Jul 08 16:34:46.532896 ip-10-0-131-106 systemd[1]: Starting Kubernetes Kubelet... Jul 08 16:34:46.965469 ip-10-0-131-106 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 16:34:46.965469 ip-10-0-131-106 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 16:34:46.965469 ip-10-0-131-106 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 16:34:46.965469 ip-10-0-131-106 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 16:34:46.965469 ip-10-0-131-106 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 16:34:46.968261 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.968119 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 16:34:46.973037 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973015 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:46.973037 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973037 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973043 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973046 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973049 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973053 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973056 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973059 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973061 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973064 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973067 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973071 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973073 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973076 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973079 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973081 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973084 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973087 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973090 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973092 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973095 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973098 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:46.973102 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973101 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973103 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973108 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973111 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973114 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973117 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973119 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973122 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973125 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973127 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973130 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973132 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973135 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973138 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973142 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973146 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973149 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973152 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973154 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:46.973630 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973157 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973160 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973163 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973167 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973170 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973174 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973177 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973181 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973184 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973186 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973190 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973193 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973195 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973198 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973200 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973204 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973207 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973210 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973213 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:46.974098 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973216 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973219 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973222 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973225 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973227 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973230 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973232 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973237 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973240 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973243 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973246 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973249 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973252 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973255 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973258 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973261 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973264 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973266 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973269 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:46.974565 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973271 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973274 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973276 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973279 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973281 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973284 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973287 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973289 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973291 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973296 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973299 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973302 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973304 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973307 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973309 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973312 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973315 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973317 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973320 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.973322 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:46.975056 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974148 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974157 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974162 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974167 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974170 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974174 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974177 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974180 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974183 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974186 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974189 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974192 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974195 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974198 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974200 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974203 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974206 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974208 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974211 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974214 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:46.975592 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974216 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974220 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974224 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974227 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974230 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974232 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974235 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974238 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974240 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974243 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974245 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974248 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974250 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974253 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974255 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974258 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974260 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974263 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974266 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:46.976138 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974269 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974271 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974274 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974276 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974279 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974282 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974285 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974287 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974290 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974293 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974295 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974298 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974300 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974303 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974306 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974309 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974312 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974315 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974317 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974320 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:46.976681 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974323 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974325 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974328 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974330 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974333 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974335 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974338 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974341 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974343 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974346 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974348 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974351 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974355 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974357 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974360 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974363 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974365 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974368 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974370 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974373 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:46.977183 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974375 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974378 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974380 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974383 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974385 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974388 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974392 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974395 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974398 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974400 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974403 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974406 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974409 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974414 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974419 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974423 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974427 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974430 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974432 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:46.977702 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974435 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974897 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974905 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974910 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974913 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974917 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974920 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974923 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974926 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974928 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974931 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974934 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974936 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974939 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974942 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974945 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974947 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974950 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974953 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974956 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:46.978238 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974959 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974962 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974964 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974968 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974972 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974976 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974979 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974982 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974985 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974988 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974991 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974993 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974996 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.974998 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975001 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975004 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975006 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975009 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975018 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975026 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:46.978787 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975029 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975032 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975034 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975037 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975040 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975043 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975045 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975048 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975051 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975054 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975057 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975060 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975063 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975066 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975070 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975073 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975075 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975078 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975081 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975083 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:46.979282 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975095 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975098 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975101 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975104 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975106 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975109 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975112 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975115 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975117 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975120 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975123 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975156 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975159 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975163 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975166 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975174 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975177 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975180 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975183 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975186 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:46.979881 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975190 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975193 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975197 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975200 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975204 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975207 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975210 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975212 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975215 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975218 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975220 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975224 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975226 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975229 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975231 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975234 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975237 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975240 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975242 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.975245 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:46.980400 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975328 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975336 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975352 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975361 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975369 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975373 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975378 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975384 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975387 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975390 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975394 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975398 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975401 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975405 2567 flags.go:64] FLAG: --cgroup-root="" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975408 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975411 2567 flags.go:64] FLAG: --client-ca-file="" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975414 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975418 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975425 2567 flags.go:64] FLAG: --cluster-domain="" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975428 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975431 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975434 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975439 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975443 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 16:34:46.980939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975446 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975450 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975454 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975457 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975460 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975464 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975467 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975471 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975476 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975479 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975482 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975487 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975492 2567 flags.go:64] FLAG: --enable-server="true" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975496 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975502 2567 flags.go:64] FLAG: --event-burst="100" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975505 2567 flags.go:64] FLAG: --event-qps="50" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975508 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975511 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975515 2567 flags.go:64] FLAG: --eviction-hard="" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975519 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975522 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975525 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975529 2567 flags.go:64] FLAG: --eviction-soft="" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975532 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975535 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 16:34:46.981530 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975539 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975542 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975545 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975548 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975551 2567 flags.go:64] FLAG: --feature-gates="" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975559 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975563 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975566 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975570 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975573 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975576 2567 flags.go:64] FLAG: --help="false" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975579 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-131-106.ec2.internal" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975583 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975586 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975589 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975593 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975597 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975617 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975622 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975626 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975629 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975641 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975644 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975647 2567 flags.go:64] FLAG: --kube-reserved="" Jul 08 16:34:46.982203 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975650 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975653 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975656 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975660 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975663 2567 flags.go:64] FLAG: --lock-file="" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975665 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975668 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975671 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975678 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975681 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975684 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975687 2567 flags.go:64] FLAG: --logging-format="text" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975690 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975693 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975696 2567 flags.go:64] FLAG: --manifest-url="" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975699 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975704 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975707 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975711 2567 flags.go:64] FLAG: --max-pods="110" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975715 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975718 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975721 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975724 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975727 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975730 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 16:34:46.982903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975733 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975742 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975745 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975749 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975752 2567 flags.go:64] FLAG: --pod-cidr="" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975762 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975768 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975772 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975776 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975779 2567 flags.go:64] FLAG: --port="10250" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975782 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975785 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0185fb69e6548b46d" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975788 2567 flags.go:64] FLAG: --qos-reserved="" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975791 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975794 2567 flags.go:64] FLAG: --register-node="true" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975798 2567 flags.go:64] FLAG: --register-with-taints="" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975802 2567 flags.go:64] FLAG: --registry-burst="10" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975805 2567 flags.go:64] FLAG: --registry-qps="5" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975808 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975811 2567 flags.go:64] FLAG: --reserved-memory="" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975815 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975819 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975822 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975825 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975829 2567 flags.go:64] FLAG: --runonce="false" Jul 08 16:34:46.983577 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975832 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975835 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975838 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975841 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975844 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975847 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975850 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975854 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975857 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975860 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975863 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975866 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975870 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975879 2567 flags.go:64] FLAG: --system-cgroups="" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975883 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975889 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975892 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975895 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975901 2567 flags.go:64] FLAG: --tls-min-version="" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975904 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975907 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975910 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975913 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975916 2567 flags.go:64] FLAG: --v="2" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975921 2567 flags.go:64] FLAG: --version="false" Jul 08 16:34:46.984275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975925 2567 flags.go:64] FLAG: --vmodule="" Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975929 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.975932 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976078 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976083 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976086 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976090 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976093 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976096 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976099 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976102 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976105 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976107 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976110 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976113 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976116 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976119 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976121 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976124 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:46.984949 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976127 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976129 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976133 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976135 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976138 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976141 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976143 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976146 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976149 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976152 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976155 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976158 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976161 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976163 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976166 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976169 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976171 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976174 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976176 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976179 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:46.985444 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976182 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976185 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976187 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976190 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976193 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976195 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976200 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976203 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976209 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976214 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976216 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976219 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976222 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976225 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976228 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976231 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976234 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976237 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976240 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976242 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:46.986036 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976245 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976248 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976251 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976253 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976256 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976259 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976262 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976265 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976267 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976270 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976273 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976276 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976278 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976281 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976284 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976287 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976290 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976292 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976295 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976298 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:46.986543 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976304 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976308 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976310 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976313 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976316 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976319 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976322 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976327 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976334 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976337 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976341 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976345 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976349 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976352 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976355 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976359 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976362 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976365 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:46.987070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976368 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976371 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976374 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976377 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.976379 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.976389 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.984419 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.984443 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.984465 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.984471 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984549 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984555 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984560 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984566 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:46.987521 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984570 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984573 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984577 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984580 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984583 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984586 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984589 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984593 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984596 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984598 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984618 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984621 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984624 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984627 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984630 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984632 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984635 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984638 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984641 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984644 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:46.987903 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984646 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984649 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984652 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984655 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984658 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984669 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984673 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984675 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984678 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984681 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984684 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984687 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984690 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984693 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984695 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984698 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984701 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984704 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984706 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984709 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:46.988454 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984712 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984715 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984718 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984720 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984723 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984727 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984730 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984733 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984736 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984739 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984742 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984744 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984747 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984750 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984752 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984755 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984759 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984761 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984770 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984773 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:46.989001 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984775 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984778 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984781 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984784 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984786 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984789 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984792 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984795 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984797 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984800 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984802 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984805 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984809 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984811 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984814 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984818 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984822 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984826 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984829 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984832 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:46.989572 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984835 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984838 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984841 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984843 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984846 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984849 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984851 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984854 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984857 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984859 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984862 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984871 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984874 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984877 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.984880 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:46.990209 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.984886 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985051 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985058 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985061 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985065 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985068 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985071 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985074 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985077 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985080 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985083 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985087 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985090 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985093 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985109 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985113 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985116 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985119 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985122 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:46.990736 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985125 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985128 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985130 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985133 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985136 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985138 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985141 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985143 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985146 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985149 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985158 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985160 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985163 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985166 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985168 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985171 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985174 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985176 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985179 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:46.991218 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985182 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985184 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985188 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985193 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985196 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985199 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985201 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985204 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985206 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985209 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985212 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985215 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985217 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985220 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985223 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985225 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985228 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985230 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985233 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:46.991716 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985237 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985241 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985244 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985246 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985250 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985259 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985261 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985264 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985268 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985272 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985275 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985277 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985280 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985282 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985285 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985287 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985290 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985293 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985296 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:46.992199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985298 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985301 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985304 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985311 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985313 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985316 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985319 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985322 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985324 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985327 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985330 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985332 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985335 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985338 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985340 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985343 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985346 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985348 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985351 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985361 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:46.992754 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985364 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:46.993281 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985367 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:46.993281 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985370 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:46.993281 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:46.985372 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:46.993281 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.985378 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 16:34:46.993281 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.985550 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 16:34:46.993281 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.988038 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 16:34:46.993281 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.990345 2567 server.go:1019] "Starting client certificate rotation" Jul 08 16:34:46.993281 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.990463 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 16:34:46.993281 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.990504 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 16:34:46.994176 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:46.994119 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 16:34:47.001915 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.001882 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 16:34:47.015988 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.015965 2567 log.go:25] "Validated CRI v1 runtime API" Jul 08 16:34:47.018508 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.018491 2567 log.go:25] "Validated CRI v1 image API" Jul 08 16:34:47.021219 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.021187 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 16:34:47.025207 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.025181 2567 fs.go:135] Filesystem UUIDs: map[74d8508c-50fb-42ab-85f6-54f7ccae1a0f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 db762068-0864-4f30-a167-b62f755e1996:/dev/nvme0n1p3] Jul 08 16:34:47.025297 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.025205 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 16:34:47.029859 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.029833 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 16:34:47.031641 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.031446 2567 manager.go:216] Machine: {Timestamp:2026-07-08 16:34:47.029642418 +0000 UTC m=+0.367566899 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3192972 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d84062a6ec52955649d7ecfb6897f SystemUUID:ec2d8406-2a6e-c529-5564-9d7ecfb6897f BootID:5d5ed198-27f3-422d-bc65-143bfb536df2 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:09:c5:0a:f0:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:09:c5:0a:f0:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:ca:39:bd:c5:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 16:34:47.031641 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.031631 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 16:34:47.031772 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.031760 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 16:34:47.036069 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.036008 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 16:34:47.036248 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.036069 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-106.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 16:34:47.036941 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.036922 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 16:34:47.036941 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.036942 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 16:34:47.037019 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.036951 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 16:34:47.037700 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.037681 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 16:34:47.039213 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.039198 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 16:34:47.042739 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.042721 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 08 16:34:47.042954 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.042943 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 16:34:47.042988 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.042983 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 08 16:34:47.043029 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.042995 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 16:34:47.043029 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.043012 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 16:34:47.043029 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.043026 2567 kubelet.go:398] "Adding apiserver pod source" Jul 08 16:34:47.043115 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.043037 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 16:34:47.043584 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.043569 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 16:34:47.043658 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.043597 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 16:34:47.046243 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.046222 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 16:34:47.048554 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.048510 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 16:34:47.048554 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.048558 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 16:34:47.050095 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.050078 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 16:34:47.050194 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.050111 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 16:34:47.050194 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.050120 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 16:34:47.050194 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.050128 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 16:34:47.050194 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.050142 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 16:34:47.050194 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.050151 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 16:34:47.050194 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.050165 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 16:34:47.050194 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.050174 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 16:34:47.050194 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.050191 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 16:34:47.050444 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.050201 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 16:34:47.050444 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.050216 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 16:34:47.050444 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.050227 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 16:34:47.052300 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.052110 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 16:34:47.052300 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.052192 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 16:34:47.056693 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.056675 2567 server.go:1268] "Started kubelet" Jul 08 16:34:47.056789 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.056758 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 16:34:47.056883 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.056829 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 16:34:47.056952 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.056920 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 16:34:47.057616 ip-10-0-131-106 systemd[1]: Started Kubernetes Kubelet. Jul 08 16:34:47.058695 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.058558 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 16:34:47.058781 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.058687 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 16:34:47.058828 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.058796 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 16:34:47.059246 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.059228 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 08 16:34:47.059323 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.059259 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 16:34:47.064855 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.063689 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-106.ec2.internal.18c05db59dccee49 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-106.ec2.internal,UID:ip-10-0-131-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-106.ec2.internal,},FirstTimestamp:2026-07-08 16:34:47.056633417 +0000 UTC m=+0.394557898,LastTimestamp:2026-07-08 16:34:47.056633417 +0000 UTC m=+0.394557898,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-106.ec2.internal,}" Jul 08 16:34:47.065086 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.065056 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wvsbn" Jul 08 16:34:47.065175 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.065083 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 16:34:47.068216 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.068198 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 16:34:47.068313 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.068272 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 16:34:47.068368 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.068312 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:47.068922 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.068897 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 16:34:47.068922 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.068920 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 16:34:47.069158 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.068907 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 16:34:47.069158 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.069057 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 08 16:34:47.069158 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.069066 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 08 16:34:47.069295 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.069180 2567 factory.go:55] Registering systemd factory Jul 08 16:34:47.069295 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.069197 2567 factory.go:223] Registration of the systemd container factory successfully Jul 08 16:34:47.069596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.069574 2567 factory.go:153] Registering CRI-O factory Jul 08 16:34:47.069718 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.069613 2567 factory.go:223] Registration of the crio container factory successfully Jul 08 16:34:47.069718 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.069680 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 16:34:47.069826 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.069722 2567 factory.go:103] Registering Raw factory Jul 08 16:34:47.069826 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.069734 2567 manager.go:1196] Started watching for new ooms in manager Jul 08 16:34:47.070387 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.070370 2567 manager.go:349] Starting recovery of all containers Jul 08 16:34:47.074346 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.074323 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wvsbn" Jul 08 16:34:47.074831 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.074783 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 16:34:47.074972 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.074853 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 16:34:47.085634 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.085473 2567 manager.go:354] Recovery completed Jul 08 16:34:47.086993 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.086972 2567 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 08 16:34:47.090324 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.090310 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:47.092471 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.092446 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:47.092592 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.092490 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:47.092592 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.092505 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:47.093144 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.093129 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 16:34:47.093144 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.093141 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 16:34:47.093260 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.093149 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:47.093260 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.093159 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 08 16:34:47.093960 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.093946 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:47.094020 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.093975 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:47.094020 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.093988 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:47.094383 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.094372 2567 policy_none.go:49] "None policy: Start" Jul 08 16:34:47.094415 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.094390 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 16:34:47.094415 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.094400 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 16:34:47.095685 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.095672 2567 policy_none.go:47] "Start" Jul 08 16:34:47.138417 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.138393 2567 manager.go:337] "Starting Device Plugin manager" Jul 08 16:34:47.138523 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.138447 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 16:34:47.138523 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.138464 2567 server.go:87] "Starting device plugin registration server" Jul 08 16:34:47.138839 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.138824 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 16:34:47.138873 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.138842 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 16:34:47.138960 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.138941 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 16:34:47.139050 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.139036 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 16:34:47.139050 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.139049 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 16:34:47.140483 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.140462 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 16:34:47.140613 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.140512 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:47.240113 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.240064 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:47.241601 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.241190 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:47.241601 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.241220 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:47.241601 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.241232 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:47.241601 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.241266 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.245435 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.245395 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 16:34:47.246788 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.246768 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 16:34:47.246904 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.246816 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 16:34:47.246904 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.246846 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 16:34:47.246904 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.246891 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 16:34:47.249833 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.249806 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:47.251875 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.251855 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.252002 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.251887 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-106.ec2.internal\": node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:47.333594 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.333473 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:47.347620 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.347588 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal"] Jul 08 16:34:47.347701 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.347688 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:47.348822 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.348806 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:47.348883 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.348838 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:47.348883 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.348849 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:47.350264 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.350251 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:47.350395 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.350380 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.350432 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.350413 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:47.351092 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.351066 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:47.351167 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.351094 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:47.351167 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.351109 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:47.351249 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.351178 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:47.351249 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.351201 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:47.351249 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.351212 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:47.352623 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.352607 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.352682 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.352639 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:47.353467 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.353446 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:47.353467 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.353482 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:47.353667 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.353496 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:47.371597 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.371561 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dee390bc22bbe9a006e589c9e7a83c0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal\" (UID: \"dee390bc22bbe9a006e589c9e7a83c0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.371597 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.371600 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dee390bc22bbe9a006e589c9e7a83c0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal\" (UID: \"dee390bc22bbe9a006e589c9e7a83c0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.371800 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.371630 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/188ef7b029f22b3628e6f2183332d139-config\") pod \"kube-apiserver-proxy-ip-10-0-131-106.ec2.internal\" (UID: \"188ef7b029f22b3628e6f2183332d139\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.377550 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.377529 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-106.ec2.internal\" not found" node="ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.382647 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.382626 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-106.ec2.internal\" not found" node="ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.433727 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.433694 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:47.472358 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.472326 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dee390bc22bbe9a006e589c9e7a83c0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal\" (UID: \"dee390bc22bbe9a006e589c9e7a83c0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.472585 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.472372 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dee390bc22bbe9a006e589c9e7a83c0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal\" (UID: \"dee390bc22bbe9a006e589c9e7a83c0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.472585 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.472398 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/188ef7b029f22b3628e6f2183332d139-config\") pod \"kube-apiserver-proxy-ip-10-0-131-106.ec2.internal\" (UID: \"188ef7b029f22b3628e6f2183332d139\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.472585 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.472453 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/188ef7b029f22b3628e6f2183332d139-config\") pod \"kube-apiserver-proxy-ip-10-0-131-106.ec2.internal\" (UID: \"188ef7b029f22b3628e6f2183332d139\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.472585 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.472453 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dee390bc22bbe9a006e589c9e7a83c0e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal\" (UID: \"dee390bc22bbe9a006e589c9e7a83c0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.472585 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.472461 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dee390bc22bbe9a006e589c9e7a83c0e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal\" (UID: \"dee390bc22bbe9a006e589c9e7a83c0e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.533954 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.533919 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:47.635501 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.635429 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:47.681323 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.681295 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.685873 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.685600 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jul 08 16:34:47.736603 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.736558 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:47.840960 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.840901 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:47.945099 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:47.944996 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:47.988779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.988745 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 16:34:47.989322 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:47.988913 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 16:34:48.046045 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:48.046009 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:48.077159 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:48.077119 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 16:29:47 +0000 UTC" deadline="2028-04-21 17:47:11.015601316 +0000 UTC" Jul 08 16:34:48.077159 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:48.077153 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15673h12m22.938452226s" Jul 08 16:34:48.147160 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:48.147119 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:48.203030 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:48.202924 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:48.249603 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:48.249549 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:48.350065 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:48.350028 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:48.351881 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:48.351861 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:48.450498 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:48.450460 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jul 08 16:34:48.493849 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:48.493767 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:48.517508 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:48.517476 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188ef7b029f22b3628e6f2183332d139.slice/crio-956d708b209b9d3105759f96835d9b0a84d40b8da020e1b9c323a798397dbdbb WatchSource:0}: Error finding container 956d708b209b9d3105759f96835d9b0a84d40b8da020e1b9c323a798397dbdbb: Status 404 returned error can't find the container with id 956d708b209b9d3105759f96835d9b0a84d40b8da020e1b9c323a798397dbdbb Jul 08 16:34:48.517845 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:48.517828 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee390bc22bbe9a006e589c9e7a83c0e.slice/crio-d66779e87b1130677519c4f826841c59fc241fdbf104f8373ecec2b726f944ac WatchSource:0}: Error finding container d66779e87b1130677519c4f826841c59fc241fdbf104f8373ecec2b726f944ac: Status 404 returned error can't find the container with id d66779e87b1130677519c4f826841c59fc241fdbf104f8373ecec2b726f944ac Jul 08 16:34:48.526385 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:48.526367 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:34:48.568488 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:48.568443 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jul 08 16:34:48.581782 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:48.581757 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 16:34:48.582922 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:48.582903 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jul 08 16:34:48.590038 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:48.590020 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 16:34:49.044928 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.044900 2567 apiserver.go:52] "Watching apiserver" Jul 08 16:34:49.053884 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.053838 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 16:34:49.055442 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.055409 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-7b6vx","openshift-image-registry/node-ca-58tpf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal","openshift-multus/multus-additional-cni-plugins-cxqqv","openshift-multus/network-metrics-daemon-t6fms","openshift-network-diagnostics/network-check-target-ntrb9","openshift-network-operator/iptables-alerter-fsmqh","kube-system/global-pull-secret-syncer-xrljb","kube-system/konnectivity-agent-jtjn9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd","openshift-cluster-node-tuning-operator/tuned-ct2c8","openshift-multus/multus-gbwgs","openshift-ovn-kubernetes/ovnkube-node-t6nhn","kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal"] Jul 08 16:34:49.057427 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.057203 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fsmqh" Jul 08 16:34:49.058926 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.058899 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.060806 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.060782 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:34:49.061158 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.061128 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:49.061268 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.061194 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:34:49.061787 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.061765 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4p7ft\"" Jul 08 16:34:49.062034 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.062008 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 16:34:49.062284 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.062269 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 16:34:49.062651 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.062630 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.064176 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.064155 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:49.064279 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.064240 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:34:49.066580 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.066159 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:34:49.066580 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.066232 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:34:49.067721 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.067385 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jtjn9" Jul 08 16:34:49.068285 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.068264 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 16:34:49.068579 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.068531 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 16:34:49.068579 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.068573 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 16:34:49.068762 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.068742 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 16:34:49.068976 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.068939 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 16:34:49.068976 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.068951 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 16:34:49.069119 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.069091 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 16:34:49.069180 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.069138 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 16:34:49.069479 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.069458 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lc84l\"" Jul 08 16:34:49.069699 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.069682 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 16:34:49.070495 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.070474 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7b6vx" Jul 08 16:34:49.070952 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.070932 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 16:34:49.071265 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.071239 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 16:34:49.071351 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.071277 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9xwsd\"" Jul 08 16:34:49.073703 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.072179 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 16:34:49.073703 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.072393 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-58tpf" Jul 08 16:34:49.073703 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.072433 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 16:34:49.073703 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.073209 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h9h2l\"" Jul 08 16:34:49.074483 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.074452 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 16:34:49.074570 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.074521 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 16:34:49.074788 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.074770 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wgbd8\"" Jul 08 16:34:49.075584 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.075560 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 16:34:49.077504 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.077038 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.077949 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.077786 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 16:34:49.078063 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.078027 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z4c77\"" Jul 08 16:34:49.078305 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.078287 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 16:34:49.078803 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.078783 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.079183 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.079156 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 16:34:49.080085 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.079921 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 16:34:49.080483 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.080386 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.081674 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.081650 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22jw2\" (UniqueName: \"kubernetes.io/projected/1fd27338-5a40-47d4-83e0-a1b0097d74db-kube-api-access-22jw2\") pod \"iptables-alerter-fsmqh\" (UID: \"1fd27338-5a40-47d4-83e0-a1b0097d74db\") " pod="openshift-network-operator/iptables-alerter-fsmqh" Jul 08 16:34:49.081674 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.081690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phllk\" (UniqueName: \"kubernetes.io/projected/03cd9c94-0548-4f48-b538-e406e0c32b7f-kube-api-access-phllk\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.081849 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.081718 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d8136738-b751-40ab-be2b-3d1a63f618a4-agent-certs\") pod \"konnectivity-agent-jtjn9\" (UID: \"d8136738-b751-40ab-be2b-3d1a63f618a4\") " pod="kube-system/konnectivity-agent-jtjn9" Jul 08 16:34:49.081849 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.081746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-kubelet\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.081849 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.081774 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-run-ovn\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.081849 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.081800 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:49.081849 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.081833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh6v6\" (UniqueName: \"kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6\") pod \"network-check-target-ntrb9\" (UID: \"5938b63a-f2f4-4903-b7ad-bacf3f4c10b5\") " pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:34:49.082132 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.081858 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1fd27338-5a40-47d4-83e0-a1b0097d74db-iptables-alerter-script\") pod \"iptables-alerter-fsmqh\" (UID: \"1fd27338-5a40-47d4-83e0-a1b0097d74db\") " pod="openshift-network-operator/iptables-alerter-fsmqh" Jul 08 16:34:49.082132 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.081887 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-log-socket\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.082132 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.081914 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.082132 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.081941 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/560f38bc-2223-47dc-bbed-7d8750d7894a-kubelet-config\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:49.082132 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.081965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d8136738-b751-40ab-be2b-3d1a63f618a4-konnectivity-ca\") pod \"konnectivity-agent-jtjn9\" (UID: \"d8136738-b751-40ab-be2b-3d1a63f618a4\") " pod="kube-system/konnectivity-agent-jtjn9" Jul 08 16:34:49.082132 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.081994 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-run-netns\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.082132 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-etc-openvswitch\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.082132 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8f20d10-33c9-46ef-b331-51e7ce568566-env-overrides\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.082132 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082076 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8f20d10-33c9-46ef-b331-51e7ce568566-ovnkube-script-lib\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.082132 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082102 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3c1f306-e11e-46e6-8ac6-e96e6652587d-tmp-dir\") pod \"node-resolver-7b6vx\" (UID: \"b3c1f306-e11e-46e6-8ac6-e96e6652587d\") " pod="openshift-dns/node-resolver-7b6vx" Jul 08 16:34:49.082132 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082130 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03cd9c94-0548-4f48-b538-e406e0c32b7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082157 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03cd9c94-0548-4f48-b538-e406e0c32b7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082188 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj8dw\" (UniqueName: \"kubernetes.io/projected/b3c1f306-e11e-46e6-8ac6-e96e6652587d-kube-api-access-lj8dw\") pod \"node-resolver-7b6vx\" (UID: \"b3c1f306-e11e-46e6-8ac6-e96e6652587d\") " pod="openshift-dns/node-resolver-7b6vx" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082219 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03cd9c94-0548-4f48-b538-e406e0c32b7f-os-release\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082245 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-node-log\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082270 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-cni-netd\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082296 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8f20d10-33c9-46ef-b331-51e7ce568566-ovn-node-metrics-cert\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082322 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc2j4\" (UniqueName: \"kubernetes.io/projected/b8f20d10-33c9-46ef-b331-51e7ce568566-kube-api-access-fc2j4\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082350 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082377 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fd27338-5a40-47d4-83e0-a1b0097d74db-host-slash\") pod \"iptables-alerter-fsmqh\" (UID: \"1fd27338-5a40-47d4-83e0-a1b0097d74db\") " pod="openshift-network-operator/iptables-alerter-fsmqh" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082403 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03cd9c94-0548-4f48-b538-e406e0c32b7f-cnibin\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082448 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-slash\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082475 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-cni-bin\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082500 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8f20d10-33c9-46ef-b331-51e7ce568566-ovnkube-config\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082523 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/560f38bc-2223-47dc-bbed-7d8750d7894a-dbus\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:49.082566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03cd9c94-0548-4f48-b538-e406e0c32b7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.083087 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082582 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03cd9c94-0548-4f48-b538-e406e0c32b7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.083087 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-run-systemd\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.083087 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-var-lib-openvswitch\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.083087 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-run-openvswitch\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.083087 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082712 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.083087 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082738 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03cd9c94-0548-4f48-b538-e406e0c32b7f-system-cni-dir\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.083087 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082769 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-systemd-units\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.083087 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082797 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xfhv\" (UniqueName: \"kubernetes.io/projected/31bdf910-65ce-489b-ba71-64d9080e8443-kube-api-access-9xfhv\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:49.083087 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.082825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3c1f306-e11e-46e6-8ac6-e96e6652587d-hosts-file\") pod \"node-resolver-7b6vx\" (UID: \"b3c1f306-e11e-46e6-8ac6-e96e6652587d\") " pod="openshift-dns/node-resolver-7b6vx" Jul 08 16:34:49.083689 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.083650 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 16:34:49.083775 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.083689 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:34:49.083775 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.083713 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cz7xb\"" Jul 08 16:34:49.084072 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.084053 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 16:34:49.084183 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.084117 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7s65t\"" Jul 08 16:34:49.084244 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.084198 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 16:34:49.084302 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.084288 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dlh8l\"" Jul 08 16:34:49.084873 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.084852 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 16:34:49.105961 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.105933 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 16:34:49.140020 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.139983 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z5rbp" Jul 08 16:34:49.155998 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.155960 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z5rbp" Jul 08 16:34:49.169945 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.169916 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 16:34:49.183989 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.183951 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-cnibin\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.184166 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.183998 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-multus-socket-dir-parent\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.184166 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184029 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xfhv\" (UniqueName: \"kubernetes.io/projected/31bdf910-65ce-489b-ba71-64d9080e8443-kube-api-access-9xfhv\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:49.184166 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184055 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phllk\" (UniqueName: \"kubernetes.io/projected/03cd9c94-0548-4f48-b538-e406e0c32b7f-kube-api-access-phllk\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.184166 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x67f\" (UniqueName: \"kubernetes.io/projected/c8f78dae-70ef-428f-898f-49da806d8912-kube-api-access-5x67f\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.184166 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184094 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-etc-selinux\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.184166 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-sysctl-d\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.184166 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184140 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91bdeead-c876-46c5-9ca6-d6bdfa439db7-tmp\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.184473 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84099618-1b2d-4ae6-adbb-28141b6cde6d-serviceca\") pod \"node-ca-58tpf\" (UID: \"84099618-1b2d-4ae6-adbb-28141b6cde6d\") " pod="openshift-image-registry/node-ca-58tpf" Jul 08 16:34:49.184473 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184195 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-kubelet\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.184473 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184212 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:49.184473 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6v6\" (UniqueName: \"kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6\") pod \"network-check-target-ntrb9\" (UID: \"5938b63a-f2f4-4903-b7ad-bacf3f4c10b5\") " pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:34:49.184473 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1fd27338-5a40-47d4-83e0-a1b0097d74db-iptables-alerter-script\") pod \"iptables-alerter-fsmqh\" (UID: \"1fd27338-5a40-47d4-83e0-a1b0097d74db\") " pod="openshift-network-operator/iptables-alerter-fsmqh" Jul 08 16:34:49.184473 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184265 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-kubelet\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.184473 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184280 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.184473 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184331 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03cd9c94-0548-4f48-b538-e406e0c32b7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.184473 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.184344 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:49.184473 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184362 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03cd9c94-0548-4f48-b538-e406e0c32b7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.184473 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184393 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-multus-cni-dir\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.184473 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.184463 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret podName:560f38bc-2223-47dc-bbed-7d8750d7894a nodeName:}" failed. No retries permitted until 2026-07-08 16:34:49.684405089 +0000 UTC m=+3.022329586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret") pod "global-pull-secret-syncer-xrljb" (UID: "560f38bc-2223-47dc-bbed-7d8750d7894a") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184532 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-var-lib-cni-bin\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184573 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-lib-modules\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184597 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-tuned\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184616 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtbtt\" (UniqueName: \"kubernetes.io/projected/84099618-1b2d-4ae6-adbb-28141b6cde6d-kube-api-access-rtbtt\") pod \"node-ca-58tpf\" (UID: \"84099618-1b2d-4ae6-adbb-28141b6cde6d\") " pod="openshift-image-registry/node-ca-58tpf" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184628 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03cd9c94-0548-4f48-b538-e406e0c32b7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184641 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03cd9c94-0548-4f48-b538-e406e0c32b7f-os-release\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-var-lib-kubelet\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184733 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03cd9c94-0548-4f48-b538-e406e0c32b7f-os-release\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184747 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8f20d10-33c9-46ef-b331-51e7ce568566-ovn-node-metrics-cert\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184795 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03cd9c94-0548-4f48-b538-e406e0c32b7f-cnibin\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184865 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03cd9c94-0548-4f48-b538-e406e0c32b7f-cnibin\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184907 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8f78dae-70ef-428f-898f-49da806d8912-cni-binary-copy\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184942 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-sysconfig\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.184978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-sys\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-cni-bin\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185037 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8f20d10-33c9-46ef-b331-51e7ce568566-ovnkube-config\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.185168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185075 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-cni-bin\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.185942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185080 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03cd9c94-0548-4f48-b538-e406e0c32b7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.185942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185079 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1fd27338-5a40-47d4-83e0-a1b0097d74db-iptables-alerter-script\") pod \"iptables-alerter-fsmqh\" (UID: \"1fd27338-5a40-47d4-83e0-a1b0097d74db\") " pod="openshift-network-operator/iptables-alerter-fsmqh" Jul 08 16:34:49.185942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185148 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/560f38bc-2223-47dc-bbed-7d8750d7894a-dbus\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:49.185942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185185 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 16:34:49.185942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185283 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/560f38bc-2223-47dc-bbed-7d8750d7894a-dbus\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:49.185942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185281 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03cd9c94-0548-4f48-b538-e406e0c32b7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.185942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185321 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-hostroot\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.185942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185735 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8f20d10-33c9-46ef-b331-51e7ce568566-ovnkube-config\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.185942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185347 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-multus-conf-dir\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.185942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-run-multus-certs\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.185942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185884 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-device-dir\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.185942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185914 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-run-systemd\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.185942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185911 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03cd9c94-0548-4f48-b538-e406e0c32b7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185958 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-run-openvswitch\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.185992 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-sys-fs\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186003 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-run-systemd\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-var-lib-kubelet\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5g9b\" (UniqueName: \"kubernetes.io/projected/91bdeead-c876-46c5-9ca6-d6bdfa439db7-kube-api-access-w5g9b\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186046 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-run-openvswitch\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186074 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-systemd-units\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186102 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3c1f306-e11e-46e6-8ac6-e96e6652587d-hosts-file\") pod \"node-resolver-7b6vx\" (UID: \"b3c1f306-e11e-46e6-8ac6-e96e6652587d\") " pod="openshift-dns/node-resolver-7b6vx" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186131 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-systemd-units\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22jw2\" (UniqueName: \"kubernetes.io/projected/1fd27338-5a40-47d4-83e0-a1b0097d74db-kube-api-access-22jw2\") pod \"iptables-alerter-fsmqh\" (UID: \"1fd27338-5a40-47d4-83e0-a1b0097d74db\") " pod="openshift-network-operator/iptables-alerter-fsmqh" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186212 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d8136738-b751-40ab-be2b-3d1a63f618a4-agent-certs\") pod \"konnectivity-agent-jtjn9\" (UID: \"d8136738-b751-40ab-be2b-3d1a63f618a4\") " pod="kube-system/konnectivity-agent-jtjn9" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186219 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3c1f306-e11e-46e6-8ac6-e96e6652587d-hosts-file\") pod \"node-resolver-7b6vx\" (UID: \"b3c1f306-e11e-46e6-8ac6-e96e6652587d\") " pod="openshift-dns/node-resolver-7b6vx" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186241 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-registration-dir\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186272 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-sysctl-conf\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186297 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-run-ovn\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-run-netns\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.186567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186381 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-run-ovn\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186422 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8f78dae-70ef-428f-898f-49da806d8912-multus-daemon-config\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186461 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-socket-dir\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186486 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-kubernetes\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-log-socket\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186562 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186582 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-log-socket\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186593 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/560f38bc-2223-47dc-bbed-7d8750d7894a-kubelet-config\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186633 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d8136738-b751-40ab-be2b-3d1a63f618a4-konnectivity-ca\") pod \"konnectivity-agent-jtjn9\" (UID: \"d8136738-b751-40ab-be2b-3d1a63f618a4\") " pod="kube-system/konnectivity-agent-jtjn9" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186642 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/560f38bc-2223-47dc-bbed-7d8750d7894a-kubelet-config\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186645 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-etc-kubernetes\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-systemd\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186726 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-run-netns\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-etc-openvswitch\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186776 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8f20d10-33c9-46ef-b331-51e7ce568566-env-overrides\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186792 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-run-netns\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.187441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186800 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8f20d10-33c9-46ef-b331-51e7ce568566-ovnkube-script-lib\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186828 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-etc-openvswitch\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3c1f306-e11e-46e6-8ac6-e96e6652587d-tmp-dir\") pod \"node-resolver-7b6vx\" (UID: \"b3c1f306-e11e-46e6-8ac6-e96e6652587d\") " pod="openshift-dns/node-resolver-7b6vx" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186907 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84099618-1b2d-4ae6-adbb-28141b6cde6d-host\") pod \"node-ca-58tpf\" (UID: \"84099618-1b2d-4ae6-adbb-28141b6cde6d\") " pod="openshift-image-registry/node-ca-58tpf" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186937 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj8dw\" (UniqueName: \"kubernetes.io/projected/b3c1f306-e11e-46e6-8ac6-e96e6652587d-kube-api-access-lj8dw\") pod \"node-resolver-7b6vx\" (UID: \"b3c1f306-e11e-46e6-8ac6-e96e6652587d\") " pod="openshift-dns/node-resolver-7b6vx" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186959 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-var-lib-cni-multus\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.186982 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-modprobe-d\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187086 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-host\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187114 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-node-log\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187116 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3c1f306-e11e-46e6-8ac6-e96e6652587d-tmp-dir\") pod \"node-resolver-7b6vx\" (UID: \"b3c1f306-e11e-46e6-8ac6-e96e6652587d\") " pod="openshift-dns/node-resolver-7b6vx" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187137 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-cni-netd\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc2j4\" (UniqueName: \"kubernetes.io/projected/b8f20d10-33c9-46ef-b331-51e7ce568566-kube-api-access-fc2j4\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187194 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-node-log\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187193 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187222 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d8136738-b751-40ab-be2b-3d1a63f618a4-konnectivity-ca\") pod \"konnectivity-agent-jtjn9\" (UID: \"d8136738-b751-40ab-be2b-3d1a63f618a4\") " pod="kube-system/konnectivity-agent-jtjn9" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187238 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-cni-netd\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.187276 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187315 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fd27338-5a40-47d4-83e0-a1b0097d74db-host-slash\") pod \"iptables-alerter-fsmqh\" (UID: \"1fd27338-5a40-47d4-83e0-a1b0097d74db\") " pod="openshift-network-operator/iptables-alerter-fsmqh" Jul 08 16:34:49.188327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fd27338-5a40-47d4-83e0-a1b0097d74db-host-slash\") pod \"iptables-alerter-fsmqh\" (UID: \"1fd27338-5a40-47d4-83e0-a1b0097d74db\") " pod="openshift-network-operator/iptables-alerter-fsmqh" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.187336 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs podName:31bdf910-65ce-489b-ba71-64d9080e8443 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:49.687315548 +0000 UTC m=+3.025240015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs") pod "network-metrics-daemon-t6fms" (UID: "31bdf910-65ce-489b-ba71-64d9080e8443") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187335 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8f20d10-33c9-46ef-b331-51e7ce568566-ovnkube-script-lib\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187367 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03cd9c94-0548-4f48-b538-e406e0c32b7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187397 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9rp4\" (UniqueName: \"kubernetes.io/projected/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-kube-api-access-t9rp4\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-slash\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187456 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-os-release\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187470 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-slash\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187480 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-run-k8s-cni-cncf-io\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187542 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-run\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187581 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-var-lib-openvswitch\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187605 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03cd9c94-0548-4f48-b538-e406e0c32b7f-system-cni-dir\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187652 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-system-cni-dir\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187665 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-var-lib-openvswitch\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187703 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8f20d10-33c9-46ef-b331-51e7ce568566-env-overrides\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.189222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187762 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03cd9c94-0548-4f48-b538-e406e0c32b7f-system-cni-dir\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.190097 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187785 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f20d10-33c9-46ef-b331-51e7ce568566-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.190097 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.187926 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03cd9c94-0548-4f48-b538-e406e0c32b7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.190323 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.190301 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8f20d10-33c9-46ef-b331-51e7ce568566-ovn-node-metrics-cert\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.190855 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.190829 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d8136738-b751-40ab-be2b-3d1a63f618a4-agent-certs\") pod \"konnectivity-agent-jtjn9\" (UID: \"d8136738-b751-40ab-be2b-3d1a63f618a4\") " pod="kube-system/konnectivity-agent-jtjn9" Jul 08 16:34:49.199065 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.199033 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:49.199065 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.199067 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:49.199284 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.199083 2567 projected.go:196] Error preparing data for projected volume kube-api-access-sh6v6 for pod openshift-network-diagnostics/network-check-target-ntrb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:49.199284 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.199164 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6 podName:5938b63a-f2f4-4903-b7ad-bacf3f4c10b5 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:49.699141629 +0000 UTC m=+3.037066097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sh6v6" (UniqueName: "kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6") pod "network-check-target-ntrb9" (UID: "5938b63a-f2f4-4903-b7ad-bacf3f4c10b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:49.207327 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.207290 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj8dw\" (UniqueName: \"kubernetes.io/projected/b3c1f306-e11e-46e6-8ac6-e96e6652587d-kube-api-access-lj8dw\") pod \"node-resolver-7b6vx\" (UID: \"b3c1f306-e11e-46e6-8ac6-e96e6652587d\") " pod="openshift-dns/node-resolver-7b6vx" Jul 08 16:34:49.211375 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.211344 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phllk\" (UniqueName: \"kubernetes.io/projected/03cd9c94-0548-4f48-b538-e406e0c32b7f-kube-api-access-phllk\") pod \"multus-additional-cni-plugins-cxqqv\" (UID: \"03cd9c94-0548-4f48-b538-e406e0c32b7f\") " pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.211574 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.211348 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22jw2\" (UniqueName: \"kubernetes.io/projected/1fd27338-5a40-47d4-83e0-a1b0097d74db-kube-api-access-22jw2\") pod \"iptables-alerter-fsmqh\" (UID: \"1fd27338-5a40-47d4-83e0-a1b0097d74db\") " pod="openshift-network-operator/iptables-alerter-fsmqh" Jul 08 16:34:49.224030 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.224000 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc2j4\" (UniqueName: \"kubernetes.io/projected/b8f20d10-33c9-46ef-b331-51e7ce568566-kube-api-access-fc2j4\") pod \"ovnkube-node-t6nhn\" (UID: \"b8f20d10-33c9-46ef-b331-51e7ce568566\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.224455 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.224426 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xfhv\" (UniqueName: \"kubernetes.io/projected/31bdf910-65ce-489b-ba71-64d9080e8443-kube-api-access-9xfhv\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:49.253514 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.253443 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" event={"ID":"dee390bc22bbe9a006e589c9e7a83c0e","Type":"ContainerStarted","Data":"d66779e87b1130677519c4f826841c59fc241fdbf104f8373ecec2b726f944ac"} Jul 08 16:34:49.254946 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.254877 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" event={"ID":"188ef7b029f22b3628e6f2183332d139","Type":"ContainerStarted","Data":"956d708b209b9d3105759f96835d9b0a84d40b8da020e1b9c323a798397dbdbb"} Jul 08 16:34:49.289032 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.288991 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-var-lib-cni-multus\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289047 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-modprobe-d\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.289275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289079 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-host\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.289275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9rp4\" (UniqueName: \"kubernetes.io/projected/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-kube-api-access-t9rp4\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.289275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289166 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-var-lib-cni-multus\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289185 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-os-release\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-run-k8s-cni-cncf-io\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289235 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-run\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.289275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289246 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-modprobe-d\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.289275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289264 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-system-cni-dir\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289318 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-cnibin\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289363 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-cnibin\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289376 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-system-cni-dir\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289381 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-multus-socket-dir-parent\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289416 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x67f\" (UniqueName: \"kubernetes.io/projected/c8f78dae-70ef-428f-898f-49da806d8912-kube-api-access-5x67f\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289426 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-run\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289334 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-os-release\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289445 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-etc-selinux\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289465 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-multus-socket-dir-parent\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289471 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-sysctl-d\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289417 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-run-k8s-cni-cncf-io\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289497 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91bdeead-c876-46c5-9ca6-d6bdfa439db7-tmp\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84099618-1b2d-4ae6-adbb-28141b6cde6d-serviceca\") pod \"node-ca-58tpf\" (UID: \"84099618-1b2d-4ae6-adbb-28141b6cde6d\") " pod="openshift-image-registry/node-ca-58tpf" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289538 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-host\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289636 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-sysctl-d\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289684 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-multus-cni-dir\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.289779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289710 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-etc-selinux\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289713 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-var-lib-cni-bin\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289753 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-lib-modules\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289756 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-var-lib-cni-bin\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289792 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-tuned\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbtt\" (UniqueName: \"kubernetes.io/projected/84099618-1b2d-4ae6-adbb-28141b6cde6d-kube-api-access-rtbtt\") pod \"node-ca-58tpf\" (UID: \"84099618-1b2d-4ae6-adbb-28141b6cde6d\") " pod="openshift-image-registry/node-ca-58tpf" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289853 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-lib-modules\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-var-lib-kubelet\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289897 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-var-lib-kubelet\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289901 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8f78dae-70ef-428f-898f-49da806d8912-cni-binary-copy\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289928 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-sysconfig\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-sys\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289971 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-multus-cni-dir\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.289999 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-hostroot\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290253 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84099618-1b2d-4ae6-adbb-28141b6cde6d-serviceca\") pod \"node-ca-58tpf\" (UID: \"84099618-1b2d-4ae6-adbb-28141b6cde6d\") " pod="openshift-image-registry/node-ca-58tpf" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290346 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-sysconfig\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290407 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-multus-conf-dir\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.290757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290469 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-sys\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290497 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-run-multus-certs\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290517 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-multus-conf-dir\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290526 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-device-dir\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290554 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8f78dae-70ef-428f-898f-49da806d8912-cni-binary-copy\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290555 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-run-multus-certs\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290577 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-sys-fs\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290603 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-var-lib-kubelet\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5g9b\" (UniqueName: \"kubernetes.io/projected/91bdeead-c876-46c5-9ca6-d6bdfa439db7-kube-api-access-w5g9b\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290632 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-device-dir\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-registration-dir\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290667 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-sys-fs\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290672 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-var-lib-kubelet\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290684 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-sysctl-conf\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290714 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-run-netns\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290727 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-registration-dir\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290740 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8f78dae-70ef-428f-898f-49da806d8912-multus-daemon-config\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.291596 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290745 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-hostroot\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.292489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-socket-dir\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.292489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290785 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-host-run-netns\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.292489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-kubernetes\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.292489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-etc-kubernetes\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.292489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290853 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-systemd\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.292489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290866 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-sysctl-conf\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.292489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290883 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84099618-1b2d-4ae6-adbb-28141b6cde6d-host\") pod \"node-ca-58tpf\" (UID: \"84099618-1b2d-4ae6-adbb-28141b6cde6d\") " pod="openshift-image-registry/node-ca-58tpf" Jul 08 16:34:49.292489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290886 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-socket-dir\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.292489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290906 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8f78dae-70ef-428f-898f-49da806d8912-etc-kubernetes\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.292489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290938 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-systemd\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.292489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.290974 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84099618-1b2d-4ae6-adbb-28141b6cde6d-host\") pod \"node-ca-58tpf\" (UID: \"84099618-1b2d-4ae6-adbb-28141b6cde6d\") " pod="openshift-image-registry/node-ca-58tpf" Jul 08 16:34:49.292489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.291016 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-kubernetes\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.292489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.291282 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8f78dae-70ef-428f-898f-49da806d8912-multus-daemon-config\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.293274 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.293231 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91bdeead-c876-46c5-9ca6-d6bdfa439db7-tmp\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.293932 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.293905 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/91bdeead-c876-46c5-9ca6-d6bdfa439db7-etc-tuned\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.313359 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.313273 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtbtt\" (UniqueName: \"kubernetes.io/projected/84099618-1b2d-4ae6-adbb-28141b6cde6d-kube-api-access-rtbtt\") pod \"node-ca-58tpf\" (UID: \"84099618-1b2d-4ae6-adbb-28141b6cde6d\") " pod="openshift-image-registry/node-ca-58tpf" Jul 08 16:34:49.318279 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.318243 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x67f\" (UniqueName: \"kubernetes.io/projected/c8f78dae-70ef-428f-898f-49da806d8912-kube-api-access-5x67f\") pod \"multus-gbwgs\" (UID: \"c8f78dae-70ef-428f-898f-49da806d8912\") " pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.318472 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.318408 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5g9b\" (UniqueName: \"kubernetes.io/projected/91bdeead-c876-46c5-9ca6-d6bdfa439db7-kube-api-access-w5g9b\") pod \"tuned-ct2c8\" (UID: \"91bdeead-c876-46c5-9ca6-d6bdfa439db7\") " pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.324913 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.324878 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9rp4\" (UniqueName: \"kubernetes.io/projected/a533c0d2-a8ef-428f-bdf1-67a3c0926c0a-kube-api-access-t9rp4\") pod \"aws-ebs-csi-driver-node-7fnnd\" (UID: \"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.374275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.374243 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fsmqh" Jul 08 16:34:49.384959 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.384927 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:34:49.393936 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.393903 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cxqqv" Jul 08 16:34:49.402264 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.402201 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jtjn9" Jul 08 16:34:49.411428 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.411384 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7b6vx" Jul 08 16:34:49.419015 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.418982 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-58tpf" Jul 08 16:34:49.428800 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.428763 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" Jul 08 16:34:49.436304 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.436267 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" Jul 08 16:34:49.443634 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.443604 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gbwgs" Jul 08 16:34:49.534930 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.534895 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:49.692831 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.692737 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:49.692831 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.692803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:49.693057 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.692941 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:49.693057 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.692949 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:49.693057 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.693032 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret podName:560f38bc-2223-47dc-bbed-7d8750d7894a nodeName:}" failed. No retries permitted until 2026-07-08 16:34:50.693011041 +0000 UTC m=+4.030935512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret") pod "global-pull-secret-syncer-xrljb" (UID: "560f38bc-2223-47dc-bbed-7d8750d7894a") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:49.693189 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.693072 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs podName:31bdf910-65ce-489b-ba71-64d9080e8443 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:50.693060121 +0000 UTC m=+4.030984589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs") pod "network-metrics-daemon-t6fms" (UID: "31bdf910-65ce-489b-ba71-64d9080e8443") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:49.794094 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:49.794049 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6v6\" (UniqueName: \"kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6\") pod \"network-check-target-ntrb9\" (UID: \"5938b63a-f2f4-4903-b7ad-bacf3f4c10b5\") " pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:34:49.794322 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.794253 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:49.794322 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.794276 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:49.794322 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.794288 2567 projected.go:196] Error preparing data for projected volume kube-api-access-sh6v6 for pod openshift-network-diagnostics/network-check-target-ntrb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:49.794466 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:49.794346 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6 podName:5938b63a-f2f4-4903-b7ad-bacf3f4c10b5 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:50.79433194 +0000 UTC m=+4.132256406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sh6v6" (UniqueName: "kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6") pod "network-check-target-ntrb9" (UID: "5938b63a-f2f4-4903-b7ad-bacf3f4c10b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:50.158350 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:50.158225 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 16:29:49 +0000 UTC" deadline="2028-04-16 00:11:12.904152314 +0000 UTC" Jul 08 16:34:50.158350 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:50.158292 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15535h36m22.74586321s" Jul 08 16:34:50.479117 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:50.479083 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91bdeead_c876_46c5_9ca6_d6bdfa439db7.slice/crio-ad863a6a61e69adf4e718978ffd7d5906073378eafea0647900e5dd2f731417c WatchSource:0}: Error finding container ad863a6a61e69adf4e718978ffd7d5906073378eafea0647900e5dd2f731417c: Status 404 returned error can't find the container with id ad863a6a61e69adf4e718978ffd7d5906073378eafea0647900e5dd2f731417c Jul 08 16:34:50.483877 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:50.483845 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c1f306_e11e_46e6_8ac6_e96e6652587d.slice/crio-07e2fe9ae19b208dee8ed5c46f5c4e4a4740acc7724613d12337ffcb03b031eb WatchSource:0}: Error finding container 07e2fe9ae19b208dee8ed5c46f5c4e4a4740acc7724613d12337ffcb03b031eb: Status 404 returned error can't find the container with id 07e2fe9ae19b208dee8ed5c46f5c4e4a4740acc7724613d12337ffcb03b031eb Jul 08 16:34:50.484932 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:50.484903 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f78dae_70ef_428f_898f_49da806d8912.slice/crio-30cc21c43cee2681bf483060f7a3ae06145d70c5625ceca1baf5e8e593df8a30 WatchSource:0}: Error finding container 30cc21c43cee2681bf483060f7a3ae06145d70c5625ceca1baf5e8e593df8a30: Status 404 returned error can't find the container with id 30cc21c43cee2681bf483060f7a3ae06145d70c5625ceca1baf5e8e593df8a30 Jul 08 16:34:50.486415 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:50.486333 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f20d10_33c9_46ef_b331_51e7ce568566.slice/crio-d350c0cdd39f24fd5e6a544a8e19c2a81f73d53e336252fb635bacd45b44d19b WatchSource:0}: Error finding container d350c0cdd39f24fd5e6a544a8e19c2a81f73d53e336252fb635bacd45b44d19b: Status 404 returned error can't find the container with id d350c0cdd39f24fd5e6a544a8e19c2a81f73d53e336252fb635bacd45b44d19b Jul 08 16:34:50.487163 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:50.486996 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8136738_b751_40ab_be2b_3d1a63f618a4.slice/crio-2449782bd12147b42629b33f74555b81e4cc4ab6575f6e23b8846eea65f3600e WatchSource:0}: Error finding container 2449782bd12147b42629b33f74555b81e4cc4ab6575f6e23b8846eea65f3600e: Status 404 returned error can't find the container with id 2449782bd12147b42629b33f74555b81e4cc4ab6575f6e23b8846eea65f3600e Jul 08 16:34:50.490955 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:50.490789 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda533c0d2_a8ef_428f_bdf1_67a3c0926c0a.slice/crio-5acb3037fe7820a7110a72622f322fd7c54908b8cd84aa229d5dad68516ebe5c WatchSource:0}: Error finding container 5acb3037fe7820a7110a72622f322fd7c54908b8cd84aa229d5dad68516ebe5c: Status 404 returned error can't find the container with id 5acb3037fe7820a7110a72622f322fd7c54908b8cd84aa229d5dad68516ebe5c Jul 08 16:34:50.493261 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:50.492858 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03cd9c94_0548_4f48_b538_e406e0c32b7f.slice/crio-2d0433720283f9a7cf5e7e9450559c969a23896d6754e7f4881340e4425d0019 WatchSource:0}: Error finding container 2d0433720283f9a7cf5e7e9450559c969a23896d6754e7f4881340e4425d0019: Status 404 returned error can't find the container with id 2d0433720283f9a7cf5e7e9450559c969a23896d6754e7f4881340e4425d0019 Jul 08 16:34:50.493261 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:34:50.493210 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd27338_5a40_47d4_83e0_a1b0097d74db.slice/crio-52e5ae685c45f36eaf9e1d79f9aacae9f6780961bb5b5e14f48ceda6f3c141d0 WatchSource:0}: Error finding container 52e5ae685c45f36eaf9e1d79f9aacae9f6780961bb5b5e14f48ceda6f3c141d0: Status 404 returned error can't find the container with id 52e5ae685c45f36eaf9e1d79f9aacae9f6780961bb5b5e14f48ceda6f3c141d0 Jul 08 16:34:50.701008 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:50.700794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:50.701215 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:50.701031 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:50.701215 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:50.700958 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:50.701215 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:50.701125 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:50.701215 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:50.701140 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs podName:31bdf910-65ce-489b-ba71-64d9080e8443 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:52.701122514 +0000 UTC m=+6.039046982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs") pod "network-metrics-daemon-t6fms" (UID: "31bdf910-65ce-489b-ba71-64d9080e8443") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:50.701215 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:50.701166 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret podName:560f38bc-2223-47dc-bbed-7d8750d7894a nodeName:}" failed. No retries permitted until 2026-07-08 16:34:52.701155531 +0000 UTC m=+6.039079999 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret") pod "global-pull-secret-syncer-xrljb" (UID: "560f38bc-2223-47dc-bbed-7d8750d7894a") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:50.801599 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:50.801567 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6v6\" (UniqueName: \"kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6\") pod \"network-check-target-ntrb9\" (UID: \"5938b63a-f2f4-4903-b7ad-bacf3f4c10b5\") " pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:34:50.801792 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:50.801698 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:50.801792 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:50.801713 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:50.801792 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:50.801721 2567 projected.go:196] Error preparing data for projected volume kube-api-access-sh6v6 for pod openshift-network-diagnostics/network-check-target-ntrb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:50.801792 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:50.801772 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6 podName:5938b63a-f2f4-4903-b7ad-bacf3f4c10b5 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:52.801757492 +0000 UTC m=+6.139681959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sh6v6" (UniqueName: "kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6") pod "network-check-target-ntrb9" (UID: "5938b63a-f2f4-4903-b7ad-bacf3f4c10b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:51.159218 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.159167 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 16:29:49 +0000 UTC" deadline="2028-01-04 06:39:04.114425758 +0000 UTC" Jul 08 16:34:51.159218 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.159214 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13070h4m12.955218288s" Jul 08 16:34:51.249553 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.248036 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:34:51.249553 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:51.248182 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:34:51.249553 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.248615 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:51.249553 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:51.248719 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:34:51.249553 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.248779 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:51.249553 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:51.248866 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:34:51.273674 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.273169 2567 generic.go:356] "Generic (PLEG): container finished" podID="dee390bc22bbe9a006e589c9e7a83c0e" containerID="8bdbb285fb7bac6053af2328bb719e120425d725d4affccb352485c2e2ff12c7" exitCode=0 Jul 08 16:34:51.273674 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.273287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" event={"ID":"dee390bc22bbe9a006e589c9e7a83c0e","Type":"ContainerDied","Data":"8bdbb285fb7bac6053af2328bb719e120425d725d4affccb352485c2e2ff12c7"} Jul 08 16:34:51.283148 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.283110 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" event={"ID":"188ef7b029f22b3628e6f2183332d139","Type":"ContainerStarted","Data":"aa1a5de835366628031050bada4cefe53c6175c0f4f673b427712d4c6f70f7dc"} Jul 08 16:34:51.288761 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.288626 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" event={"ID":"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a","Type":"ContainerStarted","Data":"5acb3037fe7820a7110a72622f322fd7c54908b8cd84aa229d5dad68516ebe5c"} Jul 08 16:34:51.296824 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.296793 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-58tpf" event={"ID":"84099618-1b2d-4ae6-adbb-28141b6cde6d","Type":"ContainerStarted","Data":"9573ad25569a0e1d2bc4718cead6e70754fc8e3e7e2096169b2ca3c4e8c93b23"} Jul 08 16:34:51.307803 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.307760 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" event={"ID":"b8f20d10-33c9-46ef-b331-51e7ce568566","Type":"ContainerStarted","Data":"d350c0cdd39f24fd5e6a544a8e19c2a81f73d53e336252fb635bacd45b44d19b"} Jul 08 16:34:51.322930 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.322886 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jtjn9" event={"ID":"d8136738-b751-40ab-be2b-3d1a63f618a4","Type":"ContainerStarted","Data":"2449782bd12147b42629b33f74555b81e4cc4ab6575f6e23b8846eea65f3600e"} Jul 08 16:34:51.330312 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.330271 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" event={"ID":"91bdeead-c876-46c5-9ca6-d6bdfa439db7","Type":"ContainerStarted","Data":"ad863a6a61e69adf4e718978ffd7d5906073378eafea0647900e5dd2f731417c"} Jul 08 16:34:51.333078 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.333040 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fsmqh" event={"ID":"1fd27338-5a40-47d4-83e0-a1b0097d74db","Type":"ContainerStarted","Data":"52e5ae685c45f36eaf9e1d79f9aacae9f6780961bb5b5e14f48ceda6f3c141d0"} Jul 08 16:34:51.338542 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.338487 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqqv" event={"ID":"03cd9c94-0548-4f48-b538-e406e0c32b7f","Type":"ContainerStarted","Data":"2d0433720283f9a7cf5e7e9450559c969a23896d6754e7f4881340e4425d0019"} Jul 08 16:34:51.361194 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.361147 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gbwgs" event={"ID":"c8f78dae-70ef-428f-898f-49da806d8912","Type":"ContainerStarted","Data":"30cc21c43cee2681bf483060f7a3ae06145d70c5625ceca1baf5e8e593df8a30"} Jul 08 16:34:51.372176 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:51.371964 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7b6vx" event={"ID":"b3c1f306-e11e-46e6-8ac6-e96e6652587d","Type":"ContainerStarted","Data":"07e2fe9ae19b208dee8ed5c46f5c4e4a4740acc7724613d12337ffcb03b031eb"} Jul 08 16:34:52.387100 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:52.387063 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" event={"ID":"dee390bc22bbe9a006e589c9e7a83c0e","Type":"ContainerStarted","Data":"f95d6e762ac4b509f4108e58c9b2614a00fc444b5d0e1547eedb2696aac5bdbd"} Jul 08 16:34:52.402095 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:52.402029 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" podStartSLOduration=4.402007466 podStartE2EDuration="4.402007466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:51.307733709 +0000 UTC m=+4.645658195" watchObservedRunningTime="2026-07-08 16:34:52.402007466 +0000 UTC m=+5.739931938" Jul 08 16:34:52.720541 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:52.720442 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:52.720541 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:52.720498 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:52.720799 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:52.720668 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:52.720799 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:52.720755 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret podName:560f38bc-2223-47dc-bbed-7d8750d7894a nodeName:}" failed. No retries permitted until 2026-07-08 16:34:56.720718872 +0000 UTC m=+10.058643337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret") pod "global-pull-secret-syncer-xrljb" (UID: "560f38bc-2223-47dc-bbed-7d8750d7894a") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:52.720908 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:52.720825 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:52.720908 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:52.720861 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs podName:31bdf910-65ce-489b-ba71-64d9080e8443 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:56.720849411 +0000 UTC m=+10.058773892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs") pod "network-metrics-daemon-t6fms" (UID: "31bdf910-65ce-489b-ba71-64d9080e8443") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:52.822032 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:52.821139 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6v6\" (UniqueName: \"kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6\") pod \"network-check-target-ntrb9\" (UID: \"5938b63a-f2f4-4903-b7ad-bacf3f4c10b5\") " pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:34:52.822032 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:52.821461 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:52.822032 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:52.821488 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:52.822032 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:52.821503 2567 projected.go:196] Error preparing data for projected volume kube-api-access-sh6v6 for pod openshift-network-diagnostics/network-check-target-ntrb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:52.822032 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:52.821580 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6 podName:5938b63a-f2f4-4903-b7ad-bacf3f4c10b5 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:56.821560295 +0000 UTC m=+10.159484781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sh6v6" (UniqueName: "kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6") pod "network-check-target-ntrb9" (UID: "5938b63a-f2f4-4903-b7ad-bacf3f4c10b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:53.253286 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:53.252433 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:34:53.253286 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:53.252580 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:34:53.253286 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:53.252994 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:53.253286 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:53.253086 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:34:53.253286 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:53.253156 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:53.253286 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:53.253244 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:34:55.253983 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:55.253858 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:55.254722 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:55.253855 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:34:55.254722 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:55.253921 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:55.255400 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:55.255211 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:34:55.255681 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:55.255658 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:34:55.255746 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:55.255718 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:34:56.760267 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:56.759539 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:56.760267 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:56.759595 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:56.760267 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:56.759727 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:56.760267 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:56.759785 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret podName:560f38bc-2223-47dc-bbed-7d8750d7894a nodeName:}" failed. No retries permitted until 2026-07-08 16:35:04.759768061 +0000 UTC m=+18.097692551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret") pod "global-pull-secret-syncer-xrljb" (UID: "560f38bc-2223-47dc-bbed-7d8750d7894a") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:56.760267 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:56.760168 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:56.760267 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:56.760226 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs podName:31bdf910-65ce-489b-ba71-64d9080e8443 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:04.760208204 +0000 UTC m=+18.098132675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs") pod "network-metrics-daemon-t6fms" (UID: "31bdf910-65ce-489b-ba71-64d9080e8443") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:56.860626 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:56.860586 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6v6\" (UniqueName: \"kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6\") pod \"network-check-target-ntrb9\" (UID: \"5938b63a-f2f4-4903-b7ad-bacf3f4c10b5\") " pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:34:56.860857 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:56.860773 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:56.860857 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:56.860802 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:56.860857 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:56.860815 2567 projected.go:196] Error preparing data for projected volume kube-api-access-sh6v6 for pod openshift-network-diagnostics/network-check-target-ntrb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:56.861007 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:56.860883 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6 podName:5938b63a-f2f4-4903-b7ad-bacf3f4c10b5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:04.860864321 +0000 UTC m=+18.198788792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sh6v6" (UniqueName: "kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6") pod "network-check-target-ntrb9" (UID: "5938b63a-f2f4-4903-b7ad-bacf3f4c10b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:57.248789 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:57.248148 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:34:57.248789 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:57.248261 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:34:57.248789 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:57.248318 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:57.248789 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:57.248384 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:34:57.248789 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:57.248471 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:57.248789 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:57.248581 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:34:59.247547 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:59.247500 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:34:59.248037 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:59.247558 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:34:59.248037 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:34:59.247500 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:34:59.248037 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:59.247669 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:34:59.248037 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:59.247767 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:34:59.248037 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:34:59.247900 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:35:01.247201 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:01.247163 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:01.247675 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:01.247227 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:01.247675 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:01.247169 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:01.247675 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:01.247307 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:35:01.247675 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:01.247379 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:35:01.247675 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:01.247490 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:35:03.247363 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:03.247329 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:03.247832 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:03.247333 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:03.247832 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:03.247453 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:35:03.247832 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:03.247342 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:03.247832 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:03.247506 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:35:03.247832 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:03.247598 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:35:04.825485 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:04.825389 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:04.825485 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:04.825451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:04.826040 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:04.825583 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:35:04.826040 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:04.825587 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:35:04.826040 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:04.825654 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret podName:560f38bc-2223-47dc-bbed-7d8750d7894a nodeName:}" failed. No retries permitted until 2026-07-08 16:35:20.825634338 +0000 UTC m=+34.163558805 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret") pod "global-pull-secret-syncer-xrljb" (UID: "560f38bc-2223-47dc-bbed-7d8750d7894a") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:35:04.826040 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:04.825673 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs podName:31bdf910-65ce-489b-ba71-64d9080e8443 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:20.825666245 +0000 UTC m=+34.163590711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs") pod "network-metrics-daemon-t6fms" (UID: "31bdf910-65ce-489b-ba71-64d9080e8443") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:35:04.926264 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:04.926225 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6v6\" (UniqueName: \"kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6\") pod \"network-check-target-ntrb9\" (UID: \"5938b63a-f2f4-4903-b7ad-bacf3f4c10b5\") " pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:04.926460 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:04.926383 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:35:04.926460 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:04.926406 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:35:04.926460 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:04.926419 2567 projected.go:196] Error preparing data for projected volume kube-api-access-sh6v6 for pod openshift-network-diagnostics/network-check-target-ntrb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:35:04.926650 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:04.926482 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6 podName:5938b63a-f2f4-4903-b7ad-bacf3f4c10b5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:20.926466539 +0000 UTC m=+34.264391005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sh6v6" (UniqueName: "kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6") pod "network-check-target-ntrb9" (UID: "5938b63a-f2f4-4903-b7ad-bacf3f4c10b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:35:05.247823 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:05.247736 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:05.247989 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:05.247738 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:05.247989 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:05.247865 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:35:05.247989 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:05.247872 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:05.247989 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:05.247974 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:35:05.248199 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:05.248063 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:35:07.248466 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:07.248426 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:07.248466 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:07.248466 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:07.248927 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:07.248556 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:35:07.248927 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:07.248604 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:07.248927 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:07.248673 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:35:07.248927 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:07.248673 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:35:09.247669 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.247338 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:09.248570 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.247339 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:09.248570 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:09.247774 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:35:09.248570 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:09.247878 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:35:09.248570 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.247339 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:09.248570 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:09.247978 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:35:09.426444 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.426409 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" event={"ID":"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a","Type":"ContainerStarted","Data":"ac19da6eed3787a426cf2601fe92cfcd17fad0fc0172a4f7537a3b50a7b57419"} Jul 08 16:35:09.427818 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.427793 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-58tpf" event={"ID":"84099618-1b2d-4ae6-adbb-28141b6cde6d","Type":"ContainerStarted","Data":"3c238d33aa03390cdae79bcef6e5e43c5915b1e1410a1fa1b0b2930f0ef99c2b"} Jul 08 16:35:09.430542 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.430502 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" event={"ID":"b8f20d10-33c9-46ef-b331-51e7ce568566","Type":"ContainerStarted","Data":"52aa821921e75151656359d54976ccfaca1cce16b2d24b5f64f24ea82f3aeff0"} Jul 08 16:35:09.430637 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.430611 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" event={"ID":"b8f20d10-33c9-46ef-b331-51e7ce568566","Type":"ContainerStarted","Data":"d87b4fe9b269d4d409b55508e5132489a8d9def8fb8ecd2371cbf9474903b9e4"} Jul 08 16:35:09.430688 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.430660 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" event={"ID":"b8f20d10-33c9-46ef-b331-51e7ce568566","Type":"ContainerStarted","Data":"8516bc7771692c3ee7d1f706a67e72e03ca85f1852b71319bf7da0e739c2ad0f"} Jul 08 16:35:09.430723 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.430695 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" event={"ID":"b8f20d10-33c9-46ef-b331-51e7ce568566","Type":"ContainerStarted","Data":"8e9b3cd7132d37298ed2282e658c351acce1ecc24ffbc2430b3d093d0da1dc82"} Jul 08 16:35:09.430761 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.430723 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" event={"ID":"b8f20d10-33c9-46ef-b331-51e7ce568566","Type":"ContainerStarted","Data":"4c69051ff6d92f25d8a2eb99fdc426f1a25029df11c0af3a10ed38da2083cd89"} Jul 08 16:35:09.431952 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.431931 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jtjn9" event={"ID":"d8136738-b751-40ab-be2b-3d1a63f618a4","Type":"ContainerStarted","Data":"6ee3e562e5b9c7a925ca5b5a69cb5f2db795d1a6bd54119b8be825a9fbdb6308"} Jul 08 16:35:09.433276 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.433256 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" event={"ID":"91bdeead-c876-46c5-9ca6-d6bdfa439db7","Type":"ContainerStarted","Data":"23a78c426c618c19a6c74db62c84ade29ebd86214b56bb14f977009212d09612"} Jul 08 16:35:09.434615 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.434593 2567 generic.go:356] "Generic (PLEG): container finished" podID="03cd9c94-0548-4f48-b538-e406e0c32b7f" containerID="3447ac96a5225c914d0540b5ef2cb6b2cd3c81d00bcef20f074f789d8c6addaf" exitCode=0 Jul 08 16:35:09.434699 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.434662 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqqv" event={"ID":"03cd9c94-0548-4f48-b538-e406e0c32b7f","Type":"ContainerDied","Data":"3447ac96a5225c914d0540b5ef2cb6b2cd3c81d00bcef20f074f789d8c6addaf"} Jul 08 16:35:09.435991 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.435952 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gbwgs" event={"ID":"c8f78dae-70ef-428f-898f-49da806d8912","Type":"ContainerStarted","Data":"e23ef6116c44b5c7917fb173881550968f469db30b40ebdb2ff14f841ffa1681"} Jul 08 16:35:09.437288 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.437262 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7b6vx" event={"ID":"b3c1f306-e11e-46e6-8ac6-e96e6652587d","Type":"ContainerStarted","Data":"a81c06d5ec43cf15f0c1ce2c94c85edf8b3b9b299f607fc72b319b89af486fb6"} Jul 08 16:35:09.458741 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.458697 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" podStartSLOduration=21.458681113 podStartE2EDuration="21.458681113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:52.403304362 +0000 UTC m=+5.741228849" watchObservedRunningTime="2026-07-08 16:35:09.458681113 +0000 UTC m=+22.796605600" Jul 08 16:35:09.471355 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.471313 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-58tpf" podStartSLOduration=4.092796195 podStartE2EDuration="22.471298154s" totalImagesPullingTime="18.378501959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:09.471157995 +0000 UTC m=+22.809082483" watchObservedRunningTime="2026-07-08 16:35:09.471298154 +0000 UTC m=+22.809222640" Jul 08 16:35:09.485628 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.485579 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jtjn9" podStartSLOduration=4.117073756 podStartE2EDuration="22.485562666s" totalImagesPullingTime="18.36848891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:09.485082645 +0000 UTC m=+22.823007137" watchObservedRunningTime="2026-07-08 16:35:09.485562666 +0000 UTC m=+22.823487153" Jul 08 16:35:09.518141 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.518090 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7b6vx" podStartSLOduration=4.14121565 podStartE2EDuration="22.518071561s" totalImagesPullingTime="18.376855911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:09.500173329 +0000 UTC m=+22.838097815" watchObservedRunningTime="2026-07-08 16:35:09.518071561 +0000 UTC m=+22.855996048" Jul 08 16:35:09.518670 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.518623 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ct2c8" podStartSLOduration=4.141609266 podStartE2EDuration="22.518609086s" totalImagesPullingTime="18.37699982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:09.518215341 +0000 UTC m=+22.856139810" watchObservedRunningTime="2026-07-08 16:35:09.518609086 +0000 UTC m=+22.856533573" Jul 08 16:35:09.535913 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:09.535867 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gbwgs" podStartSLOduration=4.110179278 podStartE2EDuration="22.535850154s" totalImagesPullingTime="18.425670876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:09.535678979 +0000 UTC m=+22.873603468" watchObservedRunningTime="2026-07-08 16:35:09.535850154 +0000 UTC m=+22.873774642" Jul 08 16:35:10.443660 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:10.443564 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" event={"ID":"b8f20d10-33c9-46ef-b331-51e7ce568566","Type":"ContainerStarted","Data":"b612b69747262874d3e8cb77be3bc0753b203370e27d259b0ffe14b21e0d4571"} Jul 08 16:35:10.445381 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:10.445287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fsmqh" event={"ID":"1fd27338-5a40-47d4-83e0-a1b0097d74db","Type":"ContainerStarted","Data":"bb79a97e3d258baeabeb6f544b66c2535eb4ffa2abf423589e7c6926246bd2d1"} Jul 08 16:35:10.461979 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:10.461917 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fsmqh" podStartSLOduration=5.099752469 podStartE2EDuration="23.461898155s" totalImagesPullingTime="18.362145686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:10.461827476 +0000 UTC m=+23.799751967" watchObservedRunningTime="2026-07-08 16:35:10.461898155 +0000 UTC m=+23.799822620" Jul 08 16:35:10.817104 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:10.817061 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 16:35:11.153947 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:11.153767 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T16:35:10.817082984Z","UUID":"5d6300d0-e121-43c4-9389-463cd300fe07","Handler":null,"Name":"","Endpoint":""} Jul 08 16:35:11.155846 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:11.155819 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 16:35:11.155988 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:11.155865 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 16:35:11.248120 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:11.248088 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:11.248308 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:11.248093 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:11.248308 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:11.248227 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:35:11.248308 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:11.248238 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:11.248469 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:11.248336 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:35:11.248469 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:11.248421 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:35:11.450408 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:11.450329 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" event={"ID":"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a","Type":"ContainerStarted","Data":"4d0a0f7a1aad0788ba5a171dcfd8289572d38dc491ac2b3b16ccdf5e5beb4b33"} Jul 08 16:35:12.455547 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:12.455295 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" event={"ID":"b8f20d10-33c9-46ef-b331-51e7ce568566","Type":"ContainerStarted","Data":"93da9c0833715d8a3ea7d33dbe70901356c7de80e59d398f1a1bfdb9ef5efe5f"} Jul 08 16:35:13.248062 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:13.248026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:13.248292 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:13.248024 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:13.248292 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:13.248154 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:35:13.248292 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:13.248212 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:35:13.248292 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:13.248024 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:13.248477 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:13.248307 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:35:13.611829 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:13.611797 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jtjn9" Jul 08 16:35:13.612373 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:13.612357 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jtjn9" Jul 08 16:35:14.462559 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:14.462260 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" event={"ID":"a533c0d2-a8ef-428f-bdf1-67a3c0926c0a","Type":"ContainerStarted","Data":"7c68640276cb1980577643a45f6ac4e6b7efcfe90d3e9a9ac8c60b0e7abbfc7e"} Jul 08 16:35:14.465929 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:14.465880 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" event={"ID":"b8f20d10-33c9-46ef-b331-51e7ce568566","Type":"ContainerStarted","Data":"e601132d3be77cf1707b652ea2de1945001ffe89ffe46bf9362647df2f029a00"} Jul 08 16:35:14.466189 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:14.466164 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:35:14.467716 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:14.467691 2567 generic.go:356] "Generic (PLEG): container finished" podID="03cd9c94-0548-4f48-b538-e406e0c32b7f" containerID="6a9abc5fdfe807a4eb403b26ad1d78d954c8bc5472515b87557d94f3375903ca" exitCode=0 Jul 08 16:35:14.467807 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:14.467777 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqqv" event={"ID":"03cd9c94-0548-4f48-b538-e406e0c32b7f","Type":"ContainerDied","Data":"6a9abc5fdfe807a4eb403b26ad1d78d954c8bc5472515b87557d94f3375903ca"} Jul 08 16:35:14.468133 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:14.468114 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jtjn9" Jul 08 16:35:14.468645 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:14.468627 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jtjn9" Jul 08 16:35:14.480112 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:14.480070 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fnnd" podStartSLOduration=4.838039706 podStartE2EDuration="27.480055411s" totalImagesPullingTime="22.642015705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:14.479685138 +0000 UTC m=+27.817609636" watchObservedRunningTime="2026-07-08 16:35:14.480055411 +0000 UTC m=+27.817979898" Jul 08 16:35:14.484122 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:14.484101 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:35:14.506663 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:14.506610 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" podStartSLOduration=9.067723998 podStartE2EDuration="27.50659576s" totalImagesPullingTime="18.438871762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:14.505095786 +0000 UTC m=+27.843020284" watchObservedRunningTime="2026-07-08 16:35:14.50659576 +0000 UTC m=+27.844520246" Jul 08 16:35:15.248180 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:15.247971 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:15.249126 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:15.248257 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:35:15.249126 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:15.248782 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:15.249822 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:15.249554 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:35:15.249822 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:15.249610 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:15.249822 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:15.249736 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:35:15.470877 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:15.470850 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:35:15.475954 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:15.475924 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:35:15.486642 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:15.486615 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:35:15.850437 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:15.850180 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ntrb9"] Jul 08 16:35:15.850620 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:15.850559 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:15.850732 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:15.850711 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:35:15.851029 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:15.850999 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t6fms"] Jul 08 16:35:15.851135 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:15.851105 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:15.851235 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:15.851217 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:35:15.851597 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:15.851578 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xrljb"] Jul 08 16:35:15.851671 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:15.851665 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:15.851772 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:15.851744 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:35:16.474776 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:16.474741 2567 generic.go:356] "Generic (PLEG): container finished" podID="03cd9c94-0548-4f48-b538-e406e0c32b7f" containerID="0660cf72fc29c0c3353f9555dc1a5994b279139234b18406cda8075ac6d93ceb" exitCode=0 Jul 08 16:35:16.475299 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:16.474824 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqqv" event={"ID":"03cd9c94-0548-4f48-b538-e406e0c32b7f","Type":"ContainerDied","Data":"0660cf72fc29c0c3353f9555dc1a5994b279139234b18406cda8075ac6d93ceb"} Jul 08 16:35:17.247972 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:17.247937 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:17.247972 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:17.247971 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:17.248207 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:17.248041 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:35:17.248207 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:17.248137 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:35:17.479591 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:17.479553 2567 generic.go:356] "Generic (PLEG): container finished" podID="03cd9c94-0548-4f48-b538-e406e0c32b7f" containerID="d21c2ca3fe4a7e9fb1b4492b2f99fe352a71ff9495eec20dad016884657703bf" exitCode=0 Jul 08 16:35:17.480119 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:17.479633 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqqv" event={"ID":"03cd9c94-0548-4f48-b538-e406e0c32b7f","Type":"ContainerDied","Data":"d21c2ca3fe4a7e9fb1b4492b2f99fe352a71ff9495eec20dad016884657703bf"} Jul 08 16:35:18.247294 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:18.247266 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:18.247491 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:18.247390 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:35:19.247730 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:19.247702 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:19.248351 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:19.247704 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:19.248351 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:19.247845 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:35:19.248351 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:19.247912 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:35:20.247296 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:20.247254 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:20.247500 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:20.247386 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xrljb" podUID="560f38bc-2223-47dc-bbed-7d8750d7894a" Jul 08 16:35:20.846558 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:20.846500 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:20.847159 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:20.846616 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:20.847159 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:20.846663 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:35:20.847159 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:20.846702 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:35:20.847159 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:20.846731 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret podName:560f38bc-2223-47dc-bbed-7d8750d7894a nodeName:}" failed. No retries permitted until 2026-07-08 16:35:52.846711488 +0000 UTC m=+66.184635965 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret") pod "global-pull-secret-syncer-xrljb" (UID: "560f38bc-2223-47dc-bbed-7d8750d7894a") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:35:20.847159 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:20.846748 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs podName:31bdf910-65ce-489b-ba71-64d9080e8443 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:52.8467406 +0000 UTC m=+66.184665065 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs") pod "network-metrics-daemon-t6fms" (UID: "31bdf910-65ce-489b-ba71-64d9080e8443") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:35:20.947849 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:20.947803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6v6\" (UniqueName: \"kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6\") pod \"network-check-target-ntrb9\" (UID: \"5938b63a-f2f4-4903-b7ad-bacf3f4c10b5\") " pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:20.948032 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:20.947963 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:35:20.948032 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:20.947986 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:35:20.948032 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:20.947999 2567 projected.go:196] Error preparing data for projected volume kube-api-access-sh6v6 for pod openshift-network-diagnostics/network-check-target-ntrb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:35:20.948204 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:20.948064 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6 podName:5938b63a-f2f4-4903-b7ad-bacf3f4c10b5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:52.948046101 +0000 UTC m=+66.285970571 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sh6v6" (UniqueName: "kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6") pod "network-check-target-ntrb9" (UID: "5938b63a-f2f4-4903-b7ad-bacf3f4c10b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:35:21.248192 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.248152 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:21.248192 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.248182 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:21.248416 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:21.248303 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:35:21.248468 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:21.248416 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrb9" podUID="5938b63a-f2f4-4903-b7ad-bacf3f4c10b5" Jul 08 16:35:21.894449 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.894219 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeReady" Jul 08 16:35:21.894818 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.894491 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 16:35:21.953139 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.953107 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2l522"] Jul 08 16:35:21.955030 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.955009 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-82djv"] Jul 08 16:35:21.955149 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.955125 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2l522" Jul 08 16:35:21.956554 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.956538 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-82djv" Jul 08 16:35:21.959227 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.959207 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rvfsx\"" Jul 08 16:35:21.959308 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.959254 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 16:35:21.959308 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.959282 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 16:35:21.959640 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.959627 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 16:35:21.959782 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.959762 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 16:35:21.959895 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.959884 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tks2z\"" Jul 08 16:35:21.960476 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.960462 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 16:35:21.969167 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.969146 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-82djv"] Jul 08 16:35:21.969662 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:21.969646 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2l522"] Jul 08 16:35:22.055279 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.055241 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:22.055471 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.055298 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cea34dd4-9352-469b-a435-2e373be078d4-cert\") pod \"ingress-canary-82djv\" (UID: \"cea34dd4-9352-469b-a435-2e373be078d4\") " pod="openshift-ingress-canary/ingress-canary-82djv" Jul 08 16:35:22.055471 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.055355 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s4bd\" (UniqueName: \"kubernetes.io/projected/cea34dd4-9352-469b-a435-2e373be078d4-kube-api-access-5s4bd\") pod \"ingress-canary-82djv\" (UID: \"cea34dd4-9352-469b-a435-2e373be078d4\") " pod="openshift-ingress-canary/ingress-canary-82djv" Jul 08 16:35:22.055471 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.055398 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-tmp-dir\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:22.055471 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.055426 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-config-volume\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:22.055471 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.055448 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjbh7\" (UniqueName: \"kubernetes.io/projected/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-kube-api-access-rjbh7\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:22.156280 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.156197 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-config-volume\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:22.156280 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.156243 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjbh7\" (UniqueName: \"kubernetes.io/projected/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-kube-api-access-rjbh7\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:22.156280 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.156276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:22.156456 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:22.156373 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:22.156456 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.156399 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cea34dd4-9352-469b-a435-2e373be078d4-cert\") pod \"ingress-canary-82djv\" (UID: \"cea34dd4-9352-469b-a435-2e373be078d4\") " pod="openshift-ingress-canary/ingress-canary-82djv" Jul 08 16:35:22.156456 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:22.156430 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls podName:9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:22.656412936 +0000 UTC m=+35.994337418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls") pod "dns-default-2l522" (UID: "9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71") : secret "dns-default-metrics-tls" not found Jul 08 16:35:22.156598 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.156459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s4bd\" (UniqueName: \"kubernetes.io/projected/cea34dd4-9352-469b-a435-2e373be078d4-kube-api-access-5s4bd\") pod \"ingress-canary-82djv\" (UID: \"cea34dd4-9352-469b-a435-2e373be078d4\") " pod="openshift-ingress-canary/ingress-canary-82djv" Jul 08 16:35:22.156598 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.156482 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-tmp-dir\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:22.156791 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.156773 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-tmp-dir\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:22.156865 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.156848 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-config-volume\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:22.161009 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.160972 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cea34dd4-9352-469b-a435-2e373be078d4-cert\") pod \"ingress-canary-82djv\" (UID: \"cea34dd4-9352-469b-a435-2e373be078d4\") " pod="openshift-ingress-canary/ingress-canary-82djv" Jul 08 16:35:22.164461 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.164438 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjbh7\" (UniqueName: \"kubernetes.io/projected/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-kube-api-access-rjbh7\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:22.164590 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.164518 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s4bd\" (UniqueName: \"kubernetes.io/projected/cea34dd4-9352-469b-a435-2e373be078d4-kube-api-access-5s4bd\") pod \"ingress-canary-82djv\" (UID: \"cea34dd4-9352-469b-a435-2e373be078d4\") " pod="openshift-ingress-canary/ingress-canary-82djv" Jul 08 16:35:22.247702 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.247651 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:22.250274 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.250255 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 16:35:22.270105 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.270071 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-82djv" Jul 08 16:35:22.406755 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.406669 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-82djv"] Jul 08 16:35:22.410985 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:35:22.410955 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea34dd4_9352_469b_a435_2e373be078d4.slice/crio-306cb748e9c9e022f76cf7a315b3ade1693f112039430e9b95605210e1a311a1 WatchSource:0}: Error finding container 306cb748e9c9e022f76cf7a315b3ade1693f112039430e9b95605210e1a311a1: Status 404 returned error can't find the container with id 306cb748e9c9e022f76cf7a315b3ade1693f112039430e9b95605210e1a311a1 Jul 08 16:35:22.494366 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.494330 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-82djv" event={"ID":"cea34dd4-9352-469b-a435-2e373be078d4","Type":"ContainerStarted","Data":"306cb748e9c9e022f76cf7a315b3ade1693f112039430e9b95605210e1a311a1"} Jul 08 16:35:22.497281 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.497254 2567 generic.go:356] "Generic (PLEG): container finished" podID="03cd9c94-0548-4f48-b538-e406e0c32b7f" containerID="d3de6b35cb14da632fb3caec1b1d8695f569a6815476ecaab053302b8e4d2537" exitCode=0 Jul 08 16:35:22.497434 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.497295 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqqv" event={"ID":"03cd9c94-0548-4f48-b538-e406e0c32b7f","Type":"ContainerDied","Data":"d3de6b35cb14da632fb3caec1b1d8695f569a6815476ecaab053302b8e4d2537"} Jul 08 16:35:22.660009 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:22.659912 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:22.660158 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:22.660073 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:22.660158 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:22.660140 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls podName:9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:23.660124372 +0000 UTC m=+36.998048853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls") pod "dns-default-2l522" (UID: "9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71") : secret "dns-default-metrics-tls" not found Jul 08 16:35:23.247546 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:23.247495 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:23.248027 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:23.247495 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:23.251558 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:23.251501 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 16:35:23.251713 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:23.251577 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6fxjj\"" Jul 08 16:35:23.251713 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:23.251507 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 16:35:23.251713 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:23.251587 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mshfs\"" Jul 08 16:35:23.251713 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:23.251499 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 16:35:23.504266 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:23.504010 2567 generic.go:356] "Generic (PLEG): container finished" podID="03cd9c94-0548-4f48-b538-e406e0c32b7f" containerID="9f8f9730a5766cce54320c1f28f487116d5b5392b0e1b16b4ee94176d0126a6d" exitCode=0 Jul 08 16:35:23.504266 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:23.504097 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqqv" event={"ID":"03cd9c94-0548-4f48-b538-e406e0c32b7f","Type":"ContainerDied","Data":"9f8f9730a5766cce54320c1f28f487116d5b5392b0e1b16b4ee94176d0126a6d"} Jul 08 16:35:23.667480 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:23.667444 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:23.667694 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:23.667594 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:23.667694 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:23.667673 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls podName:9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:25.667652738 +0000 UTC m=+39.005577216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls") pod "dns-default-2l522" (UID: "9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71") : secret "dns-default-metrics-tls" not found Jul 08 16:35:24.509391 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:24.509358 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cxqqv" event={"ID":"03cd9c94-0548-4f48-b538-e406e0c32b7f","Type":"ContainerStarted","Data":"3b0125ab1abf054e56c6cd1c24fadbbd83dbf70d881489029ade25760469475c"} Jul 08 16:35:24.534176 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:24.534120 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cxqqv" podStartSLOduration=9.033026261 podStartE2EDuration="37.534103536s" totalImagesPullingTime="28.501077275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:24.53223072 +0000 UTC m=+37.870155207" watchObservedRunningTime="2026-07-08 16:35:24.534103536 +0000 UTC m=+37.872028024" Jul 08 16:35:25.513411 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:25.513380 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-82djv" event={"ID":"cea34dd4-9352-469b-a435-2e373be078d4","Type":"ContainerStarted","Data":"15ece2d197b857d5b0a392cce876fa655aa0260b54255cca3a8a099b0b54df0b"} Jul 08 16:35:25.531107 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:25.531054 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-82djv" podStartSLOduration=2.364808111 podStartE2EDuration="4.531036721s" totalImagesPullingTime="2.16622861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:25.530041722 +0000 UTC m=+38.867966209" watchObservedRunningTime="2026-07-08 16:35:25.531036721 +0000 UTC m=+38.868961208" Jul 08 16:35:25.683814 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:25.683715 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:25.683985 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:25.683821 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:25.683985 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:25.683902 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls podName:9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:29.683881701 +0000 UTC m=+43.021806170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls") pod "dns-default-2l522" (UID: "9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71") : secret "dns-default-metrics-tls" not found Jul 08 16:35:29.713809 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:29.713766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:29.714329 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:29.713877 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:29.714329 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:29.713941 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls podName:9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:37.713928525 +0000 UTC m=+51.051852990 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls") pod "dns-default-2l522" (UID: "9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71") : secret "dns-default-metrics-tls" not found Jul 08 16:35:37.772915 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:37.772876 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:37.773387 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:37.773004 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:37.773387 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:37.773068 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls podName:9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:53.773053463 +0000 UTC m=+67.110977929 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls") pod "dns-default-2l522" (UID: "9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71") : secret "dns-default-metrics-tls" not found Jul 08 16:35:47.500770 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:47.500744 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6nhn" Jul 08 16:35:52.868081 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:52.868039 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:52.868584 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:52.868101 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:35:52.870670 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:52.870650 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 16:35:52.870747 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:52.870691 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 16:35:52.878858 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:52.878834 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 16:35:52.878965 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:52.878894 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs podName:31bdf910-65ce-489b-ba71-64d9080e8443 nodeName:}" failed. No retries permitted until 2026-07-08 16:36:56.878879609 +0000 UTC m=+130.216804077 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs") pod "network-metrics-daemon-t6fms" (UID: "31bdf910-65ce-489b-ba71-64d9080e8443") : secret "metrics-daemon-secret" not found Jul 08 16:35:52.882144 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:52.882122 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/560f38bc-2223-47dc-bbed-7d8750d7894a-original-pull-secret\") pod \"global-pull-secret-syncer-xrljb\" (UID: \"560f38bc-2223-47dc-bbed-7d8750d7894a\") " pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:52.968762 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:52.968709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6v6\" (UniqueName: \"kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6\") pod \"network-check-target-ntrb9\" (UID: \"5938b63a-f2f4-4903-b7ad-bacf3f4c10b5\") " pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:52.971363 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:52.971343 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 16:35:52.981947 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:52.981926 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 16:35:52.992150 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:52.992127 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh6v6\" (UniqueName: \"kubernetes.io/projected/5938b63a-f2f4-4903-b7ad-bacf3f4c10b5-kube-api-access-sh6v6\") pod \"network-check-target-ntrb9\" (UID: \"5938b63a-f2f4-4903-b7ad-bacf3f4c10b5\") " pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:53.157039 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:53.156953 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xrljb" Jul 08 16:35:53.262361 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:53.262333 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6fxjj\"" Jul 08 16:35:53.270628 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:53.270594 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:53.304128 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:53.304096 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xrljb"] Jul 08 16:35:53.307618 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:35:53.307581 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod560f38bc_2223_47dc_bbed_7d8750d7894a.slice/crio-2469c83494469adfa5fa8c10fcb8ad1aab16ec350332e4e2eb8e06f67931690c WatchSource:0}: Error finding container 2469c83494469adfa5fa8c10fcb8ad1aab16ec350332e4e2eb8e06f67931690c: Status 404 returned error can't find the container with id 2469c83494469adfa5fa8c10fcb8ad1aab16ec350332e4e2eb8e06f67931690c Jul 08 16:35:53.397576 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:53.397548 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ntrb9"] Jul 08 16:35:53.400610 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:35:53.400584 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5938b63a_f2f4_4903_b7ad_bacf3f4c10b5.slice/crio-4f2e81f9d497c5529b2746de081477c6e75ebeed1f299e01a501ae438922c489 WatchSource:0}: Error finding container 4f2e81f9d497c5529b2746de081477c6e75ebeed1f299e01a501ae438922c489: Status 404 returned error can't find the container with id 4f2e81f9d497c5529b2746de081477c6e75ebeed1f299e01a501ae438922c489 Jul 08 16:35:53.577994 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:53.577960 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ntrb9" event={"ID":"5938b63a-f2f4-4903-b7ad-bacf3f4c10b5","Type":"ContainerStarted","Data":"4f2e81f9d497c5529b2746de081477c6e75ebeed1f299e01a501ae438922c489"} Jul 08 16:35:53.579013 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:53.578988 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xrljb" event={"ID":"560f38bc-2223-47dc-bbed-7d8750d7894a","Type":"ContainerStarted","Data":"2469c83494469adfa5fa8c10fcb8ad1aab16ec350332e4e2eb8e06f67931690c"} Jul 08 16:35:53.773590 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:53.773560 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:35:53.773742 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:53.773669 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:53.773742 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:35:53.773722 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls podName:9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71 nodeName:}" failed. No retries permitted until 2026-07-08 16:36:25.773708205 +0000 UTC m=+99.111632670 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls") pod "dns-default-2l522" (UID: "9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71") : secret "dns-default-metrics-tls" not found Jul 08 16:35:58.593864 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:58.593823 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ntrb9" event={"ID":"5938b63a-f2f4-4903-b7ad-bacf3f4c10b5","Type":"ContainerStarted","Data":"5edffaeff223389363d1985d22ba5b174d0dfffbc56948be0a525a63c212fd09"} Jul 08 16:35:58.594387 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:58.593935 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:35:58.595252 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:58.595226 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xrljb" event={"ID":"560f38bc-2223-47dc-bbed-7d8750d7894a","Type":"ContainerStarted","Data":"fc9b03e1d3fcad8d7dbeaeef91a2dcc1bbd7d7c5ffad45b80d87bd478a1cbdb3"} Jul 08 16:35:58.609993 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:58.609946 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ntrb9" podStartSLOduration=66.98991307 podStartE2EDuration="1m11.609932125s" totalImagesPullingTime="4.620019055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:58.609044475 +0000 UTC m=+71.946968963" watchObservedRunningTime="2026-07-08 16:35:58.609932125 +0000 UTC m=+71.947856590" Jul 08 16:35:58.623377 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:35:58.623226 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xrljb" podStartSLOduration=66.90779908 podStartE2EDuration="1m11.623207554s" totalImagesPullingTime="4.715408474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:58.622662002 +0000 UTC m=+71.960586488" watchObservedRunningTime="2026-07-08 16:35:58.623207554 +0000 UTC m=+71.961132043" Jul 08 16:36:25.803831 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:36:25.803793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:36:25.804237 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:36:25.803922 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:36:25.804237 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:36:25.803986 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls podName:9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71 nodeName:}" failed. No retries permitted until 2026-07-08 16:37:29.803972622 +0000 UTC m=+163.141897087 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls") pod "dns-default-2l522" (UID: "9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71") : secret "dns-default-metrics-tls" not found Jul 08 16:36:29.600234 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:36:29.600201 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ntrb9" Jul 08 16:36:56.920014 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:36:56.919952 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:36:56.920554 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:36:56.920121 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 16:36:56.920554 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:36:56.920205 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs podName:31bdf910-65ce-489b-ba71-64d9080e8443 nodeName:}" failed. No retries permitted until 2026-07-08 16:38:58.920188808 +0000 UTC m=+252.258113273 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs") pod "network-metrics-daemon-t6fms" (UID: "31bdf910-65ce-489b-ba71-64d9080e8443") : secret "metrics-daemon-secret" not found Jul 08 16:37:24.965282 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:37:24.965233 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2l522" podUID="9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71" Jul 08 16:37:25.802169 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:37:25.802141 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2l522" Jul 08 16:37:26.266603 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:37:26.266558 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:37:29.841248 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:37:29.841209 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:37:29.841673 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:37:29.841361 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:37:29.841673 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:37:29.841463 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls podName:9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:31.841445546 +0000 UTC m=+285.179370012 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls") pod "dns-default-2l522" (UID: "9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71") : secret "dns-default-metrics-tls" not found Jul 08 16:37:37.248750 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:37:37.248711 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:38:53.532633 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.532598 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5"] Jul 08 16:38:53.534643 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.534620 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:38:53.536599 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.536571 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6879d7ccd5-7jg6n"] Jul 08 16:38:53.537076 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.537055 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 16:38:53.537190 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.537076 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 16:38:53.538673 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.538654 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 16:38:53.538766 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.538758 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.538888 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.538866 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2dljx\"" Jul 08 16:38:53.538960 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.538900 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 16:38:53.541439 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.541422 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 08 16:38:53.541779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.541751 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 08 16:38:53.541895 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.541800 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 16:38:53.541895 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.541807 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 08 16:38:53.542129 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.542113 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b7zfj\"" Jul 08 16:38:53.542444 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.542430 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 08 16:38:53.543793 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.543653 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 16:38:53.547216 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.547194 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5"] Jul 08 16:38:53.563886 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.563853 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6879d7ccd5-7jg6n"] Jul 08 16:38:53.593114 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.593080 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-default-certificate\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.593310 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.593149 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.593310 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.593180 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:38:53.593310 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.593198 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0842d1ff-72b9-424d-af59-3d25ee3df89d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:38:53.593310 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.593215 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmg74\" (UniqueName: \"kubernetes.io/projected/0842d1ff-72b9-424d-af59-3d25ee3df89d-kube-api-access-wmg74\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:38:53.593445 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.593313 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-stats-auth\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.593445 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.593347 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv25v\" (UniqueName: \"kubernetes.io/projected/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-kube-api-access-gv25v\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.593445 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.593372 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.626783 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.626745 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn"] Jul 08 16:38:53.628562 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.628520 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" Jul 08 16:38:53.631200 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.631169 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g"] Jul 08 16:38:53.631607 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.631581 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 08 16:38:53.631769 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.631751 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wc8z4\"" Jul 08 16:38:53.631860 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.631851 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 08 16:38:53.631934 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.631869 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:38:53.631934 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.631883 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 08 16:38:53.633155 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.633136 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:38:53.636150 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:53.636110 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-106.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-131-106.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 08 16:38:53.636150 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:53.636110 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"samples-operator-tls\" is forbidden: User \"system:node:ip-10-0-131-106.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-131-106.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" type="*v1.Secret" Jul 08 16:38:53.636326 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:53.636182 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-106.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-131-106.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 08 16:38:53.636696 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:53.636662 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-samples-operator-dockercfg-rc776\" is forbidden: User \"system:node:ip-10-0-131-106.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-131-106.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rc776\"" type="*v1.Secret" Jul 08 16:38:53.643874 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.643847 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn"] Jul 08 16:38:53.645333 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.645309 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2"] Jul 08 16:38:53.647235 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.647208 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g"] Jul 08 16:38:53.647391 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.647328 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" Jul 08 16:38:53.649928 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.649902 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 16:38:53.649928 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.649911 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 16:38:53.649928 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.649922 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 16:38:53.650227 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.650024 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-q6d2z\"" Jul 08 16:38:53.650227 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.650131 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:38:53.658734 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.658704 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2"] Jul 08 16:38:53.693992 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.693949 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.693992 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.693994 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:38:53.694267 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.694030 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rtzb\" (UniqueName: \"kubernetes.io/projected/4e55c310-80cc-43db-8a8e-bbc970dd7fbf-kube-api-access-7rtzb\") pod \"kube-storage-version-migrator-operator-846bf668f7-8pxcn\" (UID: \"4e55c310-80cc-43db-8a8e-bbc970dd7fbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" Jul 08 16:38:53.694267 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:53.694130 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:38:53.694267 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:53.694149 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 16:38:53.694267 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:53.694197 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls podName:0842d1ff-72b9-424d-af59-3d25ee3df89d nodeName:}" failed. No retries permitted until 2026-07-08 16:38:54.194180352 +0000 UTC m=+247.532104820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4zkj5" (UID: "0842d1ff-72b9-424d-af59-3d25ee3df89d") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:38:53.694267 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.694152 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0842d1ff-72b9-424d-af59-3d25ee3df89d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:38:53.694267 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:53.694215 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs podName:cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96 nodeName:}" failed. No retries permitted until 2026-07-08 16:38:54.194206432 +0000 UTC m=+247.532130897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs") pod "router-default-6879d7ccd5-7jg6n" (UID: "cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96") : secret "router-metrics-certs-default" not found Jul 08 16:38:53.694267 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.694246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmg74\" (UniqueName: \"kubernetes.io/projected/0842d1ff-72b9-424d-af59-3d25ee3df89d-kube-api-access-wmg74\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:38:53.694588 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.694286 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-stats-auth\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.694588 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.694309 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv25v\" (UniqueName: \"kubernetes.io/projected/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-kube-api-access-gv25v\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.694588 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.694566 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.694709 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.694600 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e55c310-80cc-43db-8a8e-bbc970dd7fbf-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8pxcn\" (UID: \"4e55c310-80cc-43db-8a8e-bbc970dd7fbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" Jul 08 16:38:53.694709 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:53.694696 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle podName:cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96 nodeName:}" failed. No retries permitted until 2026-07-08 16:38:54.19468127 +0000 UTC m=+247.532605735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle") pod "router-default-6879d7ccd5-7jg6n" (UID: "cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96") : configmap references non-existent config key: service-ca.crt Jul 08 16:38:53.694803 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.694719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e55c310-80cc-43db-8a8e-bbc970dd7fbf-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8pxcn\" (UID: \"4e55c310-80cc-43db-8a8e-bbc970dd7fbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" Jul 08 16:38:53.694803 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.694751 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdxxh\" (UniqueName: \"kubernetes.io/projected/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-kube-api-access-xdxxh\") pod \"cluster-samples-operator-56fcf86bf-f764g\" (UID: \"d72d7274-2e6a-45e0-ae20-4f99253dc2e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:38:53.694898 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.694815 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-default-certificate\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.694898 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.694881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-f764g\" (UID: \"d72d7274-2e6a-45e0-ae20-4f99253dc2e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:38:53.694993 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.694883 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0842d1ff-72b9-424d-af59-3d25ee3df89d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:38:53.696857 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.696826 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-stats-auth\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.696967 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.696902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-default-certificate\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.705488 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.705456 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv25v\" (UniqueName: \"kubernetes.io/projected/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-kube-api-access-gv25v\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:53.705839 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.705821 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmg74\" (UniqueName: \"kubernetes.io/projected/0842d1ff-72b9-424d-af59-3d25ee3df89d-kube-api-access-wmg74\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:38:53.795714 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.795626 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e55c310-80cc-43db-8a8e-bbc970dd7fbf-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8pxcn\" (UID: \"4e55c310-80cc-43db-8a8e-bbc970dd7fbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" Jul 08 16:38:53.795714 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.795670 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e55c310-80cc-43db-8a8e-bbc970dd7fbf-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8pxcn\" (UID: \"4e55c310-80cc-43db-8a8e-bbc970dd7fbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" Jul 08 16:38:53.795714 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.795691 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d08e0bf-52f8-4bc1-ab80-6238488faf00-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-6fzl2\" (UID: \"2d08e0bf-52f8-4bc1-ab80-6238488faf00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" Jul 08 16:38:53.795714 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.795709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdxxh\" (UniqueName: \"kubernetes.io/projected/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-kube-api-access-xdxxh\") pod \"cluster-samples-operator-56fcf86bf-f764g\" (UID: \"d72d7274-2e6a-45e0-ae20-4f99253dc2e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:38:53.796011 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.795728 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgm8n\" (UniqueName: \"kubernetes.io/projected/2d08e0bf-52f8-4bc1-ab80-6238488faf00-kube-api-access-tgm8n\") pod \"service-ca-operator-5d46d9ffd4-6fzl2\" (UID: \"2d08e0bf-52f8-4bc1-ab80-6238488faf00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" Jul 08 16:38:53.796011 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.795807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-f764g\" (UID: \"d72d7274-2e6a-45e0-ae20-4f99253dc2e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:38:53.796011 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.795864 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rtzb\" (UniqueName: \"kubernetes.io/projected/4e55c310-80cc-43db-8a8e-bbc970dd7fbf-kube-api-access-7rtzb\") pod \"kube-storage-version-migrator-operator-846bf668f7-8pxcn\" (UID: \"4e55c310-80cc-43db-8a8e-bbc970dd7fbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" Jul 08 16:38:53.796011 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.795891 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d08e0bf-52f8-4bc1-ab80-6238488faf00-config\") pod \"service-ca-operator-5d46d9ffd4-6fzl2\" (UID: \"2d08e0bf-52f8-4bc1-ab80-6238488faf00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" Jul 08 16:38:53.796306 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.796283 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e55c310-80cc-43db-8a8e-bbc970dd7fbf-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8pxcn\" (UID: \"4e55c310-80cc-43db-8a8e-bbc970dd7fbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" Jul 08 16:38:53.797989 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.797974 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e55c310-80cc-43db-8a8e-bbc970dd7fbf-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8pxcn\" (UID: \"4e55c310-80cc-43db-8a8e-bbc970dd7fbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" Jul 08 16:38:53.804365 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.804336 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rtzb\" (UniqueName: \"kubernetes.io/projected/4e55c310-80cc-43db-8a8e-bbc970dd7fbf-kube-api-access-7rtzb\") pod \"kube-storage-version-migrator-operator-846bf668f7-8pxcn\" (UID: \"4e55c310-80cc-43db-8a8e-bbc970dd7fbf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" Jul 08 16:38:53.897023 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.896976 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d08e0bf-52f8-4bc1-ab80-6238488faf00-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-6fzl2\" (UID: \"2d08e0bf-52f8-4bc1-ab80-6238488faf00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" Jul 08 16:38:53.897023 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.897030 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgm8n\" (UniqueName: \"kubernetes.io/projected/2d08e0bf-52f8-4bc1-ab80-6238488faf00-kube-api-access-tgm8n\") pod \"service-ca-operator-5d46d9ffd4-6fzl2\" (UID: \"2d08e0bf-52f8-4bc1-ab80-6238488faf00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" Jul 08 16:38:53.897266 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.897211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d08e0bf-52f8-4bc1-ab80-6238488faf00-config\") pod \"service-ca-operator-5d46d9ffd4-6fzl2\" (UID: \"2d08e0bf-52f8-4bc1-ab80-6238488faf00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" Jul 08 16:38:53.897742 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.897723 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d08e0bf-52f8-4bc1-ab80-6238488faf00-config\") pod \"service-ca-operator-5d46d9ffd4-6fzl2\" (UID: \"2d08e0bf-52f8-4bc1-ab80-6238488faf00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" Jul 08 16:38:53.899243 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.899225 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d08e0bf-52f8-4bc1-ab80-6238488faf00-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-6fzl2\" (UID: \"2d08e0bf-52f8-4bc1-ab80-6238488faf00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" Jul 08 16:38:53.905698 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.905666 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgm8n\" (UniqueName: \"kubernetes.io/projected/2d08e0bf-52f8-4bc1-ab80-6238488faf00-kube-api-access-tgm8n\") pod \"service-ca-operator-5d46d9ffd4-6fzl2\" (UID: \"2d08e0bf-52f8-4bc1-ab80-6238488faf00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" Jul 08 16:38:53.939489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.939457 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" Jul 08 16:38:53.956792 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:53.956740 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" Jul 08 16:38:54.071787 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:54.071709 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn"] Jul 08 16:38:54.075013 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:38:54.074988 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e55c310_80cc_43db_8a8e_bbc970dd7fbf.slice/crio-be0e450d496b5ef019243d776eeca14f0015cc3a458f099cdfeec396a5e40118 WatchSource:0}: Error finding container be0e450d496b5ef019243d776eeca14f0015cc3a458f099cdfeec396a5e40118: Status 404 returned error can't find the container with id be0e450d496b5ef019243d776eeca14f0015cc3a458f099cdfeec396a5e40118 Jul 08 16:38:54.091471 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:54.091441 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2"] Jul 08 16:38:54.094631 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:38:54.094601 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d08e0bf_52f8_4bc1_ab80_6238488faf00.slice/crio-7b68171e0a63ec61d20824107f76a43088d58e4592ace9ffd942315c067c0549 WatchSource:0}: Error finding container 7b68171e0a63ec61d20824107f76a43088d58e4592ace9ffd942315c067c0549: Status 404 returned error can't find the container with id 7b68171e0a63ec61d20824107f76a43088d58e4592ace9ffd942315c067c0549 Jul 08 16:38:54.200683 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:54.200640 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:54.200683 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:54.200686 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:38:54.200925 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:54.200734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:54.200925 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:54.200849 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 16:38:54.200925 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:54.200885 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:38:54.200925 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:54.200920 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle podName:cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96 nodeName:}" failed. No retries permitted until 2026-07-08 16:38:55.20090146 +0000 UTC m=+248.538825926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle") pod "router-default-6879d7ccd5-7jg6n" (UID: "cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96") : configmap references non-existent config key: service-ca.crt Jul 08 16:38:54.201056 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:54.200943 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls podName:0842d1ff-72b9-424d-af59-3d25ee3df89d nodeName:}" failed. No retries permitted until 2026-07-08 16:38:55.200928669 +0000 UTC m=+248.538853135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4zkj5" (UID: "0842d1ff-72b9-424d-af59-3d25ee3df89d") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:38:54.201056 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:54.200958 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs podName:cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96 nodeName:}" failed. No retries permitted until 2026-07-08 16:38:55.200951322 +0000 UTC m=+248.538875788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs") pod "router-default-6879d7ccd5-7jg6n" (UID: "cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96") : secret "router-metrics-certs-default" not found Jul 08 16:38:54.646913 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:54.646880 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:38:54.796161 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:54.796129 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: failed to sync secret cache: timed out waiting for the condition Jul 08 16:38:54.796352 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:54.796227 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls podName:d72d7274-2e6a-45e0-ae20-4f99253dc2e8 nodeName:}" failed. No retries permitted until 2026-07-08 16:38:55.296203069 +0000 UTC m=+248.634127546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-f764g" (UID: "d72d7274-2e6a-45e0-ae20-4f99253dc2e8") : failed to sync secret cache: timed out waiting for the condition Jul 08 16:38:54.802811 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:54.802778 2567 projected.go:291] Couldn't get configMap openshift-cluster-samples-operator/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 08 16:38:54.802970 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:54.802824 2567 projected.go:196] Error preparing data for projected volume kube-api-access-xdxxh for pod openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g: failed to sync configmap cache: timed out waiting for the condition Jul 08 16:38:54.802970 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:54.802893 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-kube-api-access-xdxxh podName:d72d7274-2e6a-45e0-ae20-4f99253dc2e8 nodeName:}" failed. No retries permitted until 2026-07-08 16:38:55.302873947 +0000 UTC m=+248.640798429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xdxxh" (UniqueName: "kubernetes.io/projected/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-kube-api-access-xdxxh") pod "cluster-samples-operator-56fcf86bf-f764g" (UID: "d72d7274-2e6a-45e0-ae20-4f99253dc2e8") : failed to sync configmap cache: timed out waiting for the condition Jul 08 16:38:54.899097 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:54.899016 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 16:38:54.991396 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:54.991369 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rc776\"" Jul 08 16:38:55.017371 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:55.017326 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" event={"ID":"4e55c310-80cc-43db-8a8e-bbc970dd7fbf","Type":"ContainerStarted","Data":"be0e450d496b5ef019243d776eeca14f0015cc3a458f099cdfeec396a5e40118"} Jul 08 16:38:55.018505 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:55.018476 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" event={"ID":"2d08e0bf-52f8-4bc1-ab80-6238488faf00","Type":"ContainerStarted","Data":"7b68171e0a63ec61d20824107f76a43088d58e4592ace9ffd942315c067c0549"} Jul 08 16:38:55.123475 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:55.123439 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 16:38:55.209188 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:55.209096 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:55.209188 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:55.209143 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:38:55.209437 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:55.209201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:55.209437 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:55.209268 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 16:38:55.209437 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:55.209337 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs podName:cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96 nodeName:}" failed. No retries permitted until 2026-07-08 16:38:57.209317357 +0000 UTC m=+250.547241841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs") pod "router-default-6879d7ccd5-7jg6n" (UID: "cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96") : secret "router-metrics-certs-default" not found Jul 08 16:38:55.209437 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:55.209348 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:38:55.209437 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:55.209357 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle podName:cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96 nodeName:}" failed. No retries permitted until 2026-07-08 16:38:57.209347321 +0000 UTC m=+250.547271791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle") pod "router-default-6879d7ccd5-7jg6n" (UID: "cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96") : configmap references non-existent config key: service-ca.crt Jul 08 16:38:55.209437 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:55.209432 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls podName:0842d1ff-72b9-424d-af59-3d25ee3df89d nodeName:}" failed. No retries permitted until 2026-07-08 16:38:57.209413871 +0000 UTC m=+250.547338352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4zkj5" (UID: "0842d1ff-72b9-424d-af59-3d25ee3df89d") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:38:55.309952 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:55.309902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdxxh\" (UniqueName: \"kubernetes.io/projected/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-kube-api-access-xdxxh\") pod \"cluster-samples-operator-56fcf86bf-f764g\" (UID: \"d72d7274-2e6a-45e0-ae20-4f99253dc2e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:38:55.310158 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:55.309979 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-f764g\" (UID: \"d72d7274-2e6a-45e0-ae20-4f99253dc2e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:38:55.310158 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:55.310132 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 16:38:55.310290 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:55.310208 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls podName:d72d7274-2e6a-45e0-ae20-4f99253dc2e8 nodeName:}" failed. No retries permitted until 2026-07-08 16:38:56.310188967 +0000 UTC m=+249.648113452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-f764g" (UID: "d72d7274-2e6a-45e0-ae20-4f99253dc2e8") : secret "samples-operator-tls" not found Jul 08 16:38:55.313682 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:55.313641 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdxxh\" (UniqueName: \"kubernetes.io/projected/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-kube-api-access-xdxxh\") pod \"cluster-samples-operator-56fcf86bf-f764g\" (UID: \"d72d7274-2e6a-45e0-ae20-4f99253dc2e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:38:56.319474 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:56.319437 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-f764g\" (UID: \"d72d7274-2e6a-45e0-ae20-4f99253dc2e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:38:56.320016 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:56.319632 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 16:38:56.320016 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:56.319717 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls podName:d72d7274-2e6a-45e0-ae20-4f99253dc2e8 nodeName:}" failed. No retries permitted until 2026-07-08 16:38:58.319694516 +0000 UTC m=+251.657618995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-f764g" (UID: "d72d7274-2e6a-45e0-ae20-4f99253dc2e8") : secret "samples-operator-tls" not found Jul 08 16:38:57.025666 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:57.025623 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" event={"ID":"4e55c310-80cc-43db-8a8e-bbc970dd7fbf","Type":"ContainerStarted","Data":"0f5625dafcd8fb8c1fc810502b895b3153fda84addbc0ba8aec560fba302fd01"} Jul 08 16:38:57.027165 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:57.027138 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" event={"ID":"2d08e0bf-52f8-4bc1-ab80-6238488faf00","Type":"ContainerStarted","Data":"46da5861a7df4499e0484816c5bcc1512f38fa8c937ca4324ac8f8715fef70b3"} Jul 08 16:38:57.042368 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:57.042317 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" podStartSLOduration=1.230844662 podStartE2EDuration="4.042300046s" totalImagesPullingTime="2.811455384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:38:57.041468526 +0000 UTC m=+250.379393015" watchObservedRunningTime="2026-07-08 16:38:57.042300046 +0000 UTC m=+250.380224552" Jul 08 16:38:57.056479 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:57.056431 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" podStartSLOduration=1.263340752 podStartE2EDuration="4.05641362s" totalImagesPullingTime="2.793072868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:38:57.05565588 +0000 UTC m=+250.393580370" watchObservedRunningTime="2026-07-08 16:38:57.05641362 +0000 UTC m=+250.394338153" Jul 08 16:38:57.227061 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:57.227026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:57.227254 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:57.227065 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:38:57.227254 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:57.227143 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:38:57.227254 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:57.227176 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 16:38:57.227254 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:57.227254 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs podName:cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:01.227232902 +0000 UTC m=+254.565157381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs") pod "router-default-6879d7ccd5-7jg6n" (UID: "cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96") : secret "router-metrics-certs-default" not found Jul 08 16:38:57.227404 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:57.227261 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:38:57.227404 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:57.227270 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle podName:cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:01.227263472 +0000 UTC m=+254.565187938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle") pod "router-default-6879d7ccd5-7jg6n" (UID: "cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96") : configmap references non-existent config key: service-ca.crt Jul 08 16:38:57.227404 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:57.227344 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls podName:0842d1ff-72b9-424d-af59-3d25ee3df89d nodeName:}" failed. No retries permitted until 2026-07-08 16:39:01.227321768 +0000 UTC m=+254.565246242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4zkj5" (UID: "0842d1ff-72b9-424d-af59-3d25ee3df89d") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:38:58.335258 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:58.335216 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-f764g\" (UID: \"d72d7274-2e6a-45e0-ae20-4f99253dc2e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:38:58.335671 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:58.335349 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 16:38:58.335671 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:58.335422 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls podName:d72d7274-2e6a-45e0-ae20-4f99253dc2e8 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:02.335400944 +0000 UTC m=+255.673325409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-f764g" (UID: "d72d7274-2e6a-45e0-ae20-4f99253dc2e8") : secret "samples-operator-tls" not found Jul 08 16:38:58.461779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:58.461741 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j775w"] Jul 08 16:38:58.464024 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:58.464008 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j775w" Jul 08 16:38:58.467648 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:58.467622 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fjkt9\"" Jul 08 16:38:58.467889 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:58.467622 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 16:38:58.467889 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:58.467679 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 16:38:58.476544 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:58.476509 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j775w"] Jul 08 16:38:58.537697 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:58.537663 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txnvn\" (UniqueName: \"kubernetes.io/projected/f463ee9f-e90b-48dc-86b6-4ab9bf01d298-kube-api-access-txnvn\") pod \"migrator-d57d58cc9-j775w\" (UID: \"f463ee9f-e90b-48dc-86b6-4ab9bf01d298\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j775w" Jul 08 16:38:58.638510 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:58.638416 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txnvn\" (UniqueName: \"kubernetes.io/projected/f463ee9f-e90b-48dc-86b6-4ab9bf01d298-kube-api-access-txnvn\") pod \"migrator-d57d58cc9-j775w\" (UID: \"f463ee9f-e90b-48dc-86b6-4ab9bf01d298\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j775w" Jul 08 16:38:58.651987 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:58.651955 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txnvn\" (UniqueName: \"kubernetes.io/projected/f463ee9f-e90b-48dc-86b6-4ab9bf01d298-kube-api-access-txnvn\") pod \"migrator-d57d58cc9-j775w\" (UID: \"f463ee9f-e90b-48dc-86b6-4ab9bf01d298\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j775w" Jul 08 16:38:58.773430 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:58.773368 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j775w" Jul 08 16:38:58.904226 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:58.904143 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j775w"] Jul 08 16:38:58.907097 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:38:58.907062 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf463ee9f_e90b_48dc_86b6_4ab9bf01d298.slice/crio-6b2be41210c1892980cb93256d7e8e8952deabffae1afabdc4987814f98483b2 WatchSource:0}: Error finding container 6b2be41210c1892980cb93256d7e8e8952deabffae1afabdc4987814f98483b2: Status 404 returned error can't find the container with id 6b2be41210c1892980cb93256d7e8e8952deabffae1afabdc4987814f98483b2 Jul 08 16:38:58.941137 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:58.941110 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:38:58.941281 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:58.941257 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 16:38:58.941324 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:38:58.941320 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs podName:31bdf910-65ce-489b-ba71-64d9080e8443 nodeName:}" failed. No retries permitted until 2026-07-08 16:41:00.941303596 +0000 UTC m=+374.279228063 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs") pod "network-metrics-daemon-t6fms" (UID: "31bdf910-65ce-489b-ba71-64d9080e8443") : secret "metrics-daemon-secret" not found Jul 08 16:38:59.033568 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:59.033519 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j775w" event={"ID":"f463ee9f-e90b-48dc-86b6-4ab9bf01d298","Type":"ContainerStarted","Data":"6b2be41210c1892980cb93256d7e8e8952deabffae1afabdc4987814f98483b2"} Jul 08 16:38:59.902436 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:59.902399 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f57rh"] Jul 08 16:38:59.906270 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:59.906252 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:38:59.908619 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:59.908593 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 16:38:59.908750 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:59.908626 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 16:38:59.908962 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:59.908948 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 16:38:59.909721 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:59.909702 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 16:38:59.909830 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:59.909705 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8kpkx\"" Jul 08 16:38:59.919806 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:38:59.919781 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f57rh"] Jul 08 16:39:00.049970 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.049936 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5be7c8c6-981e-4353-81d9-38135fe81075-crio-socket\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.049970 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.049978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.050187 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.050074 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ht59\" (UniqueName: \"kubernetes.io/projected/5be7c8c6-981e-4353-81d9-38135fe81075-kube-api-access-9ht59\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.050187 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.050123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.050187 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.050143 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5be7c8c6-981e-4353-81d9-38135fe81075-data-volume\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.151284 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.151244 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5be7c8c6-981e-4353-81d9-38135fe81075-crio-socket\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.151284 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.151294 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.151554 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.151385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5be7c8c6-981e-4353-81d9-38135fe81075-crio-socket\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.151554 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:00.151447 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:39:00.151554 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.151463 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ht59\" (UniqueName: \"kubernetes.io/projected/5be7c8c6-981e-4353-81d9-38135fe81075-kube-api-access-9ht59\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.151554 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.151513 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.151767 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.151561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5be7c8c6-981e-4353-81d9-38135fe81075-data-volume\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.151767 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:00.151602 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls podName:5be7c8c6-981e-4353-81d9-38135fe81075 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:00.651573953 +0000 UTC m=+253.989498426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f57rh" (UID: "5be7c8c6-981e-4353-81d9-38135fe81075") : secret "insights-runtime-extractor-tls" not found Jul 08 16:39:00.151767 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:00.151640 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:39:00.151767 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:00.151696 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm podName:5be7c8c6-981e-4353-81d9-38135fe81075 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:00.651679601 +0000 UTC m=+253.989604073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f57rh" (UID: "5be7c8c6-981e-4353-81d9-38135fe81075") : configmap "kube-rbac-proxy" not found Jul 08 16:39:00.151912 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.151893 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5be7c8c6-981e-4353-81d9-38135fe81075-data-volume\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.162667 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.162600 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ht59\" (UniqueName: \"kubernetes.io/projected/5be7c8c6-981e-4353-81d9-38135fe81075-kube-api-access-9ht59\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.655114 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.655075 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.655329 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:00.655175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:00.655329 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:00.655253 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:39:00.655329 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:00.655305 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:39:00.655481 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:00.655333 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls podName:5be7c8c6-981e-4353-81d9-38135fe81075 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:01.655313774 +0000 UTC m=+254.993238257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f57rh" (UID: "5be7c8c6-981e-4353-81d9-38135fe81075") : secret "insights-runtime-extractor-tls" not found Jul 08 16:39:00.655481 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:00.655365 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm podName:5be7c8c6-981e-4353-81d9-38135fe81075 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:01.655347294 +0000 UTC m=+254.993271762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f57rh" (UID: "5be7c8c6-981e-4353-81d9-38135fe81075") : configmap "kube-rbac-proxy" not found Jul 08 16:39:01.040633 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:01.040599 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j775w" event={"ID":"f463ee9f-e90b-48dc-86b6-4ab9bf01d298","Type":"ContainerStarted","Data":"5b3f7112909ff883cbff37c9c1f7755010cda4fd84d33f9d92cdf7834b2d456b"} Jul 08 16:39:01.041101 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:01.040661 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j775w" event={"ID":"f463ee9f-e90b-48dc-86b6-4ab9bf01d298","Type":"ContainerStarted","Data":"7859a580111544766bd9e5b3f576f82dd16a8f65c497ac3a08867526f4cdb2df"} Jul 08 16:39:01.064980 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:01.064924 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j775w" podStartSLOduration=1.151387023 podStartE2EDuration="3.06490714s" totalImagesPullingTime="1.913520117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:01.064209608 +0000 UTC m=+254.402134094" watchObservedRunningTime="2026-07-08 16:39:01.06490714 +0000 UTC m=+254.402831673" Jul 08 16:39:01.259712 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:01.259671 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:39:01.259914 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:01.259730 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:39:01.259914 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:01.259756 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:39:01.259914 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:01.259840 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle podName:cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:09.259821822 +0000 UTC m=+262.597746287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle") pod "router-default-6879d7ccd5-7jg6n" (UID: "cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96") : configmap references non-existent config key: service-ca.crt Jul 08 16:39:01.259914 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:01.259852 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 16:39:01.259914 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:01.259896 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs podName:cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:09.259884386 +0000 UTC m=+262.597808857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs") pod "router-default-6879d7ccd5-7jg6n" (UID: "cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96") : secret "router-metrics-certs-default" not found Jul 08 16:39:01.260124 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:01.259918 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:39:01.260124 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:01.259972 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls podName:0842d1ff-72b9-424d-af59-3d25ee3df89d nodeName:}" failed. No retries permitted until 2026-07-08 16:39:09.259957547 +0000 UTC m=+262.597882030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4zkj5" (UID: "0842d1ff-72b9-424d-af59-3d25ee3df89d") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:39:01.663547 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:01.663416 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:01.663547 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:01.663513 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:01.663766 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:01.663593 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:39:01.663766 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:01.663664 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls podName:5be7c8c6-981e-4353-81d9-38135fe81075 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:03.663647947 +0000 UTC m=+257.001572413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f57rh" (UID: "5be7c8c6-981e-4353-81d9-38135fe81075") : secret "insights-runtime-extractor-tls" not found Jul 08 16:39:01.663766 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:01.663598 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:39:01.663766 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:01.663726 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm podName:5be7c8c6-981e-4353-81d9-38135fe81075 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:03.663715668 +0000 UTC m=+257.001640133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f57rh" (UID: "5be7c8c6-981e-4353-81d9-38135fe81075") : configmap "kube-rbac-proxy" not found Jul 08 16:39:02.368278 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:02.368236 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-f764g\" (UID: \"d72d7274-2e6a-45e0-ae20-4f99253dc2e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:39:02.368712 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:02.368384 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 16:39:02.368712 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:02.368448 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls podName:d72d7274-2e6a-45e0-ae20-4f99253dc2e8 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:10.368432295 +0000 UTC m=+263.706356761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-f764g" (UID: "d72d7274-2e6a-45e0-ae20-4f99253dc2e8") : secret "samples-operator-tls" not found Jul 08 16:39:02.489281 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:02.489255 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7b6vx_b3c1f306-e11e-46e6-8ac6-e96e6652587d/dns-node-resolver/0.log" Jul 08 16:39:03.490180 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:03.490151 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-58tpf_84099618-1b2d-4ae6-adbb-28141b6cde6d/node-ca/0.log" Jul 08 16:39:03.678653 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:03.678615 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:03.678805 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:03.678689 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:03.678805 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:03.678760 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:39:03.678805 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:03.678782 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:39:03.678904 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:03.678812 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm podName:5be7c8c6-981e-4353-81d9-38135fe81075 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:07.67879817 +0000 UTC m=+261.016722636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f57rh" (UID: "5be7c8c6-981e-4353-81d9-38135fe81075") : configmap "kube-rbac-proxy" not found Jul 08 16:39:03.678904 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:03.678835 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls podName:5be7c8c6-981e-4353-81d9-38135fe81075 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:07.678823646 +0000 UTC m=+261.016748111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f57rh" (UID: "5be7c8c6-981e-4353-81d9-38135fe81075") : secret "insights-runtime-extractor-tls" not found Jul 08 16:39:04.289352 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:04.289323 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-82djv_cea34dd4-9352-469b-a435-2e373be078d4/serve-healthcheck-canary/0.log" Jul 08 16:39:04.890480 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:04.890450 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j775w_f463ee9f-e90b-48dc-86b6-4ab9bf01d298/migrator/0.log" Jul 08 16:39:05.089694 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:05.089669 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j775w_f463ee9f-e90b-48dc-86b6-4ab9bf01d298/graceful-termination/0.log" Jul 08 16:39:05.291081 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:05.291049 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-8pxcn_4e55c310-80cc-43db-8a8e-bbc970dd7fbf/kube-storage-version-migrator-operator/0.log" Jul 08 16:39:07.711913 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:07.711873 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:07.712388 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:07.711951 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:07.712388 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:07.711970 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:39:07.712388 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:07.712031 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:39:07.712388 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:07.712043 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm podName:5be7c8c6-981e-4353-81d9-38135fe81075 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:15.712022276 +0000 UTC m=+269.049946754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f57rh" (UID: "5be7c8c6-981e-4353-81d9-38135fe81075") : configmap "kube-rbac-proxy" not found Jul 08 16:39:07.712388 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:07.712069 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls podName:5be7c8c6-981e-4353-81d9-38135fe81075 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:15.712057749 +0000 UTC m=+269.049982214 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f57rh" (UID: "5be7c8c6-981e-4353-81d9-38135fe81075") : secret "insights-runtime-extractor-tls" not found Jul 08 16:39:09.325617 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:09.325512 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:39:09.325617 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:09.325579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:39:09.326229 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:09.325665 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 16:39:09.326229 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:09.325730 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs podName:cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:25.325711579 +0000 UTC m=+278.663636059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs") pod "router-default-6879d7ccd5-7jg6n" (UID: "cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96") : secret "router-metrics-certs-default" not found Jul 08 16:39:09.326229 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:09.325743 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:39:09.326229 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:09.325762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:39:09.326229 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:09.325801 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls podName:0842d1ff-72b9-424d-af59-3d25ee3df89d nodeName:}" failed. No retries permitted until 2026-07-08 16:39:25.325791245 +0000 UTC m=+278.663715711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4zkj5" (UID: "0842d1ff-72b9-424d-af59-3d25ee3df89d") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:39:09.326229 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:09.325851 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle podName:cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:25.325833728 +0000 UTC m=+278.663758194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle") pod "router-default-6879d7ccd5-7jg6n" (UID: "cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96") : configmap references non-existent config key: service-ca.crt Jul 08 16:39:10.435780 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:10.435746 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-f764g\" (UID: \"d72d7274-2e6a-45e0-ae20-4f99253dc2e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:39:10.438219 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:10.438195 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d72d7274-2e6a-45e0-ae20-4f99253dc2e8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-f764g\" (UID: \"d72d7274-2e6a-45e0-ae20-4f99253dc2e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:39:10.445083 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:10.445052 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" Jul 08 16:39:10.580829 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:10.580763 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g"] Jul 08 16:39:11.077013 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:11.076980 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" event={"ID":"d72d7274-2e6a-45e0-ae20-4f99253dc2e8","Type":"ContainerStarted","Data":"8b4d1b3a0845067d3ef6c524732a4be17ae2107c6fba926cdd026405eb8521c4"} Jul 08 16:39:14.088102 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:14.088071 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" event={"ID":"d72d7274-2e6a-45e0-ae20-4f99253dc2e8","Type":"ContainerStarted","Data":"17135f28bc3d66ade936481ae2915ec2674033a4f75b3fe8fbb75e53ffe4a59f"} Jul 08 16:39:14.088483 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:14.088121 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" event={"ID":"d72d7274-2e6a-45e0-ae20-4f99253dc2e8","Type":"ContainerStarted","Data":"1c69fb30479de0dd94950b0d37302366081aa60cfb39b8da400a3c86acd0afd4"} Jul 08 16:39:14.118876 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:14.118810 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-f764g" podStartSLOduration=18.153474308 podStartE2EDuration="21.118791073s" totalImagesPullingTime="2.965316765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:14.118502012 +0000 UTC m=+267.456426525" watchObservedRunningTime="2026-07-08 16:39:14.118791073 +0000 UTC m=+267.456715558" Jul 08 16:39:15.780623 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:15.780578 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:15.781046 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:15.780680 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:15.781262 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:15.781241 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5be7c8c6-981e-4353-81d9-38135fe81075-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:15.783015 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:15.782992 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5be7c8c6-981e-4353-81d9-38135fe81075-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f57rh\" (UID: \"5be7c8c6-981e-4353-81d9-38135fe81075\") " pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:15.815671 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:15.815635 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f57rh" Jul 08 16:39:15.945729 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:15.945691 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f57rh"] Jul 08 16:39:15.948443 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:39:15.948414 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be7c8c6_981e_4353_81d9_38135fe81075.slice/crio-43e207311a415d93b47bec02dd10ec65e1e29dc7fc173970579c648131cbd55e WatchSource:0}: Error finding container 43e207311a415d93b47bec02dd10ec65e1e29dc7fc173970579c648131cbd55e: Status 404 returned error can't find the container with id 43e207311a415d93b47bec02dd10ec65e1e29dc7fc173970579c648131cbd55e Jul 08 16:39:16.095080 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:16.094994 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f57rh" event={"ID":"5be7c8c6-981e-4353-81d9-38135fe81075","Type":"ContainerStarted","Data":"43e207311a415d93b47bec02dd10ec65e1e29dc7fc173970579c648131cbd55e"} Jul 08 16:39:20.583701 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:20.583668 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-b9rh9"] Jul 08 16:39:20.587125 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:20.587100 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-b9rh9" Jul 08 16:39:20.589993 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:20.589968 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 16:39:20.589993 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:20.589987 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 16:39:20.590209 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:20.589969 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-trmp7\"" Jul 08 16:39:20.597281 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:20.597254 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-b9rh9"] Jul 08 16:39:20.621977 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:20.621940 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4r4m\" (UniqueName: \"kubernetes.io/projected/0a3993bc-25ec-4852-8333-0ef3d216968d-kube-api-access-r4r4m\") pod \"downloads-685bfb5f64-b9rh9\" (UID: \"0a3993bc-25ec-4852-8333-0ef3d216968d\") " pod="openshift-console/downloads-685bfb5f64-b9rh9" Jul 08 16:39:20.722501 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:20.722453 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4r4m\" (UniqueName: \"kubernetes.io/projected/0a3993bc-25ec-4852-8333-0ef3d216968d-kube-api-access-r4r4m\") pod \"downloads-685bfb5f64-b9rh9\" (UID: \"0a3993bc-25ec-4852-8333-0ef3d216968d\") " pod="openshift-console/downloads-685bfb5f64-b9rh9" Jul 08 16:39:20.735294 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:20.735252 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4r4m\" (UniqueName: \"kubernetes.io/projected/0a3993bc-25ec-4852-8333-0ef3d216968d-kube-api-access-r4r4m\") pod \"downloads-685bfb5f64-b9rh9\" (UID: \"0a3993bc-25ec-4852-8333-0ef3d216968d\") " pod="openshift-console/downloads-685bfb5f64-b9rh9" Jul 08 16:39:20.898380 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:20.898343 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-b9rh9" Jul 08 16:39:21.034145 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:21.034099 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-b9rh9"] Jul 08 16:39:21.036100 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:39:21.036072 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3993bc_25ec_4852_8333_0ef3d216968d.slice/crio-599089039d01f2def5eb2c548b7c9e76f3d571d3349d0710702c3d2a967b6d03 WatchSource:0}: Error finding container 599089039d01f2def5eb2c548b7c9e76f3d571d3349d0710702c3d2a967b6d03: Status 404 returned error can't find the container with id 599089039d01f2def5eb2c548b7c9e76f3d571d3349d0710702c3d2a967b6d03 Jul 08 16:39:21.114175 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:21.114070 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-b9rh9" event={"ID":"0a3993bc-25ec-4852-8333-0ef3d216968d","Type":"ContainerStarted","Data":"599089039d01f2def5eb2c548b7c9e76f3d571d3349d0710702c3d2a967b6d03"} Jul 08 16:39:21.115428 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:21.115397 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f57rh" event={"ID":"5be7c8c6-981e-4353-81d9-38135fe81075","Type":"ContainerStarted","Data":"b3003ee64f8a9d7634b127905828c624b12f91b8a8255150be0ce22d6837030e"} Jul 08 16:39:22.121644 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:22.121561 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f57rh" event={"ID":"5be7c8c6-981e-4353-81d9-38135fe81075","Type":"ContainerStarted","Data":"6dd1eb3a8782f5c449acaa857c84032446c6fa9d8b62fc76681f42c821662bb8"} Jul 08 16:39:25.135161 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:25.135120 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f57rh" event={"ID":"5be7c8c6-981e-4353-81d9-38135fe81075","Type":"ContainerStarted","Data":"089569073b32b7e1075205600e7044283118173bb4b76983d275f3139dcb73ee"} Jul 08 16:39:25.156266 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:25.156207 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f57rh" podStartSLOduration=18.110208992 podStartE2EDuration="26.156178727s" totalImagesPullingTime="8.045969735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:38:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:25.155169645 +0000 UTC m=+278.493094134" watchObservedRunningTime="2026-07-08 16:39:25.156178727 +0000 UTC m=+278.494103215" Jul 08 16:39:25.362395 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:25.362362 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:39:25.362591 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:25.362414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:39:25.362591 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:25.362440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:39:25.363110 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:25.363082 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-service-ca-bundle\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:39:25.365118 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:25.365094 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96-metrics-certs\") pod \"router-default-6879d7ccd5-7jg6n\" (UID: \"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96\") " pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:39:25.365241 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:25.365189 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0842d1ff-72b9-424d-af59-3d25ee3df89d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4zkj5\" (UID: \"0842d1ff-72b9-424d-af59-3d25ee3df89d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:39:25.645448 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:25.645414 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" Jul 08 16:39:25.650704 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:25.650667 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:39:25.813195 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:25.813088 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6879d7ccd5-7jg6n"] Jul 08 16:39:25.816089 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:39:25.816052 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb54e00d_1b8f_4cc4_8eb6_ba3b50c56b96.slice/crio-cfd601efc45424f7c77277edcbb37e099cb072346baaf99b8b8efb41f476fc45 WatchSource:0}: Error finding container cfd601efc45424f7c77277edcbb37e099cb072346baaf99b8b8efb41f476fc45: Status 404 returned error can't find the container with id cfd601efc45424f7c77277edcbb37e099cb072346baaf99b8b8efb41f476fc45 Jul 08 16:39:25.829841 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:25.829802 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5"] Jul 08 16:39:25.832708 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:39:25.832650 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0842d1ff_72b9_424d_af59_3d25ee3df89d.slice/crio-6594a5b6fa241aa58a67d0c3b805e83d97d69f0f402e771c6e6665832aac5e39 WatchSource:0}: Error finding container 6594a5b6fa241aa58a67d0c3b805e83d97d69f0f402e771c6e6665832aac5e39: Status 404 returned error can't find the container with id 6594a5b6fa241aa58a67d0c3b805e83d97d69f0f402e771c6e6665832aac5e39 Jul 08 16:39:26.140392 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:26.140354 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" event={"ID":"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96","Type":"ContainerStarted","Data":"f6a99f8755e39903b189efd747215609b1f82f90b9477da99dd97761485d7df6"} Jul 08 16:39:26.140922 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:26.140422 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" event={"ID":"cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96","Type":"ContainerStarted","Data":"cfd601efc45424f7c77277edcbb37e099cb072346baaf99b8b8efb41f476fc45"} Jul 08 16:39:26.141939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:26.141888 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" event={"ID":"0842d1ff-72b9-424d-af59-3d25ee3df89d","Type":"ContainerStarted","Data":"6594a5b6fa241aa58a67d0c3b805e83d97d69f0f402e771c6e6665832aac5e39"} Jul 08 16:39:26.163469 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:26.163405 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" podStartSLOduration=33.163380494 podStartE2EDuration="33.163380494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:26.16266013 +0000 UTC m=+279.500584617" watchObservedRunningTime="2026-07-08 16:39:26.163380494 +0000 UTC m=+279.501304980" Jul 08 16:39:26.651738 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:26.651701 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:39:26.654363 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:26.654339 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:39:27.150293 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:27.149987 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:39:27.151382 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:27.151359 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6879d7ccd5-7jg6n" Jul 08 16:39:28.156582 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:28.156502 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" event={"ID":"0842d1ff-72b9-424d-af59-3d25ee3df89d","Type":"ContainerStarted","Data":"1cfbfaa2888a15b7704d3120f23e70d838c7683c4e72f34d8509d8328792acfb"} Jul 08 16:39:28.175763 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:28.175678 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4zkj5" podStartSLOduration=33.017669825 podStartE2EDuration="35.175654558s" totalImagesPullingTime="2.157984733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:28.17344859 +0000 UTC m=+281.511373079" watchObservedRunningTime="2026-07-08 16:39:28.175654558 +0000 UTC m=+281.513579047" Jul 08 16:39:28.524415 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:28.524378 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bfnx5"] Jul 08 16:39:28.527695 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:28.527669 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bfnx5" Jul 08 16:39:28.530515 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:28.530457 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 16:39:28.530515 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:28.530463 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2xn94\"" Jul 08 16:39:28.536800 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:28.536732 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bfnx5"] Jul 08 16:39:28.591271 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:28.591241 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a18b9b6a-b38c-42cf-b618-c3dfd5648fa0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-bfnx5\" (UID: \"a18b9b6a-b38c-42cf-b618-c3dfd5648fa0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bfnx5" Jul 08 16:39:28.692688 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:28.692647 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a18b9b6a-b38c-42cf-b618-c3dfd5648fa0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-bfnx5\" (UID: \"a18b9b6a-b38c-42cf-b618-c3dfd5648fa0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bfnx5" Jul 08 16:39:28.695782 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:28.695751 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a18b9b6a-b38c-42cf-b618-c3dfd5648fa0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-bfnx5\" (UID: \"a18b9b6a-b38c-42cf-b618-c3dfd5648fa0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bfnx5" Jul 08 16:39:28.803333 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:28.803240 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2l522" podUID="9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71" Jul 08 16:39:28.839916 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:28.839880 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bfnx5" Jul 08 16:39:28.998429 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:28.998391 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bfnx5"] Jul 08 16:39:29.002510 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:39:29.002479 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18b9b6a_b38c_42cf_b618_c3dfd5648fa0.slice/crio-fedbffbaf3ca34ee849e750ed42eef61c9dd16c17a218a86aa29a1d66234aba1 WatchSource:0}: Error finding container fedbffbaf3ca34ee849e750ed42eef61c9dd16c17a218a86aa29a1d66234aba1: Status 404 returned error can't find the container with id fedbffbaf3ca34ee849e750ed42eef61c9dd16c17a218a86aa29a1d66234aba1 Jul 08 16:39:29.161860 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:29.161782 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2l522" Jul 08 16:39:29.161860 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:29.161785 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bfnx5" event={"ID":"a18b9b6a-b38c-42cf-b618-c3dfd5648fa0","Type":"ContainerStarted","Data":"fedbffbaf3ca34ee849e750ed42eef61c9dd16c17a218a86aa29a1d66234aba1"} Jul 08 16:39:30.105374 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.105329 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b4cfd8779-lxsbp"] Jul 08 16:39:30.111649 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.111619 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.114483 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.114356 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 16:39:30.115404 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.115378 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 16:39:30.115624 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.115606 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 16:39:30.115724 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.115624 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 16:39:30.115724 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.115685 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f2htc\"" Jul 08 16:39:30.115864 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.115846 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 16:39:30.118325 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.118303 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4cfd8779-lxsbp"] Jul 08 16:39:30.205935 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.205890 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-oauth-config\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.206421 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.205951 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-service-ca\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.206421 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.206019 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt6tc\" (UniqueName: \"kubernetes.io/projected/eccffc5f-9cf4-4822-b6cb-81a672e66aec-kube-api-access-dt6tc\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.206421 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.206147 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-config\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.206421 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.206168 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-oauth-serving-cert\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.206421 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.206192 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-serving-cert\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.306976 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.306948 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-config\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.307110 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.306992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-oauth-serving-cert\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.307110 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.307034 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-serving-cert\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.307375 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.307354 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-oauth-config\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.307772 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.307413 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-service-ca\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.307772 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.307583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt6tc\" (UniqueName: \"kubernetes.io/projected/eccffc5f-9cf4-4822-b6cb-81a672e66aec-kube-api-access-dt6tc\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.307930 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.307800 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-config\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.307930 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.307826 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-oauth-serving-cert\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.308194 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.308168 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-service-ca\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.310053 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.310033 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-oauth-config\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.310503 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.310478 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-serving-cert\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.316939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.316855 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt6tc\" (UniqueName: \"kubernetes.io/projected/eccffc5f-9cf4-4822-b6cb-81a672e66aec-kube-api-access-dt6tc\") pod \"console-5b4cfd8779-lxsbp\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.424979 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.424945 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:30.572960 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:30.572928 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4cfd8779-lxsbp"] Jul 08 16:39:30.576021 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:39:30.575992 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeccffc5f_9cf4_4822_b6cb_81a672e66aec.slice/crio-010a8d3c6b010dfe18dd481edcb9d4b90cdd58c3836bbf0c3642e4df60efaeb3 WatchSource:0}: Error finding container 010a8d3c6b010dfe18dd481edcb9d4b90cdd58c3836bbf0c3642e4df60efaeb3: Status 404 returned error can't find the container with id 010a8d3c6b010dfe18dd481edcb9d4b90cdd58c3836bbf0c3642e4df60efaeb3 Jul 08 16:39:31.171107 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:31.171066 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4cfd8779-lxsbp" event={"ID":"eccffc5f-9cf4-4822-b6cb-81a672e66aec","Type":"ContainerStarted","Data":"010a8d3c6b010dfe18dd481edcb9d4b90cdd58c3836bbf0c3642e4df60efaeb3"} Jul 08 16:39:31.172309 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:31.172287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bfnx5" event={"ID":"a18b9b6a-b38c-42cf-b618-c3dfd5648fa0","Type":"ContainerStarted","Data":"49d4ebe9fa2875b6d08b8396c4f598b4c565d9e0df3cedd20093d22fdea4290b"} Jul 08 16:39:31.172518 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:31.172499 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bfnx5" Jul 08 16:39:31.177418 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:31.177387 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bfnx5" Jul 08 16:39:31.212319 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:31.212262 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-bfnx5" podStartSLOduration=1.921470638 podStartE2EDuration="3.212243156s" totalImagesPullingTime="1.290772518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:31.1947147 +0000 UTC m=+284.532639186" watchObservedRunningTime="2026-07-08 16:39:31.212243156 +0000 UTC m=+284.550167621" Jul 08 16:39:31.925444 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:31.925412 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:39:31.928439 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:31.928409 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71-metrics-tls\") pod \"dns-default-2l522\" (UID: \"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71\") " pod="openshift-dns/dns-default-2l522" Jul 08 16:39:32.165754 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:32.165714 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rvfsx\"" Jul 08 16:39:32.173117 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:32.173055 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2l522" Jul 08 16:39:32.344035 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:32.344001 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2l522"] Jul 08 16:39:32.347585 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:39:32.347545 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9590cf9d_5a23_4ab4_8b62_ce4a5bb85e71.slice/crio-07fb8479d78b4ca19e57235612cb37c17adc0f5b5fc795d1482e0b0eec6a4f40 WatchSource:0}: Error finding container 07fb8479d78b4ca19e57235612cb37c17adc0f5b5fc795d1482e0b0eec6a4f40: Status 404 returned error can't find the container with id 07fb8479d78b4ca19e57235612cb37c17adc0f5b5fc795d1482e0b0eec6a4f40 Jul 08 16:39:33.181993 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:33.181954 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2l522" event={"ID":"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71","Type":"ContainerStarted","Data":"07fb8479d78b4ca19e57235612cb37c17adc0f5b5fc795d1482e0b0eec6a4f40"} Jul 08 16:39:38.947450 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:38.947403 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4"] Jul 08 16:39:38.950185 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:38.950157 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:38.953198 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:38.953167 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jr2zl\"" Jul 08 16:39:38.954292 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:38.954270 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 08 16:39:38.954434 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:38.954322 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 16:39:38.954434 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:38.954334 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 08 16:39:38.990628 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:38.990453 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4"] Jul 08 16:39:38.991581 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:38.991553 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f"] Jul 08 16:39:38.994260 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:38.994239 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.006680 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.006609 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 16:39:39.006680 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.006669 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 16:39:39.007349 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.007327 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 16:39:39.007512 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.007383 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wp9lm\"" Jul 08 16:39:39.025477 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.025379 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f"] Jul 08 16:39:39.028174 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.028143 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qlmkv"] Jul 08 16:39:39.031284 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.031259 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.034246 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.034221 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 16:39:39.034390 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.034246 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 16:39:39.034541 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.034503 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nkmpb\"" Jul 08 16:39:39.034660 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.034626 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 16:39:39.088569 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.088517 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1181c031-e377-406d-a11d-0fb905e6bf89-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.088824 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.088601 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzt7m\" (UniqueName: \"kubernetes.io/projected/1181c031-e377-406d-a11d-0fb905e6bf89-kube-api-access-xzt7m\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.088824 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.088683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-metrics-client-ca\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.088824 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.088735 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2xxb\" (UniqueName: \"kubernetes.io/projected/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-kube-api-access-c2xxb\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.088824 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.088768 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-root\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.088824 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.088811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3170188e-cf8d-4f1f-a68f-85f492f7f47f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-sjvv4\" (UID: \"3170188e-cf8d-4f1f-a68f-85f492f7f47f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:39.089083 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.088858 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-sys\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.089083 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.088882 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-wtmp\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.089083 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.088909 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.089083 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.088936 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1181c031-e377-406d-a11d-0fb905e6bf89-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.089083 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.088970 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm6d4\" (UniqueName: \"kubernetes.io/projected/3170188e-cf8d-4f1f-a68f-85f492f7f47f-kube-api-access-sm6d4\") pod \"openshift-state-metrics-54cf96dfcf-sjvv4\" (UID: \"3170188e-cf8d-4f1f-a68f-85f492f7f47f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:39.089083 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.089002 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3170188e-cf8d-4f1f-a68f-85f492f7f47f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-sjvv4\" (UID: \"3170188e-cf8d-4f1f-a68f-85f492f7f47f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:39.089083 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.089069 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3170188e-cf8d-4f1f-a68f-85f492f7f47f-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-sjvv4\" (UID: \"3170188e-cf8d-4f1f-a68f-85f492f7f47f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:39.089393 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.089148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-tls\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.089393 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.089195 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.089393 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.089240 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1181c031-e377-406d-a11d-0fb905e6bf89-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.089393 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.089323 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-textfile\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.089393 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.089354 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1181c031-e377-406d-a11d-0fb905e6bf89-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.089393 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.089383 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1181c031-e377-406d-a11d-0fb905e6bf89-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.190416 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.190375 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-tls\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.190416 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.190420 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.190708 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.190440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1181c031-e377-406d-a11d-0fb905e6bf89-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.190708 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.190473 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-textfile\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.190708 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.190503 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1181c031-e377-406d-a11d-0fb905e6bf89-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.190708 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.190553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1181c031-e377-406d-a11d-0fb905e6bf89-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.190708 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.190586 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1181c031-e377-406d-a11d-0fb905e6bf89-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.190958 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.190934 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-textfile\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.191009 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.190989 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1181c031-e377-406d-a11d-0fb905e6bf89-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.191009 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.190997 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzt7m\" (UniqueName: \"kubernetes.io/projected/1181c031-e377-406d-a11d-0fb905e6bf89-kube-api-access-xzt7m\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.191104 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191042 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-metrics-client-ca\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.191104 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191075 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2xxb\" (UniqueName: \"kubernetes.io/projected/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-kube-api-access-c2xxb\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.191195 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-root\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.191195 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3170188e-cf8d-4f1f-a68f-85f492f7f47f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-sjvv4\" (UID: \"3170188e-cf8d-4f1f-a68f-85f492f7f47f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:39.191195 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191163 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-sys\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.191195 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-wtmp\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.191385 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191219 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.191385 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191247 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1181c031-e377-406d-a11d-0fb905e6bf89-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.191385 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm6d4\" (UniqueName: \"kubernetes.io/projected/3170188e-cf8d-4f1f-a68f-85f492f7f47f-kube-api-access-sm6d4\") pod \"openshift-state-metrics-54cf96dfcf-sjvv4\" (UID: \"3170188e-cf8d-4f1f-a68f-85f492f7f47f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:39.191385 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191305 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3170188e-cf8d-4f1f-a68f-85f492f7f47f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-sjvv4\" (UID: \"3170188e-cf8d-4f1f-a68f-85f492f7f47f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:39.191385 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191310 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-sys\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.191385 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191357 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1181c031-e377-406d-a11d-0fb905e6bf89-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.191385 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191364 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3170188e-cf8d-4f1f-a68f-85f492f7f47f-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-sjvv4\" (UID: \"3170188e-cf8d-4f1f-a68f-85f492f7f47f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:39.191822 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191422 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-root\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.191822 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191575 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-wtmp\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.191822 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191722 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-metrics-client-ca\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.191973 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.191950 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-accelerators-collector-config\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.192725 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:39.192041 2567 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 08 16:39:39.192725 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:39.192103 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1181c031-e377-406d-a11d-0fb905e6bf89-kube-state-metrics-tls podName:1181c031-e377-406d-a11d-0fb905e6bf89 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:39.692085595 +0000 UTC m=+293.030010075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1181c031-e377-406d-a11d-0fb905e6bf89-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-z6c5f" (UID: "1181c031-e377-406d-a11d-0fb905e6bf89") : secret "kube-state-metrics-tls" not found Jul 08 16:39:39.192725 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.192563 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3170188e-cf8d-4f1f-a68f-85f492f7f47f-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-sjvv4\" (UID: \"3170188e-cf8d-4f1f-a68f-85f492f7f47f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:39.193579 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.193354 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-tls\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.193579 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.193515 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1181c031-e377-406d-a11d-0fb905e6bf89-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.193731 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.193687 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.194636 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.194613 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3170188e-cf8d-4f1f-a68f-85f492f7f47f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-sjvv4\" (UID: \"3170188e-cf8d-4f1f-a68f-85f492f7f47f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:39.194636 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.194624 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1181c031-e377-406d-a11d-0fb905e6bf89-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.194961 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.194940 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3170188e-cf8d-4f1f-a68f-85f492f7f47f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-sjvv4\" (UID: \"3170188e-cf8d-4f1f-a68f-85f492f7f47f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:39.201379 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.201281 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2xxb\" (UniqueName: \"kubernetes.io/projected/f0101b37-fb84-42ba-8fb0-9566eb9fe2e3-kube-api-access-c2xxb\") pod \"node-exporter-qlmkv\" (UID: \"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3\") " pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.201379 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.201341 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm6d4\" (UniqueName: \"kubernetes.io/projected/3170188e-cf8d-4f1f-a68f-85f492f7f47f-kube-api-access-sm6d4\") pod \"openshift-state-metrics-54cf96dfcf-sjvv4\" (UID: \"3170188e-cf8d-4f1f-a68f-85f492f7f47f\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:39.201379 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.201355 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzt7m\" (UniqueName: \"kubernetes.io/projected/1181c031-e377-406d-a11d-0fb905e6bf89-kube-api-access-xzt7m\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.261104 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.261065 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" Jul 08 16:39:39.343541 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.343504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qlmkv" Jul 08 16:39:39.695294 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.695254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1181c031-e377-406d-a11d-0fb905e6bf89-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.698268 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.698238 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1181c031-e377-406d-a11d-0fb905e6bf89-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-z6c5f\" (UID: \"1181c031-e377-406d-a11d-0fb905e6bf89\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:39.905982 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:39.905947 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" Jul 08 16:39:40.087572 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.087537 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 16:39:40.091152 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.091124 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.094343 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.094318 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 16:39:40.094909 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.094882 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 16:39:40.095042 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.094915 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 16:39:40.095042 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.094924 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 16:39:40.095210 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.095191 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 16:39:40.095632 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.095613 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 16:39:40.095791 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.095775 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xmcbp\"" Jul 08 16:39:40.095844 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.095803 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 16:39:40.095966 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.095951 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 16:39:40.096032 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.096001 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 16:39:40.115188 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.115156 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 16:39:40.199539 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.199486 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.199733 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.199585 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5d44502-d937-4d4c-96b2-665c6cb83ecf-config-out\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.199733 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.199615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-web-config\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.199733 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.199639 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.199733 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.199673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.199924 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.199729 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5d44502-d937-4d4c-96b2-665c6cb83ecf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.199924 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.199763 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5d44502-d937-4d4c-96b2-665c6cb83ecf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.199924 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.199795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m97n7\" (UniqueName: \"kubernetes.io/projected/e5d44502-d937-4d4c-96b2-665c6cb83ecf-kube-api-access-m97n7\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.199924 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.199820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.199924 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.199859 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5d44502-d937-4d4c-96b2-665c6cb83ecf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.199924 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.199901 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.200152 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.199926 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d44502-d937-4d4c-96b2-665c6cb83ecf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.200152 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.199962 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.249632 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:39:40.249588 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-t6fms" podUID="31bdf910-65ce-489b-ba71-64d9080e8443" Jul 08 16:39:40.300680 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.300641 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5d44502-d937-4d4c-96b2-665c6cb83ecf-config-out\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.300680 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.300683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-web-config\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.300958 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.300712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.300958 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.300748 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.300958 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.300773 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5d44502-d937-4d4c-96b2-665c6cb83ecf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.300958 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.300802 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5d44502-d937-4d4c-96b2-665c6cb83ecf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.300958 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.300846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m97n7\" (UniqueName: \"kubernetes.io/projected/e5d44502-d937-4d4c-96b2-665c6cb83ecf-kube-api-access-m97n7\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.300958 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.300868 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.300958 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.300896 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5d44502-d937-4d4c-96b2-665c6cb83ecf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.300958 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.300944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.301338 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.300967 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d44502-d937-4d4c-96b2-665c6cb83ecf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.301338 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.300997 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.301338 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.301035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.301867 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.301772 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5d44502-d937-4d4c-96b2-665c6cb83ecf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.301867 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.301820 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5d44502-d937-4d4c-96b2-665c6cb83ecf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.304955 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.304920 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d44502-d937-4d4c-96b2-665c6cb83ecf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.305231 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.305208 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-web-config\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.305388 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.305366 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5d44502-d937-4d4c-96b2-665c6cb83ecf-config-out\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.305450 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.305364 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5d44502-d937-4d4c-96b2-665c6cb83ecf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.306042 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.305868 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.306154 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.306125 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.307011 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.306963 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.308266 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.308152 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.309081 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.308983 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.309081 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.309045 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-config-volume\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.310681 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.310649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m97n7\" (UniqueName: \"kubernetes.io/projected/e5d44502-d937-4d4c-96b2-665c6cb83ecf-kube-api-access-m97n7\") pod \"alertmanager-main-0\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.403739 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.403656 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:39:40.971917 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.971883 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt"] Jul 08 16:39:40.984235 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.984206 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:40.986932 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.986903 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 08 16:39:40.987709 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.987260 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 08 16:39:40.987709 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.987496 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 08 16:39:40.987709 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.987543 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-etgmgridb7sei\"" Jul 08 16:39:40.987709 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.987696 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt"] Jul 08 16:39:40.987972 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.987825 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 08 16:39:40.987972 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.987857 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4rtbz\"" Jul 08 16:39:40.988067 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:40.987997 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 08 16:39:41.108677 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.108636 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-tls\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.109179 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.108724 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.109179 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.108753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.109179 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.108799 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.109179 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.108912 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-grpc-tls\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.109179 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.108987 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e82df89-9076-4262-b727-d657a2dcc8ca-metrics-client-ca\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.109179 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.109032 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.109179 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.109063 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97559\" (UniqueName: \"kubernetes.io/projected/8e82df89-9076-4262-b727-d657a2dcc8ca-kube-api-access-97559\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.209822 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.209780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.210059 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.209832 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.210059 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.209862 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.210059 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.209905 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-grpc-tls\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.210059 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.209969 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e82df89-9076-4262-b727-d657a2dcc8ca-metrics-client-ca\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.210253 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.210026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.210253 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.210117 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97559\" (UniqueName: \"kubernetes.io/projected/8e82df89-9076-4262-b727-d657a2dcc8ca-kube-api-access-97559\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.210253 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.210187 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-tls\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.210822 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.210793 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e82df89-9076-4262-b727-d657a2dcc8ca-metrics-client-ca\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.213234 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.213048 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.213234 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.213103 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.213234 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.213170 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.213635 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.213598 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.213738 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.213634 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-grpc-tls\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.213843 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.213751 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8e82df89-9076-4262-b727-d657a2dcc8ca-secret-thanos-querier-tls\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.219261 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.219233 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97559\" (UniqueName: \"kubernetes.io/projected/8e82df89-9076-4262-b727-d657a2dcc8ca-kube-api-access-97559\") pod \"thanos-querier-b6dc7f47b-jlhqt\" (UID: \"8e82df89-9076-4262-b727-d657a2dcc8ca\") " pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:41.297284 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:41.297201 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:42.086119 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:39:42.086083 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0101b37_fb84_42ba_8fb0_9566eb9fe2e3.slice/crio-e4a5dca33c3c352162bd0771b6392ac2971e3ed31835a2a0e6a596df861efdb4 WatchSource:0}: Error finding container e4a5dca33c3c352162bd0771b6392ac2971e3ed31835a2a0e6a596df861efdb4: Status 404 returned error can't find the container with id e4a5dca33c3c352162bd0771b6392ac2971e3ed31835a2a0e6a596df861efdb4 Jul 08 16:39:42.243200 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:42.240928 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qlmkv" event={"ID":"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3","Type":"ContainerStarted","Data":"e4a5dca33c3c352162bd0771b6392ac2971e3ed31835a2a0e6a596df861efdb4"} Jul 08 16:39:42.299220 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:42.299126 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4"] Jul 08 16:39:42.309829 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:39:42.309792 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3170188e_cf8d_4f1f_a68f_85f492f7f47f.slice/crio-c13b32bb4a28adb2acbd89a8ff9be164d486d2632f1809f1b1636afac7e6917d WatchSource:0}: Error finding container c13b32bb4a28adb2acbd89a8ff9be164d486d2632f1809f1b1636afac7e6917d: Status 404 returned error can't find the container with id c13b32bb4a28adb2acbd89a8ff9be164d486d2632f1809f1b1636afac7e6917d Jul 08 16:39:42.532709 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:42.532674 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f"] Jul 08 16:39:42.535421 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:39:42.535385 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1181c031_e377_406d_a11d_0fb905e6bf89.slice/crio-6979ea8f3a74fd11d27472f9035eb58a5771edf11b0cf253f348fa702c14c296 WatchSource:0}: Error finding container 6979ea8f3a74fd11d27472f9035eb58a5771edf11b0cf253f348fa702c14c296: Status 404 returned error can't find the container with id 6979ea8f3a74fd11d27472f9035eb58a5771edf11b0cf253f348fa702c14c296 Jul 08 16:39:42.537798 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:42.537686 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt"] Jul 08 16:39:42.541072 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:42.540875 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 16:39:42.541199 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:39:42.541163 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e82df89_9076_4262_b727_d657a2dcc8ca.slice/crio-2ed9b7055afbea00cd71f462fed78cb8fa4d065965b2b320b25c975c59e89bf7 WatchSource:0}: Error finding container 2ed9b7055afbea00cd71f462fed78cb8fa4d065965b2b320b25c975c59e89bf7: Status 404 returned error can't find the container with id 2ed9b7055afbea00cd71f462fed78cb8fa4d065965b2b320b25c975c59e89bf7 Jul 08 16:39:42.543914 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:39:42.543889 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d44502_d937_4d4c_96b2_665c6cb83ecf.slice/crio-ccc4415c396e725cf399ad11b7ea7991e763192cd9f9bb5a0fec30ea38dcd323 WatchSource:0}: Error finding container ccc4415c396e725cf399ad11b7ea7991e763192cd9f9bb5a0fec30ea38dcd323: Status 404 returned error can't find the container with id ccc4415c396e725cf399ad11b7ea7991e763192cd9f9bb5a0fec30ea38dcd323 Jul 08 16:39:43.254082 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.254036 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" event={"ID":"1181c031-e377-406d-a11d-0fb905e6bf89","Type":"ContainerStarted","Data":"6979ea8f3a74fd11d27472f9035eb58a5771edf11b0cf253f348fa702c14c296"} Jul 08 16:39:43.254515 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.254110 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" event={"ID":"3170188e-cf8d-4f1f-a68f-85f492f7f47f","Type":"ContainerStarted","Data":"76156c7119d1a0bfc56e3758adb240b044f2e002befc8e94e8e2a9e08e093e58"} Jul 08 16:39:43.254515 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.254143 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" event={"ID":"3170188e-cf8d-4f1f-a68f-85f492f7f47f","Type":"ContainerStarted","Data":"92b9c04adcdeb35fc74add41d7036ca18e07a9d9f3c113e7fb665b7731a77eb6"} Jul 08 16:39:43.254515 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.254169 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" event={"ID":"3170188e-cf8d-4f1f-a68f-85f492f7f47f","Type":"ContainerStarted","Data":"c13b32bb4a28adb2acbd89a8ff9be164d486d2632f1809f1b1636afac7e6917d"} Jul 08 16:39:43.254515 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.254199 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerStarted","Data":"ccc4415c396e725cf399ad11b7ea7991e763192cd9f9bb5a0fec30ea38dcd323"} Jul 08 16:39:43.254515 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.254308 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2l522" event={"ID":"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71","Type":"ContainerStarted","Data":"2662757db7e8df00b080e8c06422c958dc0c925d37295dcd4aec0c2ff6f42d5b"} Jul 08 16:39:43.254515 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.254335 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2l522" event={"ID":"9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71","Type":"ContainerStarted","Data":"2512b009288597224c6dac12e1847445edabf65103b505d6ec1d5aadee9668f2"} Jul 08 16:39:43.254862 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.254559 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2l522" Jul 08 16:39:43.256161 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.256131 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4cfd8779-lxsbp" event={"ID":"eccffc5f-9cf4-4822-b6cb-81a672e66aec","Type":"ContainerStarted","Data":"487b6e1f009dc990134f654cf6ccf1b51eb2cb3f82ac346c9602ae0b6e9314d1"} Jul 08 16:39:43.257589 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.257563 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" event={"ID":"8e82df89-9076-4262-b727-d657a2dcc8ca","Type":"ContainerStarted","Data":"2ed9b7055afbea00cd71f462fed78cb8fa4d065965b2b320b25c975c59e89bf7"} Jul 08 16:39:43.259164 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.259142 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-b9rh9" event={"ID":"0a3993bc-25ec-4852-8333-0ef3d216968d","Type":"ContainerStarted","Data":"d783e099181a66d0352ea54c9e4be2b8b6ea4acc10043b237e2ddf74db0f222f"} Jul 08 16:39:43.259394 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.259370 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-b9rh9" Jul 08 16:39:43.272337 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.272278 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2l522" podStartSLOduration=252.535052931 podStartE2EDuration="4m22.272257617s" totalImagesPullingTime="9.737204686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:43.271827536 +0000 UTC m=+296.609752022" watchObservedRunningTime="2026-07-08 16:39:43.272257617 +0000 UTC m=+296.610182107" Jul 08 16:39:43.273953 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.273929 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-b9rh9" Jul 08 16:39:43.291364 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.291302 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-b9rh9" podStartSLOduration=2.191560362 podStartE2EDuration="23.291281313s" totalImagesPullingTime="21.099720951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:43.289981069 +0000 UTC m=+296.627905558" watchObservedRunningTime="2026-07-08 16:39:43.291281313 +0000 UTC m=+296.629205830" Jul 08 16:39:43.307067 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.307000 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b4cfd8779-lxsbp" podStartSLOduration=1.8044903909999999 podStartE2EDuration="13.30698171s" totalImagesPullingTime="11.502491319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:43.306350505 +0000 UTC m=+296.644274991" watchObservedRunningTime="2026-07-08 16:39:43.30698171 +0000 UTC m=+296.644906204" Jul 08 16:39:43.430579 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:43.430518 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4cfd8779-lxsbp"] Jul 08 16:39:45.279328 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:45.278546 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" event={"ID":"3170188e-cf8d-4f1f-a68f-85f492f7f47f","Type":"ContainerStarted","Data":"68b67d1c436c6319a5206e512fed7c6e523fdbe3d6fab68185f2ec812eb0ff69"} Jul 08 16:39:45.343910 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:45.343823 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-sjvv4" podStartSLOduration=5.426662058 podStartE2EDuration="7.343790678s" totalImagesPullingTime="1.91712862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:45.343639063 +0000 UTC m=+298.681563665" watchObservedRunningTime="2026-07-08 16:39:45.343790678 +0000 UTC m=+298.681715167" Jul 08 16:39:47.631669 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:47.628975 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 16:39:48.294722 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:48.294681 2567 generic.go:356] "Generic (PLEG): container finished" podID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerID="b6a8f9ed45dc969dfc0058d97dafa0ff06c8e26807cb61bdc635eded44cb9cc4" exitCode=0 Jul 08 16:39:48.294872 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:48.294737 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerDied","Data":"b6a8f9ed45dc969dfc0058d97dafa0ff06c8e26807cb61bdc635eded44cb9cc4"} Jul 08 16:39:48.301452 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:48.300921 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" event={"ID":"8e82df89-9076-4262-b727-d657a2dcc8ca","Type":"ContainerStarted","Data":"66e412bb4421cb01c273027ab054c6c7dd995e0949e325539cf4ceb77b4648f9"} Jul 08 16:39:48.301452 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:48.301004 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" event={"ID":"8e82df89-9076-4262-b727-d657a2dcc8ca","Type":"ContainerStarted","Data":"0b73777f6361d95140260aed6bfa0f0ebabfbe728e0fbc179a99c0d48f2c54ec"} Jul 08 16:39:48.301452 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:48.301046 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" event={"ID":"8e82df89-9076-4262-b727-d657a2dcc8ca","Type":"ContainerStarted","Data":"b8cd9abe67bf441a914af9a7629b9a27bf7eeda6b2c86aea0dbbf4c1b044619d"} Jul 08 16:39:48.304873 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:48.304188 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" event={"ID":"1181c031-e377-406d-a11d-0fb905e6bf89","Type":"ContainerStarted","Data":"7144c1c559077707e99a3a36d7297cf7cb6e480ec2f210487d7393f229b7977f"} Jul 08 16:39:48.304873 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:48.304248 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" event={"ID":"1181c031-e377-406d-a11d-0fb905e6bf89","Type":"ContainerStarted","Data":"dac3f24d673f113259607fda8a3eaa9a73fdfdde8eb49e5ba005c738709a1231"} Jul 08 16:39:48.304873 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:48.304275 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" event={"ID":"1181c031-e377-406d-a11d-0fb905e6bf89","Type":"ContainerStarted","Data":"b45ac684e067fd0c60345dde4eeb5bc00125792baaf90bb026fc712333d02327"} Jul 08 16:39:48.306605 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:48.306432 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0101b37-fb84-42ba-8fb0-9566eb9fe2e3" containerID="a9dca0c57b155df238b3562bcb14ea7f9a2df34d74174f71cd0feb40e862ce9a" exitCode=0 Jul 08 16:39:48.306605 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:48.306519 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qlmkv" event={"ID":"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3","Type":"ContainerDied","Data":"a9dca0c57b155df238b3562bcb14ea7f9a2df34d74174f71cd0feb40e862ce9a"} Jul 08 16:39:48.365564 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:48.365401 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z6c5f" podStartSLOduration=5.330014099 podStartE2EDuration="10.36538426s" totalImagesPullingTime="5.035370161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:48.363747925 +0000 UTC m=+301.701672412" watchObservedRunningTime="2026-07-08 16:39:48.36538426 +0000 UTC m=+301.703308747" Jul 08 16:39:49.320815 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:49.320746 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qlmkv" event={"ID":"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3","Type":"ContainerStarted","Data":"a1cdf0d4044d5ab5fb53e3d03a9069640fd1234d7a5a68df52549c8abf37a82a"} Jul 08 16:39:49.321642 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:49.321610 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qlmkv" event={"ID":"f0101b37-fb84-42ba-8fb0-9566eb9fe2e3","Type":"ContainerStarted","Data":"b11ef0270957a79edfd50246f89c34a99b373c3613d596c60f5aa3e422824683"} Jul 08 16:39:49.345044 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:49.344987 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qlmkv" podStartSLOduration=5.750323921 podStartE2EDuration="11.344964703s" totalImagesPullingTime="5.476099465s" totalInitContainerRuntime="118.541317ms" isStatefulPod=true podCreationTimestamp="2026-07-08 16:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:49.341281529 +0000 UTC m=+302.679206017" watchObservedRunningTime="2026-07-08 16:39:49.344964703 +0000 UTC m=+302.682889193" Jul 08 16:39:50.335614 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.335574 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" event={"ID":"8e82df89-9076-4262-b727-d657a2dcc8ca","Type":"ContainerStarted","Data":"212355d872b416b556650bd6bea537ba1c5db95ff92ee2a0cf2e6de60b73bf57"} Jul 08 16:39:50.336063 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.335699 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" event={"ID":"8e82df89-9076-4262-b727-d657a2dcc8ca","Type":"ContainerStarted","Data":"1fe67ac0f82925c6713b5902c0ebfcf682771f5e319976a2249edb2059fc0438"} Jul 08 16:39:50.425726 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.425690 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:39:50.749721 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.749683 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56fc6668b6-pw7fs"] Jul 08 16:39:50.772967 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.772919 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56fc6668b6-pw7fs"] Jul 08 16:39:50.773138 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.773086 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:50.784162 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.784137 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 16:39:50.908928 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.908883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb041af-afb2-44fc-a0a3-227432182bef-console-oauth-config\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:50.909124 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.908968 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-console-config\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:50.909124 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.909083 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-oauth-serving-cert\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:50.909124 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.909121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-trusted-ca-bundle\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:50.909281 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.909152 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5jkd\" (UniqueName: \"kubernetes.io/projected/2cb041af-afb2-44fc-a0a3-227432182bef-kube-api-access-j5jkd\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:50.909281 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.909249 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb041af-afb2-44fc-a0a3-227432182bef-console-serving-cert\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:50.909379 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:50.909289 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-service-ca\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.010436 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.010353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-console-config\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.010436 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.010408 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-oauth-serving-cert\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.010686 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.010462 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-trusted-ca-bundle\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.010686 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.010492 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5jkd\" (UniqueName: \"kubernetes.io/projected/2cb041af-afb2-44fc-a0a3-227432182bef-kube-api-access-j5jkd\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.010686 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.010553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb041af-afb2-44fc-a0a3-227432182bef-console-serving-cert\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.010686 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.010580 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-service-ca\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.010686 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.010655 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb041af-afb2-44fc-a0a3-227432182bef-console-oauth-config\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.011581 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.011426 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-oauth-serving-cert\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.011581 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.011550 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-service-ca\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.011775 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.011587 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-console-config\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.011775 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.011616 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-trusted-ca-bundle\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.013447 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.013423 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb041af-afb2-44fc-a0a3-227432182bef-console-oauth-config\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.014014 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.013987 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb041af-afb2-44fc-a0a3-227432182bef-console-serving-cert\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.019374 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.019348 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5jkd\" (UniqueName: \"kubernetes.io/projected/2cb041af-afb2-44fc-a0a3-227432182bef-kube-api-access-j5jkd\") pod \"console-56fc6668b6-pw7fs\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.091405 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.091366 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:39:51.299437 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.299404 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56fc6668b6-pw7fs"] Jul 08 16:39:51.345198 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.345154 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" event={"ID":"8e82df89-9076-4262-b727-d657a2dcc8ca","Type":"ContainerStarted","Data":"532066678b31de1c6ea37411664fc7e9dbf46ba8a316e974c3c5e79c2e9d37f6"} Jul 08 16:39:51.345674 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.345360 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:39:51.380329 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:51.380274 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" podStartSLOduration=4.341916056 podStartE2EDuration="11.380254656s" totalImagesPullingTime="7.0383386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:39:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:51.378646641 +0000 UTC m=+304.716571128" watchObservedRunningTime="2026-07-08 16:39:51.380254656 +0000 UTC m=+304.718179177" Jul 08 16:39:51.607829 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:39:51.607752 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb041af_afb2_44fc_a0a3_227432182bef.slice/crio-78db6f6e429480aa5b5cc0a9c4394ea6c644b9a05f0743cc0998c26c79f4e24f WatchSource:0}: Error finding container 78db6f6e429480aa5b5cc0a9c4394ea6c644b9a05f0743cc0998c26c79f4e24f: Status 404 returned error can't find the container with id 78db6f6e429480aa5b5cc0a9c4394ea6c644b9a05f0743cc0998c26c79f4e24f Jul 08 16:39:52.247178 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:52.247147 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:39:52.352300 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:52.352263 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerStarted","Data":"a239fdf7c7d6aa08b9f9303b4bc43ca304a8fc99330514eb20410152bae0b0b0"} Jul 08 16:39:52.352716 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:52.352338 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerStarted","Data":"be6e579c646874b976014e19c69df8acbab0242ab8472d536a958af16ea363fc"} Jul 08 16:39:52.352716 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:52.352372 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerStarted","Data":"eaa2b518374657d2064e8872b99b46b9e5a24104f2769f623a57df79c7c8a878"} Jul 08 16:39:52.353925 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:52.353904 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56fc6668b6-pw7fs" event={"ID":"2cb041af-afb2-44fc-a0a3-227432182bef","Type":"ContainerStarted","Data":"64bfe8398f5fd380aa3de113b26f96a4cf3f1fa8406ef2a364168e06eb0310e9"} Jul 08 16:39:52.353998 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:52.353946 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56fc6668b6-pw7fs" event={"ID":"2cb041af-afb2-44fc-a0a3-227432182bef","Type":"ContainerStarted","Data":"78db6f6e429480aa5b5cc0a9c4394ea6c644b9a05f0743cc0998c26c79f4e24f"} Jul 08 16:39:52.373571 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:52.372418 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56fc6668b6-pw7fs" podStartSLOduration=2.372395775 podStartE2EDuration="2.372395775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:39:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:52.372285933 +0000 UTC m=+305.710210424" watchObservedRunningTime="2026-07-08 16:39:52.372395775 +0000 UTC m=+305.710320266" Jul 08 16:39:53.266379 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:53.266349 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2l522" Jul 08 16:39:53.362103 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:53.362066 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerStarted","Data":"ee2b7c2e2870b584bc3621e49e1b8813e977c6d96153a2cc922ac8e721d8ecba"} Jul 08 16:39:53.362617 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:53.362146 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerStarted","Data":"3ea27e6d3c9e8e8fe7b255ed1c3cace0eb414db75f5a73d33e55d1293d69828d"} Jul 08 16:39:53.362617 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:53.362191 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerStarted","Data":"4626e85912b7518c812b469a5e5cc3297f23cdd1e72b1443d0202d967e97c5fd"} Jul 08 16:39:53.389424 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:53.389362 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.659115566 podStartE2EDuration="13.38933857s" totalImagesPullingTime="8.709895509s" totalInitContainerRuntime="20.327495ms" isStatefulPod=false podCreationTimestamp="2026-07-08 16:39:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:53.38767838 +0000 UTC m=+306.725602868" watchObservedRunningTime="2026-07-08 16:39:53.38933857 +0000 UTC m=+306.727263060" Jul 08 16:39:57.361033 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:39:57.361004 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-b6dc7f47b-jlhqt" Jul 08 16:40:01.091568 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:01.091515 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:40:01.092046 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:01.091604 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:40:01.096447 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:01.096424 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:40:01.402163 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:01.402079 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:40:10.304415 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.304346 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b4cfd8779-lxsbp" podUID="eccffc5f-9cf4-4822-b6cb-81a672e66aec" containerName="console" containerID="cri-o://487b6e1f009dc990134f654cf6ccf1b51eb2cb3f82ac346c9602ae0b6e9314d1" gracePeriod=15 Jul 08 16:40:10.436275 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.436245 2567 generic.go:356] "Generic (PLEG): container finished" podID="eccffc5f-9cf4-4822-b6cb-81a672e66aec" containerID="487b6e1f009dc990134f654cf6ccf1b51eb2cb3f82ac346c9602ae0b6e9314d1" exitCode=0 Jul 08 16:40:10.436377 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.436275 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4cfd8779-lxsbp" event={"ID":"eccffc5f-9cf4-4822-b6cb-81a672e66aec","Type":"ContainerDied","Data":"487b6e1f009dc990134f654cf6ccf1b51eb2cb3f82ac346c9602ae0b6e9314d1"} Jul 08 16:40:10.589827 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.589791 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:40:10.690774 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.690740 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-config\") pod \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " Jul 08 16:40:10.690963 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.690803 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-oauth-config\") pod \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " Jul 08 16:40:10.690963 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.690830 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-service-ca\") pod \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " Jul 08 16:40:10.690963 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.690883 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-oauth-serving-cert\") pod \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " Jul 08 16:40:10.691128 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.690997 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-serving-cert\") pod \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " Jul 08 16:40:10.691128 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.691038 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt6tc\" (UniqueName: \"kubernetes.io/projected/eccffc5f-9cf4-4822-b6cb-81a672e66aec-kube-api-access-dt6tc\") pod \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\" (UID: \"eccffc5f-9cf4-4822-b6cb-81a672e66aec\") " Jul 08 16:40:10.691258 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.691234 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-config" (OuterVolumeSpecName: "console-config") pod "eccffc5f-9cf4-4822-b6cb-81a672e66aec" (UID: "eccffc5f-9cf4-4822-b6cb-81a672e66aec"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:40:10.691316 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.691263 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eccffc5f-9cf4-4822-b6cb-81a672e66aec" (UID: "eccffc5f-9cf4-4822-b6cb-81a672e66aec"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:40:10.691316 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.691284 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-service-ca" (OuterVolumeSpecName: "service-ca") pod "eccffc5f-9cf4-4822-b6cb-81a672e66aec" (UID: "eccffc5f-9cf4-4822-b6cb-81a672e66aec"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:40:10.691419 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.691363 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:40:10.691419 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.691382 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-service-ca\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:40:10.691419 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.691395 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eccffc5f-9cf4-4822-b6cb-81a672e66aec-oauth-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:40:10.693323 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.693297 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eccffc5f-9cf4-4822-b6cb-81a672e66aec-kube-api-access-dt6tc" (OuterVolumeSpecName: "kube-api-access-dt6tc") pod "eccffc5f-9cf4-4822-b6cb-81a672e66aec" (UID: "eccffc5f-9cf4-4822-b6cb-81a672e66aec"). InnerVolumeSpecName "kube-api-access-dt6tc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:40:10.693411 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.693296 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eccffc5f-9cf4-4822-b6cb-81a672e66aec" (UID: "eccffc5f-9cf4-4822-b6cb-81a672e66aec"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:40:10.693411 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.693354 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eccffc5f-9cf4-4822-b6cb-81a672e66aec" (UID: "eccffc5f-9cf4-4822-b6cb-81a672e66aec"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:40:10.792044 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.792011 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-oauth-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:40:10.792044 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.792038 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eccffc5f-9cf4-4822-b6cb-81a672e66aec-console-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:40:10.792044 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:10.792048 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt6tc\" (UniqueName: \"kubernetes.io/projected/eccffc5f-9cf4-4822-b6cb-81a672e66aec-kube-api-access-dt6tc\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:40:11.442068 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:11.442029 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4cfd8779-lxsbp" Jul 08 16:40:11.442484 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:11.442043 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4cfd8779-lxsbp" event={"ID":"eccffc5f-9cf4-4822-b6cb-81a672e66aec","Type":"ContainerDied","Data":"010a8d3c6b010dfe18dd481edcb9d4b90cdd58c3836bbf0c3642e4df60efaeb3"} Jul 08 16:40:11.442484 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:11.442184 2567 scope.go:117] "RemoveContainer" containerID="487b6e1f009dc990134f654cf6ccf1b51eb2cb3f82ac346c9602ae0b6e9314d1" Jul 08 16:40:11.458449 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:11.458426 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4cfd8779-lxsbp"] Jul 08 16:40:11.462156 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:11.462133 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b4cfd8779-lxsbp"] Jul 08 16:40:12.448566 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:12.448518 2567 generic.go:356] "Generic (PLEG): container finished" podID="2d08e0bf-52f8-4bc1-ab80-6238488faf00" containerID="46da5861a7df4499e0484816c5bcc1512f38fa8c937ca4324ac8f8715fef70b3" exitCode=0 Jul 08 16:40:12.448967 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:12.448589 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" event={"ID":"2d08e0bf-52f8-4bc1-ab80-6238488faf00","Type":"ContainerDied","Data":"46da5861a7df4499e0484816c5bcc1512f38fa8c937ca4324ac8f8715fef70b3"} Jul 08 16:40:12.448967 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:12.448924 2567 scope.go:117] "RemoveContainer" containerID="46da5861a7df4499e0484816c5bcc1512f38fa8c937ca4324ac8f8715fef70b3" Jul 08 16:40:13.253317 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:13.253286 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eccffc5f-9cf4-4822-b6cb-81a672e66aec" path="/var/lib/kubelet/pods/eccffc5f-9cf4-4822-b6cb-81a672e66aec/volumes" Jul 08 16:40:13.454803 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:13.454768 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-6fzl2" event={"ID":"2d08e0bf-52f8-4bc1-ab80-6238488faf00","Type":"ContainerStarted","Data":"6bddf3131fb31c9994ae4c5c0ed997b4c47374b06fd539593cdd989329d9a4e4"} Jul 08 16:40:28.520971 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:28.520929 2567 generic.go:356] "Generic (PLEG): container finished" podID="4e55c310-80cc-43db-8a8e-bbc970dd7fbf" containerID="0f5625dafcd8fb8c1fc810502b895b3153fda84addbc0ba8aec560fba302fd01" exitCode=0 Jul 08 16:40:28.521823 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:28.521593 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" event={"ID":"4e55c310-80cc-43db-8a8e-bbc970dd7fbf","Type":"ContainerDied","Data":"0f5625dafcd8fb8c1fc810502b895b3153fda84addbc0ba8aec560fba302fd01"} Jul 08 16:40:28.522439 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:28.522423 2567 scope.go:117] "RemoveContainer" containerID="0f5625dafcd8fb8c1fc810502b895b3153fda84addbc0ba8aec560fba302fd01" Jul 08 16:40:29.531116 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:29.531082 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8pxcn" event={"ID":"4e55c310-80cc-43db-8a8e-bbc970dd7fbf","Type":"ContainerStarted","Data":"e2611ca10913eafd3b9aec1bf32a744fd4a24ff482fb57f631bfa9e68d3940c7"} Jul 08 16:40:59.319321 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.319285 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 16:40:59.319874 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.319588 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="kube-rbac-proxy-metric" containerID="cri-o://3ea27e6d3c9e8e8fe7b255ed1c3cace0eb414db75f5a73d33e55d1293d69828d" gracePeriod=120 Jul 08 16:40:59.319874 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.319622 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="kube-rbac-proxy-web" containerID="cri-o://a239fdf7c7d6aa08b9f9303b4bc43ca304a8fc99330514eb20410152bae0b0b0" gracePeriod=120 Jul 08 16:40:59.319874 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.319643 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="prom-label-proxy" containerID="cri-o://ee2b7c2e2870b584bc3621e49e1b8813e977c6d96153a2cc922ac8e721d8ecba" gracePeriod=120 Jul 08 16:40:59.319874 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.319659 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="kube-rbac-proxy" containerID="cri-o://4626e85912b7518c812b469a5e5cc3297f23cdd1e72b1443d0202d967e97c5fd" gracePeriod=120 Jul 08 16:40:59.319874 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.319574 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="alertmanager" containerID="cri-o://eaa2b518374657d2064e8872b99b46b9e5a24104f2769f623a57df79c7c8a878" gracePeriod=120 Jul 08 16:40:59.319874 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.319677 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="config-reloader" containerID="cri-o://be6e579c646874b976014e19c69df8acbab0242ab8472d536a958af16ea363fc" gracePeriod=120 Jul 08 16:40:59.654161 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.654081 2567 generic.go:356] "Generic (PLEG): container finished" podID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerID="ee2b7c2e2870b584bc3621e49e1b8813e977c6d96153a2cc922ac8e721d8ecba" exitCode=0 Jul 08 16:40:59.654161 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.654107 2567 generic.go:356] "Generic (PLEG): container finished" podID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerID="3ea27e6d3c9e8e8fe7b255ed1c3cace0eb414db75f5a73d33e55d1293d69828d" exitCode=0 Jul 08 16:40:59.654161 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.654113 2567 generic.go:356] "Generic (PLEG): container finished" podID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerID="4626e85912b7518c812b469a5e5cc3297f23cdd1e72b1443d0202d967e97c5fd" exitCode=0 Jul 08 16:40:59.654161 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.654119 2567 generic.go:356] "Generic (PLEG): container finished" podID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerID="be6e579c646874b976014e19c69df8acbab0242ab8472d536a958af16ea363fc" exitCode=0 Jul 08 16:40:59.654161 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.654124 2567 generic.go:356] "Generic (PLEG): container finished" podID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerID="eaa2b518374657d2064e8872b99b46b9e5a24104f2769f623a57df79c7c8a878" exitCode=0 Jul 08 16:40:59.654161 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.654152 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerDied","Data":"ee2b7c2e2870b584bc3621e49e1b8813e977c6d96153a2cc922ac8e721d8ecba"} Jul 08 16:40:59.654442 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.654215 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerDied","Data":"3ea27e6d3c9e8e8fe7b255ed1c3cace0eb414db75f5a73d33e55d1293d69828d"} Jul 08 16:40:59.654442 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.654244 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerDied","Data":"4626e85912b7518c812b469a5e5cc3297f23cdd1e72b1443d0202d967e97c5fd"} Jul 08 16:40:59.654442 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.654272 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerDied","Data":"be6e579c646874b976014e19c69df8acbab0242ab8472d536a958af16ea363fc"} Jul 08 16:40:59.654442 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:40:59.654295 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerDied","Data":"eaa2b518374657d2064e8872b99b46b9e5a24104f2769f623a57df79c7c8a878"} Jul 08 16:41:00.568643 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.568618 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.622019 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.621979 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy\") pod \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " Jul 08 16:41:00.622232 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622041 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m97n7\" (UniqueName: \"kubernetes.io/projected/e5d44502-d937-4d4c-96b2-665c6cb83ecf-kube-api-access-m97n7\") pod \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " Jul 08 16:41:00.622232 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622080 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5d44502-d937-4d4c-96b2-665c6cb83ecf-alertmanager-main-db\") pod \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " Jul 08 16:41:00.622232 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622119 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-web-config\") pod \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " Jul 08 16:41:00.622232 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622174 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5d44502-d937-4d4c-96b2-665c6cb83ecf-config-out\") pod \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " Jul 08 16:41:00.622232 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622202 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy-web\") pod \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " Jul 08 16:41:00.622232 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622226 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-cluster-tls-config\") pod \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " Jul 08 16:41:00.622545 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622262 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d44502-d937-4d4c-96b2-665c6cb83ecf-alertmanager-trusted-ca-bundle\") pod \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " Jul 08 16:41:00.622545 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622325 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " Jul 08 16:41:00.622545 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622349 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-main-tls\") pod \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " Jul 08 16:41:00.622545 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622374 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5d44502-d937-4d4c-96b2-665c6cb83ecf-tls-assets\") pod \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " Jul 08 16:41:00.622545 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622415 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5d44502-d937-4d4c-96b2-665c6cb83ecf-metrics-client-ca\") pod \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " Jul 08 16:41:00.622545 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622441 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-config-volume\") pod \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\" (UID: \"e5d44502-d937-4d4c-96b2-665c6cb83ecf\") " Jul 08 16:41:00.622545 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622463 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5d44502-d937-4d4c-96b2-665c6cb83ecf-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e5d44502-d937-4d4c-96b2-665c6cb83ecf" (UID: "e5d44502-d937-4d4c-96b2-665c6cb83ecf"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:41:00.622865 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622798 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e5d44502-d937-4d4c-96b2-665c6cb83ecf-alertmanager-main-db\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:00.622865 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.622842 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5d44502-d937-4d4c-96b2-665c6cb83ecf-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e5d44502-d937-4d4c-96b2-665c6cb83ecf" (UID: "e5d44502-d937-4d4c-96b2-665c6cb83ecf"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:41:00.624571 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.624472 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5d44502-d937-4d4c-96b2-665c6cb83ecf-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e5d44502-d937-4d4c-96b2-665c6cb83ecf" (UID: "e5d44502-d937-4d4c-96b2-665c6cb83ecf"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:41:00.625357 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.625325 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e5d44502-d937-4d4c-96b2-665c6cb83ecf" (UID: "e5d44502-d937-4d4c-96b2-665c6cb83ecf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:41:00.625813 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.625774 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5d44502-d937-4d4c-96b2-665c6cb83ecf-kube-api-access-m97n7" (OuterVolumeSpecName: "kube-api-access-m97n7") pod "e5d44502-d937-4d4c-96b2-665c6cb83ecf" (UID: "e5d44502-d937-4d4c-96b2-665c6cb83ecf"). InnerVolumeSpecName "kube-api-access-m97n7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:41:00.626007 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.625975 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e5d44502-d937-4d4c-96b2-665c6cb83ecf" (UID: "e5d44502-d937-4d4c-96b2-665c6cb83ecf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:41:00.626143 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.626074 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-config-volume" (OuterVolumeSpecName: "config-volume") pod "e5d44502-d937-4d4c-96b2-665c6cb83ecf" (UID: "e5d44502-d937-4d4c-96b2-665c6cb83ecf"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:41:00.626855 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.626829 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5d44502-d937-4d4c-96b2-665c6cb83ecf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e5d44502-d937-4d4c-96b2-665c6cb83ecf" (UID: "e5d44502-d937-4d4c-96b2-665c6cb83ecf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:41:00.626956 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.626938 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5d44502-d937-4d4c-96b2-665c6cb83ecf-config-out" (OuterVolumeSpecName: "config-out") pod "e5d44502-d937-4d4c-96b2-665c6cb83ecf" (UID: "e5d44502-d937-4d4c-96b2-665c6cb83ecf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:41:00.628055 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.628026 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e5d44502-d937-4d4c-96b2-665c6cb83ecf" (UID: "e5d44502-d937-4d4c-96b2-665c6cb83ecf"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:41:00.628418 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.628383 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e5d44502-d937-4d4c-96b2-665c6cb83ecf" (UID: "e5d44502-d937-4d4c-96b2-665c6cb83ecf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:41:00.632071 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.632043 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e5d44502-d937-4d4c-96b2-665c6cb83ecf" (UID: "e5d44502-d937-4d4c-96b2-665c6cb83ecf"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:41:00.639676 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.639634 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-web-config" (OuterVolumeSpecName: "web-config") pod "e5d44502-d937-4d4c-96b2-665c6cb83ecf" (UID: "e5d44502-d937-4d4c-96b2-665c6cb83ecf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:41:00.661603 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.661498 2567 generic.go:356] "Generic (PLEG): container finished" podID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerID="a239fdf7c7d6aa08b9f9303b4bc43ca304a8fc99330514eb20410152bae0b0b0" exitCode=0 Jul 08 16:41:00.661603 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.661573 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerDied","Data":"a239fdf7c7d6aa08b9f9303b4bc43ca304a8fc99330514eb20410152bae0b0b0"} Jul 08 16:41:00.661831 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.661616 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.661831 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.661697 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e5d44502-d937-4d4c-96b2-665c6cb83ecf","Type":"ContainerDied","Data":"ccc4415c396e725cf399ad11b7ea7991e763192cd9f9bb5a0fec30ea38dcd323"} Jul 08 16:41:00.661831 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.661746 2567 scope.go:117] "RemoveContainer" containerID="ee2b7c2e2870b584bc3621e49e1b8813e977c6d96153a2cc922ac8e721d8ecba" Jul 08 16:41:00.670013 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.669958 2567 scope.go:117] "RemoveContainer" containerID="3ea27e6d3c9e8e8fe7b255ed1c3cace0eb414db75f5a73d33e55d1293d69828d" Jul 08 16:41:00.677708 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.677688 2567 scope.go:117] "RemoveContainer" containerID="4626e85912b7518c812b469a5e5cc3297f23cdd1e72b1443d0202d967e97c5fd" Jul 08 16:41:00.685711 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.685655 2567 scope.go:117] "RemoveContainer" containerID="a239fdf7c7d6aa08b9f9303b4bc43ca304a8fc99330514eb20410152bae0b0b0" Jul 08 16:41:00.687114 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.687093 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 16:41:00.692935 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.692907 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 16:41:00.693903 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.693880 2567 scope.go:117] "RemoveContainer" containerID="be6e579c646874b976014e19c69df8acbab0242ab8472d536a958af16ea363fc" Jul 08 16:41:00.701700 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.701679 2567 scope.go:117] "RemoveContainer" containerID="eaa2b518374657d2064e8872b99b46b9e5a24104f2769f623a57df79c7c8a878" Jul 08 16:41:00.709576 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.709557 2567 scope.go:117] "RemoveContainer" containerID="b6a8f9ed45dc969dfc0058d97dafa0ff06c8e26807cb61bdc635eded44cb9cc4" Jul 08 16:41:00.717613 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.717587 2567 scope.go:117] "RemoveContainer" containerID="ee2b7c2e2870b584bc3621e49e1b8813e977c6d96153a2cc922ac8e721d8ecba" Jul 08 16:41:00.717917 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:41:00.717894 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee2b7c2e2870b584bc3621e49e1b8813e977c6d96153a2cc922ac8e721d8ecba\": container with ID starting with ee2b7c2e2870b584bc3621e49e1b8813e977c6d96153a2cc922ac8e721d8ecba not found: ID does not exist" containerID="ee2b7c2e2870b584bc3621e49e1b8813e977c6d96153a2cc922ac8e721d8ecba" Jul 08 16:41:00.718009 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.717925 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee2b7c2e2870b584bc3621e49e1b8813e977c6d96153a2cc922ac8e721d8ecba"} err="failed to get container status \"ee2b7c2e2870b584bc3621e49e1b8813e977c6d96153a2cc922ac8e721d8ecba\": rpc error: code = NotFound desc = could not find container \"ee2b7c2e2870b584bc3621e49e1b8813e977c6d96153a2cc922ac8e721d8ecba\": container with ID starting with ee2b7c2e2870b584bc3621e49e1b8813e977c6d96153a2cc922ac8e721d8ecba not found: ID does not exist" Jul 08 16:41:00.718009 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.717959 2567 scope.go:117] "RemoveContainer" containerID="3ea27e6d3c9e8e8fe7b255ed1c3cace0eb414db75f5a73d33e55d1293d69828d" Jul 08 16:41:00.718199 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:41:00.718182 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ea27e6d3c9e8e8fe7b255ed1c3cace0eb414db75f5a73d33e55d1293d69828d\": container with ID starting with 3ea27e6d3c9e8e8fe7b255ed1c3cace0eb414db75f5a73d33e55d1293d69828d not found: ID does not exist" containerID="3ea27e6d3c9e8e8fe7b255ed1c3cace0eb414db75f5a73d33e55d1293d69828d" Jul 08 16:41:00.718261 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.718210 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ea27e6d3c9e8e8fe7b255ed1c3cace0eb414db75f5a73d33e55d1293d69828d"} err="failed to get container status \"3ea27e6d3c9e8e8fe7b255ed1c3cace0eb414db75f5a73d33e55d1293d69828d\": rpc error: code = NotFound desc = could not find container \"3ea27e6d3c9e8e8fe7b255ed1c3cace0eb414db75f5a73d33e55d1293d69828d\": container with ID starting with 3ea27e6d3c9e8e8fe7b255ed1c3cace0eb414db75f5a73d33e55d1293d69828d not found: ID does not exist" Jul 08 16:41:00.718261 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.718233 2567 scope.go:117] "RemoveContainer" containerID="4626e85912b7518c812b469a5e5cc3297f23cdd1e72b1443d0202d967e97c5fd" Jul 08 16:41:00.718482 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:41:00.718460 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4626e85912b7518c812b469a5e5cc3297f23cdd1e72b1443d0202d967e97c5fd\": container with ID starting with 4626e85912b7518c812b469a5e5cc3297f23cdd1e72b1443d0202d967e97c5fd not found: ID does not exist" containerID="4626e85912b7518c812b469a5e5cc3297f23cdd1e72b1443d0202d967e97c5fd" Jul 08 16:41:00.718523 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.718490 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4626e85912b7518c812b469a5e5cc3297f23cdd1e72b1443d0202d967e97c5fd"} err="failed to get container status \"4626e85912b7518c812b469a5e5cc3297f23cdd1e72b1443d0202d967e97c5fd\": rpc error: code = NotFound desc = could not find container \"4626e85912b7518c812b469a5e5cc3297f23cdd1e72b1443d0202d967e97c5fd\": container with ID starting with 4626e85912b7518c812b469a5e5cc3297f23cdd1e72b1443d0202d967e97c5fd not found: ID does not exist" Jul 08 16:41:00.718523 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.718504 2567 scope.go:117] "RemoveContainer" containerID="a239fdf7c7d6aa08b9f9303b4bc43ca304a8fc99330514eb20410152bae0b0b0" Jul 08 16:41:00.718730 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:41:00.718714 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a239fdf7c7d6aa08b9f9303b4bc43ca304a8fc99330514eb20410152bae0b0b0\": container with ID starting with a239fdf7c7d6aa08b9f9303b4bc43ca304a8fc99330514eb20410152bae0b0b0 not found: ID does not exist" containerID="a239fdf7c7d6aa08b9f9303b4bc43ca304a8fc99330514eb20410152bae0b0b0" Jul 08 16:41:00.718781 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.718732 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a239fdf7c7d6aa08b9f9303b4bc43ca304a8fc99330514eb20410152bae0b0b0"} err="failed to get container status \"a239fdf7c7d6aa08b9f9303b4bc43ca304a8fc99330514eb20410152bae0b0b0\": rpc error: code = NotFound desc = could not find container \"a239fdf7c7d6aa08b9f9303b4bc43ca304a8fc99330514eb20410152bae0b0b0\": container with ID starting with a239fdf7c7d6aa08b9f9303b4bc43ca304a8fc99330514eb20410152bae0b0b0 not found: ID does not exist" Jul 08 16:41:00.718781 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.718745 2567 scope.go:117] "RemoveContainer" containerID="be6e579c646874b976014e19c69df8acbab0242ab8472d536a958af16ea363fc" Jul 08 16:41:00.718920 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:41:00.718907 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be6e579c646874b976014e19c69df8acbab0242ab8472d536a958af16ea363fc\": container with ID starting with be6e579c646874b976014e19c69df8acbab0242ab8472d536a958af16ea363fc not found: ID does not exist" containerID="be6e579c646874b976014e19c69df8acbab0242ab8472d536a958af16ea363fc" Jul 08 16:41:00.718958 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.718923 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be6e579c646874b976014e19c69df8acbab0242ab8472d536a958af16ea363fc"} err="failed to get container status \"be6e579c646874b976014e19c69df8acbab0242ab8472d536a958af16ea363fc\": rpc error: code = NotFound desc = could not find container \"be6e579c646874b976014e19c69df8acbab0242ab8472d536a958af16ea363fc\": container with ID starting with be6e579c646874b976014e19c69df8acbab0242ab8472d536a958af16ea363fc not found: ID does not exist" Jul 08 16:41:00.718958 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.718935 2567 scope.go:117] "RemoveContainer" containerID="eaa2b518374657d2064e8872b99b46b9e5a24104f2769f623a57df79c7c8a878" Jul 08 16:41:00.719156 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:41:00.719139 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaa2b518374657d2064e8872b99b46b9e5a24104f2769f623a57df79c7c8a878\": container with ID starting with eaa2b518374657d2064e8872b99b46b9e5a24104f2769f623a57df79c7c8a878 not found: ID does not exist" containerID="eaa2b518374657d2064e8872b99b46b9e5a24104f2769f623a57df79c7c8a878" Jul 08 16:41:00.719204 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.719160 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaa2b518374657d2064e8872b99b46b9e5a24104f2769f623a57df79c7c8a878"} err="failed to get container status \"eaa2b518374657d2064e8872b99b46b9e5a24104f2769f623a57df79c7c8a878\": rpc error: code = NotFound desc = could not find container \"eaa2b518374657d2064e8872b99b46b9e5a24104f2769f623a57df79c7c8a878\": container with ID starting with eaa2b518374657d2064e8872b99b46b9e5a24104f2769f623a57df79c7c8a878 not found: ID does not exist" Jul 08 16:41:00.719204 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.719177 2567 scope.go:117] "RemoveContainer" containerID="b6a8f9ed45dc969dfc0058d97dafa0ff06c8e26807cb61bdc635eded44cb9cc4" Jul 08 16:41:00.719341 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:41:00.719327 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6a8f9ed45dc969dfc0058d97dafa0ff06c8e26807cb61bdc635eded44cb9cc4\": container with ID starting with b6a8f9ed45dc969dfc0058d97dafa0ff06c8e26807cb61bdc635eded44cb9cc4 not found: ID does not exist" containerID="b6a8f9ed45dc969dfc0058d97dafa0ff06c8e26807cb61bdc635eded44cb9cc4" Jul 08 16:41:00.719402 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.719343 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6a8f9ed45dc969dfc0058d97dafa0ff06c8e26807cb61bdc635eded44cb9cc4"} err="failed to get container status \"b6a8f9ed45dc969dfc0058d97dafa0ff06c8e26807cb61bdc635eded44cb9cc4\": rpc error: code = NotFound desc = could not find container \"b6a8f9ed45dc969dfc0058d97dafa0ff06c8e26807cb61bdc635eded44cb9cc4\": container with ID starting with b6a8f9ed45dc969dfc0058d97dafa0ff06c8e26807cb61bdc635eded44cb9cc4 not found: ID does not exist" Jul 08 16:41:00.723960 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.723938 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:00.723960 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.723960 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m97n7\" (UniqueName: \"kubernetes.io/projected/e5d44502-d937-4d4c-96b2-665c6cb83ecf-kube-api-access-m97n7\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:00.724125 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.723972 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-web-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:00.724125 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.723981 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e5d44502-d937-4d4c-96b2-665c6cb83ecf-config-out\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:00.724125 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.723990 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:00.724125 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.724003 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-cluster-tls-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:00.724125 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.724016 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5d44502-d937-4d4c-96b2-665c6cb83ecf-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:00.724125 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.724029 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:00.724125 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.724042 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-secret-alertmanager-main-tls\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:00.724125 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.724056 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e5d44502-d937-4d4c-96b2-665c6cb83ecf-tls-assets\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:00.724125 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.724069 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5d44502-d937-4d4c-96b2-665c6cb83ecf-metrics-client-ca\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:00.724125 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.724081 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e5d44502-d937-4d4c-96b2-665c6cb83ecf-config-volume\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:00.726154 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726133 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 16:41:00.726478 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726463 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="init-config-reloader" Jul 08 16:41:00.726565 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726482 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="init-config-reloader" Jul 08 16:41:00.726565 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726504 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="alertmanager" Jul 08 16:41:00.726565 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726513 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="alertmanager" Jul 08 16:41:00.726565 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726546 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="kube-rbac-proxy-web" Jul 08 16:41:00.726565 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726555 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="kube-rbac-proxy-web" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726573 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eccffc5f-9cf4-4822-b6cb-81a672e66aec" containerName="console" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726580 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eccffc5f-9cf4-4822-b6cb-81a672e66aec" containerName="console" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726593 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="prom-label-proxy" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726601 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="prom-label-proxy" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726613 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="config-reloader" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726621 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="config-reloader" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726632 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="kube-rbac-proxy-metric" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726640 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="kube-rbac-proxy-metric" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726653 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="kube-rbac-proxy" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726662 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="kube-rbac-proxy" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726739 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="kube-rbac-proxy" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726751 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eccffc5f-9cf4-4822-b6cb-81a672e66aec" containerName="console" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726760 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="prom-label-proxy" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726770 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="kube-rbac-proxy-web" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726778 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="config-reloader" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726788 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="kube-rbac-proxy-metric" Jul 08 16:41:00.726799 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.726797 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" containerName="alertmanager" Jul 08 16:41:00.730224 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.730204 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.733108 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.733087 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 16:41:00.733209 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.733155 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xmcbp\"" Jul 08 16:41:00.733796 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.733776 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 16:41:00.733888 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.733817 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 16:41:00.734325 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.734307 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 16:41:00.734427 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.734308 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 16:41:00.734576 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.734560 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 16:41:00.734640 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.734626 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 16:41:00.735031 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.735011 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 16:41:00.740189 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.740165 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 16:41:00.745143 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.745111 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 16:41:00.825044 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.825006 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.825044 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.825041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae571e70-0a43-4ec6-a181-b71aa96214b4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.825258 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.825064 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8d5k\" (UniqueName: \"kubernetes.io/projected/ae571e70-0a43-4ec6-a181-b71aa96214b4-kube-api-access-l8d5k\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.825258 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.825146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.825258 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.825176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.825258 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.825216 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae571e70-0a43-4ec6-a181-b71aa96214b4-config-out\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.825258 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.825236 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae571e70-0a43-4ec6-a181-b71aa96214b4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.825411 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.825263 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae571e70-0a43-4ec6-a181-b71aa96214b4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.825411 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.825286 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-web-config\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.825411 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.825309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae571e70-0a43-4ec6-a181-b71aa96214b4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.825411 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.825332 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.825411 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.825367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.825411 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.825398 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.926716 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.926629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.926716 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.926664 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.926716 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.926682 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae571e70-0a43-4ec6-a181-b71aa96214b4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.926716 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.926709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8d5k\" (UniqueName: \"kubernetes.io/projected/ae571e70-0a43-4ec6-a181-b71aa96214b4-kube-api-access-l8d5k\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.927012 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.926745 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.927012 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.926777 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.927012 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.926808 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae571e70-0a43-4ec6-a181-b71aa96214b4-config-out\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.927012 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.926838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae571e70-0a43-4ec6-a181-b71aa96214b4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.927012 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.926869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae571e70-0a43-4ec6-a181-b71aa96214b4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.927012 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.926896 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-web-config\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.927012 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.926932 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae571e70-0a43-4ec6-a181-b71aa96214b4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.927012 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.926958 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.927012 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.926988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.927416 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.927132 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae571e70-0a43-4ec6-a181-b71aa96214b4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.928035 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.928008 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae571e70-0a43-4ec6-a181-b71aa96214b4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.928158 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.928047 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae571e70-0a43-4ec6-a181-b71aa96214b4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.929787 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.929759 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae571e70-0a43-4ec6-a181-b71aa96214b4-config-out\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.929877 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.929832 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae571e70-0a43-4ec6-a181-b71aa96214b4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.930168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.930148 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.930212 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.930186 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.930252 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.930190 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.930483 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.930459 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.930657 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.930637 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.930813 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.930798 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.931284 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.931268 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae571e70-0a43-4ec6-a181-b71aa96214b4-web-config\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:00.936670 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:00.936648 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8d5k\" (UniqueName: \"kubernetes.io/projected/ae571e70-0a43-4ec6-a181-b71aa96214b4-kube-api-access-l8d5k\") pod \"alertmanager-main-0\" (UID: \"ae571e70-0a43-4ec6-a181-b71aa96214b4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:01.027356 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:01.027324 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:41:01.029546 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:01.029516 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31bdf910-65ce-489b-ba71-64d9080e8443-metrics-certs\") pod \"network-metrics-daemon-t6fms\" (UID: \"31bdf910-65ce-489b-ba71-64d9080e8443\") " pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:41:01.041612 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:01.041576 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:41:01.184124 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:01.184099 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 16:41:01.186660 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:41:01.186633 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae571e70_0a43_4ec6_a181_b71aa96214b4.slice/crio-4af554f91cd13a1d04b14aa5dac55026b0f301d252d455dd00d353c015be11d1 WatchSource:0}: Error finding container 4af554f91cd13a1d04b14aa5dac55026b0f301d252d455dd00d353c015be11d1: Status 404 returned error can't find the container with id 4af554f91cd13a1d04b14aa5dac55026b0f301d252d455dd00d353c015be11d1 Jul 08 16:41:01.250103 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:01.250068 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mshfs\"" Jul 08 16:41:01.253238 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:01.253201 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5d44502-d937-4d4c-96b2-665c6cb83ecf" path="/var/lib/kubelet/pods/e5d44502-d937-4d4c-96b2-665c6cb83ecf/volumes" Jul 08 16:41:01.258099 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:01.258079 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6fms" Jul 08 16:41:01.392715 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:01.392682 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t6fms"] Jul 08 16:41:01.395802 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:41:01.395775 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31bdf910_65ce_489b_ba71_64d9080e8443.slice/crio-a950f8621dbdeaab957e1ad20abe034407e7844a853fdfaea1e5953cf7e525cb WatchSource:0}: Error finding container a950f8621dbdeaab957e1ad20abe034407e7844a853fdfaea1e5953cf7e525cb: Status 404 returned error can't find the container with id a950f8621dbdeaab957e1ad20abe034407e7844a853fdfaea1e5953cf7e525cb Jul 08 16:41:01.397865 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:01.397846 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:41:01.667034 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:01.666999 2567 generic.go:356] "Generic (PLEG): container finished" podID="ae571e70-0a43-4ec6-a181-b71aa96214b4" containerID="0900f3c78c33fc3954bf903c878baf831d36010f696aac0329f312dbd3e31fa4" exitCode=0 Jul 08 16:41:01.667493 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:01.667086 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae571e70-0a43-4ec6-a181-b71aa96214b4","Type":"ContainerDied","Data":"0900f3c78c33fc3954bf903c878baf831d36010f696aac0329f312dbd3e31fa4"} Jul 08 16:41:01.667493 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:01.667185 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae571e70-0a43-4ec6-a181-b71aa96214b4","Type":"ContainerStarted","Data":"4af554f91cd13a1d04b14aa5dac55026b0f301d252d455dd00d353c015be11d1"} Jul 08 16:41:01.669220 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:01.669189 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t6fms" event={"ID":"31bdf910-65ce-489b-ba71-64d9080e8443","Type":"ContainerStarted","Data":"a950f8621dbdeaab957e1ad20abe034407e7844a853fdfaea1e5953cf7e525cb"} Jul 08 16:41:02.675409 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:02.675308 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t6fms" event={"ID":"31bdf910-65ce-489b-ba71-64d9080e8443","Type":"ContainerStarted","Data":"aaa4bf0066d780ec484dd86496a067a04d375445a2dc20de84d039a33cc509f2"} Jul 08 16:41:02.675409 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:02.675404 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t6fms" event={"ID":"31bdf910-65ce-489b-ba71-64d9080e8443","Type":"ContainerStarted","Data":"da1fafc703e0348711b07cfa39669498dafb69865eb0ab30c798a55eaa8e154f"} Jul 08 16:41:02.678354 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:02.678325 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae571e70-0a43-4ec6-a181-b71aa96214b4","Type":"ContainerStarted","Data":"a18bac1de98b1c92954f99fb2ed92251d71bdf64a0513b6eae02848725f75291"} Jul 08 16:41:02.678465 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:02.678386 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae571e70-0a43-4ec6-a181-b71aa96214b4","Type":"ContainerStarted","Data":"22d8dc652ee02fdedee73cf1aa4d238c2531a942e048fc56b8ddec8a7bc5eced"} Jul 08 16:41:02.678465 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:02.678412 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae571e70-0a43-4ec6-a181-b71aa96214b4","Type":"ContainerStarted","Data":"e3a8ddf45458326915837ff7e9e38fb2c6658303477781b05e8bcb2c2ae34315"} Jul 08 16:41:02.678465 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:02.678439 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae571e70-0a43-4ec6-a181-b71aa96214b4","Type":"ContainerStarted","Data":"8a8b25f2aa6fb8b17251556b968191510d54219960b902d0efd880b86cbdc536"} Jul 08 16:41:02.678465 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:02.678461 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae571e70-0a43-4ec6-a181-b71aa96214b4","Type":"ContainerStarted","Data":"6f9a5de515ad948b9061eee20c7fe42ad8be954a8c11eb56d6df1dbee9568f07"} Jul 08 16:41:02.678625 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:02.678488 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae571e70-0a43-4ec6-a181-b71aa96214b4","Type":"ContainerStarted","Data":"4f64ca62bad241f3c036ae89f69ce52471576e49a0cf32373017457604112731"} Jul 08 16:41:02.696133 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:02.696083 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t6fms" podStartSLOduration=374.742798539 podStartE2EDuration="6m15.696062514s" totalImagesPullingTime="953.263975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:02.695310038 +0000 UTC m=+376.033234524" watchObservedRunningTime="2026-07-08 16:41:02.696062514 +0000 UTC m=+376.033987001" Jul 08 16:41:02.723539 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:02.723471 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.700605985 podStartE2EDuration="2.723453146s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.847161ms" isStatefulPod=false podCreationTimestamp="2026-07-08 16:41:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:02.721749665 +0000 UTC m=+376.059674166" watchObservedRunningTime="2026-07-08 16:41:02.723453146 +0000 UTC m=+376.061377631" Jul 08 16:41:03.391509 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.391474 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f9ff948c-m7pfq"] Jul 08 16:41:03.394278 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.394262 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.397651 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.397620 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 08 16:41:03.397803 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.397672 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lkcdb\"" Jul 08 16:41:03.397803 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.397698 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 08 16:41:03.397803 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.397626 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 08 16:41:03.397803 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.397708 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 08 16:41:03.397803 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.397788 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 08 16:41:03.403499 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.403479 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 08 16:41:03.411201 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.411178 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f9ff948c-m7pfq"] Jul 08 16:41:03.447686 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.447657 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/73cfb596-f137-44e2-b46b-9d436b5f919f-telemeter-client-tls\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.447686 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.447689 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/73cfb596-f137-44e2-b46b-9d436b5f919f-federate-client-tls\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.447944 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.447707 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73cfb596-f137-44e2-b46b-9d436b5f919f-metrics-client-ca\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.447944 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.447723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/73cfb596-f137-44e2-b46b-9d436b5f919f-secret-telemeter-client\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.447944 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.447790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73cfb596-f137-44e2-b46b-9d436b5f919f-serving-certs-ca-bundle\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.447944 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.447806 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73cfb596-f137-44e2-b46b-9d436b5f919f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.447944 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.447835 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73cfb596-f137-44e2-b46b-9d436b5f919f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.447944 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.447853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tb9r\" (UniqueName: \"kubernetes.io/projected/73cfb596-f137-44e2-b46b-9d436b5f919f-kube-api-access-5tb9r\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.548346 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.548297 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tb9r\" (UniqueName: \"kubernetes.io/projected/73cfb596-f137-44e2-b46b-9d436b5f919f-kube-api-access-5tb9r\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.548506 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.548376 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/73cfb596-f137-44e2-b46b-9d436b5f919f-telemeter-client-tls\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.548506 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.548396 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/73cfb596-f137-44e2-b46b-9d436b5f919f-federate-client-tls\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.548506 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.548414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73cfb596-f137-44e2-b46b-9d436b5f919f-metrics-client-ca\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.548506 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.548434 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/73cfb596-f137-44e2-b46b-9d436b5f919f-secret-telemeter-client\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.548506 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.548476 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73cfb596-f137-44e2-b46b-9d436b5f919f-serving-certs-ca-bundle\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.548506 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.548492 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73cfb596-f137-44e2-b46b-9d436b5f919f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.548861 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.548522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73cfb596-f137-44e2-b46b-9d436b5f919f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.549374 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.549345 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73cfb596-f137-44e2-b46b-9d436b5f919f-metrics-client-ca\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.549605 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.549581 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73cfb596-f137-44e2-b46b-9d436b5f919f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.549769 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.549745 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73cfb596-f137-44e2-b46b-9d436b5f919f-serving-certs-ca-bundle\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.551182 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.551151 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73cfb596-f137-44e2-b46b-9d436b5f919f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.551298 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.551220 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/73cfb596-f137-44e2-b46b-9d436b5f919f-federate-client-tls\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.551298 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.551211 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/73cfb596-f137-44e2-b46b-9d436b5f919f-secret-telemeter-client\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.551376 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.551297 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/73cfb596-f137-44e2-b46b-9d436b5f919f-telemeter-client-tls\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.557130 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.557108 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tb9r\" (UniqueName: \"kubernetes.io/projected/73cfb596-f137-44e2-b46b-9d436b5f919f-kube-api-access-5tb9r\") pod \"telemeter-client-7f9ff948c-m7pfq\" (UID: \"73cfb596-f137-44e2-b46b-9d436b5f919f\") " pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.704992 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.704903 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" Jul 08 16:41:03.843740 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:03.843712 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f9ff948c-m7pfq"] Jul 08 16:41:03.845656 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:41:03.845627 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73cfb596_f137_44e2_b46b_9d436b5f919f.slice/crio-82091defae622620faad38b2c1576ef9e170180646013485f7959e1fc48b3a49 WatchSource:0}: Error finding container 82091defae622620faad38b2c1576ef9e170180646013485f7959e1fc48b3a49: Status 404 returned error can't find the container with id 82091defae622620faad38b2c1576ef9e170180646013485f7959e1fc48b3a49 Jul 08 16:41:04.689155 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:04.689112 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" event={"ID":"73cfb596-f137-44e2-b46b-9d436b5f919f","Type":"ContainerStarted","Data":"82091defae622620faad38b2c1576ef9e170180646013485f7959e1fc48b3a49"} Jul 08 16:41:06.700406 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:06.700367 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" event={"ID":"73cfb596-f137-44e2-b46b-9d436b5f919f","Type":"ContainerStarted","Data":"3772c79b433699506d70ce965545bc4f759b1c493d4772ac370d860d5b8a672f"} Jul 08 16:41:06.700856 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:06.700432 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" event={"ID":"73cfb596-f137-44e2-b46b-9d436b5f919f","Type":"ContainerStarted","Data":"943857864b8090a28494fcbf048f1c84819353028969a4c285320012f6ad8739"} Jul 08 16:41:06.700856 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:06.700462 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" event={"ID":"73cfb596-f137-44e2-b46b-9d436b5f919f","Type":"ContainerStarted","Data":"845a284e1c04eb3bb41e0d8c238c91e064813d0e570022aabfa8065470fb0752"} Jul 08 16:41:06.724183 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:06.724136 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f9ff948c-m7pfq" podStartSLOduration=1.511344125 podStartE2EDuration="3.724121325s" totalImagesPullingTime="2.2127772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:06.723770626 +0000 UTC m=+380.061695115" watchObservedRunningTime="2026-07-08 16:41:06.724121325 +0000 UTC m=+380.062045811" Jul 08 16:41:07.568887 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.568851 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75f6dc68f-vm4n5"] Jul 08 16:41:07.571195 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.571175 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.591762 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.591727 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75f6dc68f-vm4n5"] Jul 08 16:41:07.687335 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.687300 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc5e9a96-c827-424b-9965-02bf24d05326-console-serving-cert\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.687335 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.687348 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-service-ca\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.687567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.687368 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg9t2\" (UniqueName: \"kubernetes.io/projected/cc5e9a96-c827-424b-9965-02bf24d05326-kube-api-access-lg9t2\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.687567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.687441 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-trusted-ca-bundle\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.687567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.687477 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-console-config\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.687567 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.687514 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc5e9a96-c827-424b-9965-02bf24d05326-console-oauth-config\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.687745 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.687589 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-oauth-serving-cert\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.788700 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.788667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc5e9a96-c827-424b-9965-02bf24d05326-console-serving-cert\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.788700 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.788712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-service-ca\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.789247 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.788733 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg9t2\" (UniqueName: \"kubernetes.io/projected/cc5e9a96-c827-424b-9965-02bf24d05326-kube-api-access-lg9t2\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.789247 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.788783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-trusted-ca-bundle\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.789247 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.788933 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-console-config\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.789247 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.788995 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc5e9a96-c827-424b-9965-02bf24d05326-console-oauth-config\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.789247 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.789035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-oauth-serving-cert\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.789598 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.789568 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-service-ca\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.789941 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.789903 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-trusted-ca-bundle\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.790287 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.790267 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-console-config\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.790364 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.790321 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-oauth-serving-cert\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.791501 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.791482 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc5e9a96-c827-424b-9965-02bf24d05326-console-oauth-config\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.791621 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.791605 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc5e9a96-c827-424b-9965-02bf24d05326-console-serving-cert\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.801550 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.800243 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg9t2\" (UniqueName: \"kubernetes.io/projected/cc5e9a96-c827-424b-9965-02bf24d05326-kube-api-access-lg9t2\") pod \"console-75f6dc68f-vm4n5\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:07.881428 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:07.881328 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:08.015307 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:08.015279 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75f6dc68f-vm4n5"] Jul 08 16:41:08.017120 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:41:08.017090 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5e9a96_c827_424b_9965_02bf24d05326.slice/crio-ca908527d9f24c08284d0412b0793feb3a5b0ea022e15ec04362876cece9a0d3 WatchSource:0}: Error finding container ca908527d9f24c08284d0412b0793feb3a5b0ea022e15ec04362876cece9a0d3: Status 404 returned error can't find the container with id ca908527d9f24c08284d0412b0793feb3a5b0ea022e15ec04362876cece9a0d3 Jul 08 16:41:08.710665 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:08.710631 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f6dc68f-vm4n5" event={"ID":"cc5e9a96-c827-424b-9965-02bf24d05326","Type":"ContainerStarted","Data":"8be9b45d0f191ccf15181d8a0587865fc579f0b60057109fed677fefc1309d0e"} Jul 08 16:41:08.710848 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:08.710681 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f6dc68f-vm4n5" event={"ID":"cc5e9a96-c827-424b-9965-02bf24d05326","Type":"ContainerStarted","Data":"ca908527d9f24c08284d0412b0793feb3a5b0ea022e15ec04362876cece9a0d3"} Jul 08 16:41:08.730783 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:08.730733 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75f6dc68f-vm4n5" podStartSLOduration=1.730716052 podStartE2EDuration="1.730716052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:41:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:08.729418449 +0000 UTC m=+382.067342941" watchObservedRunningTime="2026-07-08 16:41:08.730716052 +0000 UTC m=+382.068640539" Jul 08 16:41:17.882429 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:17.882379 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:17.882911 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:17.882454 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:17.887437 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:17.887411 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:18.757162 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:18.757130 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:41:18.809670 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:18.809636 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56fc6668b6-pw7fs"] Jul 08 16:41:43.833223 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:43.833173 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56fc6668b6-pw7fs" podUID="2cb041af-afb2-44fc-a0a3-227432182bef" containerName="console" containerID="cri-o://64bfe8398f5fd380aa3de113b26f96a4cf3f1fa8406ef2a364168e06eb0310e9" gracePeriod=15 Jul 08 16:41:44.091248 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.091189 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:41:44.204001 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.203966 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-service-ca\") pod \"2cb041af-afb2-44fc-a0a3-227432182bef\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " Jul 08 16:41:44.204001 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.204007 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb041af-afb2-44fc-a0a3-227432182bef-console-oauth-config\") pod \"2cb041af-afb2-44fc-a0a3-227432182bef\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " Jul 08 16:41:44.204230 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.204041 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-oauth-serving-cert\") pod \"2cb041af-afb2-44fc-a0a3-227432182bef\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " Jul 08 16:41:44.204283 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.204226 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5jkd\" (UniqueName: \"kubernetes.io/projected/2cb041af-afb2-44fc-a0a3-227432182bef-kube-api-access-j5jkd\") pod \"2cb041af-afb2-44fc-a0a3-227432182bef\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " Jul 08 16:41:44.204335 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.204299 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb041af-afb2-44fc-a0a3-227432182bef-console-serving-cert\") pod \"2cb041af-afb2-44fc-a0a3-227432182bef\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " Jul 08 16:41:44.204382 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.204345 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-console-config\") pod \"2cb041af-afb2-44fc-a0a3-227432182bef\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " Jul 08 16:41:44.204471 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.204445 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2cb041af-afb2-44fc-a0a3-227432182bef" (UID: "2cb041af-afb2-44fc-a0a3-227432182bef"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:41:44.204737 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.204460 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-service-ca" (OuterVolumeSpecName: "service-ca") pod "2cb041af-afb2-44fc-a0a3-227432182bef" (UID: "2cb041af-afb2-44fc-a0a3-227432182bef"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:41:44.204737 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.204463 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-trusted-ca-bundle\") pod \"2cb041af-afb2-44fc-a0a3-227432182bef\" (UID: \"2cb041af-afb2-44fc-a0a3-227432182bef\") " Jul 08 16:41:44.204737 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.204703 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-console-config" (OuterVolumeSpecName: "console-config") pod "2cb041af-afb2-44fc-a0a3-227432182bef" (UID: "2cb041af-afb2-44fc-a0a3-227432182bef"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:41:44.204908 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.204787 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2cb041af-afb2-44fc-a0a3-227432182bef" (UID: "2cb041af-afb2-44fc-a0a3-227432182bef"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:41:44.204991 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.204977 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-service-ca\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:44.205031 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.204996 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-oauth-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:44.205031 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.205007 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-console-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:44.205031 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.205016 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb041af-afb2-44fc-a0a3-227432182bef-trusted-ca-bundle\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:44.206355 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.206335 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cb041af-afb2-44fc-a0a3-227432182bef-kube-api-access-j5jkd" (OuterVolumeSpecName: "kube-api-access-j5jkd") pod "2cb041af-afb2-44fc-a0a3-227432182bef" (UID: "2cb041af-afb2-44fc-a0a3-227432182bef"). InnerVolumeSpecName "kube-api-access-j5jkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:41:44.206671 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.206656 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cb041af-afb2-44fc-a0a3-227432182bef-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2cb041af-afb2-44fc-a0a3-227432182bef" (UID: "2cb041af-afb2-44fc-a0a3-227432182bef"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:41:44.206737 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.206677 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cb041af-afb2-44fc-a0a3-227432182bef-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2cb041af-afb2-44fc-a0a3-227432182bef" (UID: "2cb041af-afb2-44fc-a0a3-227432182bef"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:41:44.306168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.306132 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb041af-afb2-44fc-a0a3-227432182bef-console-oauth-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:44.306168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.306158 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5jkd\" (UniqueName: \"kubernetes.io/projected/2cb041af-afb2-44fc-a0a3-227432182bef-kube-api-access-j5jkd\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:44.306168 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.306168 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb041af-afb2-44fc-a0a3-227432182bef-console-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:41:44.864920 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.864886 2567 generic.go:356] "Generic (PLEG): container finished" podID="2cb041af-afb2-44fc-a0a3-227432182bef" containerID="64bfe8398f5fd380aa3de113b26f96a4cf3f1fa8406ef2a364168e06eb0310e9" exitCode=0 Jul 08 16:41:44.865307 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.864932 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56fc6668b6-pw7fs" Jul 08 16:41:44.865307 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.864971 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56fc6668b6-pw7fs" event={"ID":"2cb041af-afb2-44fc-a0a3-227432182bef","Type":"ContainerDied","Data":"64bfe8398f5fd380aa3de113b26f96a4cf3f1fa8406ef2a364168e06eb0310e9"} Jul 08 16:41:44.865307 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.865020 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56fc6668b6-pw7fs" event={"ID":"2cb041af-afb2-44fc-a0a3-227432182bef","Type":"ContainerDied","Data":"78db6f6e429480aa5b5cc0a9c4394ea6c644b9a05f0743cc0998c26c79f4e24f"} Jul 08 16:41:44.865307 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.865042 2567 scope.go:117] "RemoveContainer" containerID="64bfe8398f5fd380aa3de113b26f96a4cf3f1fa8406ef2a364168e06eb0310e9" Jul 08 16:41:44.874494 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.874473 2567 scope.go:117] "RemoveContainer" containerID="64bfe8398f5fd380aa3de113b26f96a4cf3f1fa8406ef2a364168e06eb0310e9" Jul 08 16:41:44.874792 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:41:44.874776 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64bfe8398f5fd380aa3de113b26f96a4cf3f1fa8406ef2a364168e06eb0310e9\": container with ID starting with 64bfe8398f5fd380aa3de113b26f96a4cf3f1fa8406ef2a364168e06eb0310e9 not found: ID does not exist" containerID="64bfe8398f5fd380aa3de113b26f96a4cf3f1fa8406ef2a364168e06eb0310e9" Jul 08 16:41:44.874838 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.874801 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bfe8398f5fd380aa3de113b26f96a4cf3f1fa8406ef2a364168e06eb0310e9"} err="failed to get container status \"64bfe8398f5fd380aa3de113b26f96a4cf3f1fa8406ef2a364168e06eb0310e9\": rpc error: code = NotFound desc = could not find container \"64bfe8398f5fd380aa3de113b26f96a4cf3f1fa8406ef2a364168e06eb0310e9\": container with ID starting with 64bfe8398f5fd380aa3de113b26f96a4cf3f1fa8406ef2a364168e06eb0310e9 not found: ID does not exist" Jul 08 16:41:44.888685 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.888656 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56fc6668b6-pw7fs"] Jul 08 16:41:44.894270 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:44.894243 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56fc6668b6-pw7fs"] Jul 08 16:41:45.252472 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:41:45.252434 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cb041af-afb2-44fc-a0a3-227432182bef" path="/var/lib/kubelet/pods/2cb041af-afb2-44fc-a0a3-227432182bef/volumes" Jul 08 16:42:16.884418 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:16.884377 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bdfc6c996-cdhbq"] Jul 08 16:42:16.885933 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:16.885903 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb041af-afb2-44fc-a0a3-227432182bef" containerName="console" Jul 08 16:42:16.886110 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:16.886099 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb041af-afb2-44fc-a0a3-227432182bef" containerName="console" Jul 08 16:42:16.886383 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:16.886371 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cb041af-afb2-44fc-a0a3-227432182bef" containerName="console" Jul 08 16:42:16.890315 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:16.890293 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:16.901331 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:16.901306 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bdfc6c996-cdhbq"] Jul 08 16:42:16.971489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:16.971448 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-oauth-config\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:16.971489 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:16.971485 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-config\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:16.971735 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:16.971507 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-service-ca\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:16.971735 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:16.971604 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-trusted-ca-bundle\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:16.971735 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:16.971635 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ldk6\" (UniqueName: \"kubernetes.io/projected/a1be16b9-5285-4e59-bf1b-9742a1bb0081-kube-api-access-6ldk6\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:16.971735 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:16.971688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-serving-cert\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:16.971859 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:16.971755 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-oauth-serving-cert\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.073083 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.073025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-oauth-config\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.073083 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.073079 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-config\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.073352 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.073204 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-service-ca\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.073352 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.073275 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-trusted-ca-bundle\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.073472 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.073372 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ldk6\" (UniqueName: \"kubernetes.io/projected/a1be16b9-5285-4e59-bf1b-9742a1bb0081-kube-api-access-6ldk6\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.073472 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.073411 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-serving-cert\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.073627 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.073503 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-oauth-serving-cert\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.073866 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.073842 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-config\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.073962 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.073921 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-service-ca\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.074097 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.074067 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-trusted-ca-bundle\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.074328 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.074307 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-oauth-serving-cert\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.075763 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.075740 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-oauth-config\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.075860 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.075810 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-serving-cert\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.082427 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.082403 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ldk6\" (UniqueName: \"kubernetes.io/projected/a1be16b9-5285-4e59-bf1b-9742a1bb0081-kube-api-access-6ldk6\") pod \"console-7bdfc6c996-cdhbq\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.201457 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.201368 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:17.343189 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:17.343157 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bdfc6c996-cdhbq"] Jul 08 16:42:17.346505 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:42:17.346467 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1be16b9_5285_4e59_bf1b_9742a1bb0081.slice/crio-1e5b20d961e533363142f8ef5a7650e371cb030ce1dfb43b6ce35f331f299bd0 WatchSource:0}: Error finding container 1e5b20d961e533363142f8ef5a7650e371cb030ce1dfb43b6ce35f331f299bd0: Status 404 returned error can't find the container with id 1e5b20d961e533363142f8ef5a7650e371cb030ce1dfb43b6ce35f331f299bd0 Jul 08 16:42:18.005823 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:18.005789 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdfc6c996-cdhbq" event={"ID":"a1be16b9-5285-4e59-bf1b-9742a1bb0081","Type":"ContainerStarted","Data":"7e660992b67e3db9bbeded60574f62088fe84c53aa6c5ce0065199888067d64d"} Jul 08 16:42:18.006233 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:18.005838 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdfc6c996-cdhbq" event={"ID":"a1be16b9-5285-4e59-bf1b-9742a1bb0081","Type":"ContainerStarted","Data":"1e5b20d961e533363142f8ef5a7650e371cb030ce1dfb43b6ce35f331f299bd0"} Jul 08 16:42:18.024684 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:18.024633 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bdfc6c996-cdhbq" podStartSLOduration=2.024613237 podStartE2EDuration="2.024613237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:42:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:42:18.023373293 +0000 UTC m=+451.361297780" watchObservedRunningTime="2026-07-08 16:42:18.024613237 +0000 UTC m=+451.362537724" Jul 08 16:42:27.201609 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:27.201557 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:27.202099 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:27.201655 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:27.206476 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:27.206456 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:28.051000 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:28.050968 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:42:28.098187 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:28.098155 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75f6dc68f-vm4n5"] Jul 08 16:42:53.121790 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.121735 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75f6dc68f-vm4n5" podUID="cc5e9a96-c827-424b-9965-02bf24d05326" containerName="console" containerID="cri-o://8be9b45d0f191ccf15181d8a0587865fc579f0b60057109fed677fefc1309d0e" gracePeriod=15 Jul 08 16:42:53.367935 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.367910 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:42:53.394722 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.394636 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-trusted-ca-bundle\") pod \"cc5e9a96-c827-424b-9965-02bf24d05326\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " Jul 08 16:42:53.394722 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.394668 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-console-config\") pod \"cc5e9a96-c827-424b-9965-02bf24d05326\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " Jul 08 16:42:53.394722 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.394694 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg9t2\" (UniqueName: \"kubernetes.io/projected/cc5e9a96-c827-424b-9965-02bf24d05326-kube-api-access-lg9t2\") pod \"cc5e9a96-c827-424b-9965-02bf24d05326\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " Jul 08 16:42:53.394722 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.394719 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc5e9a96-c827-424b-9965-02bf24d05326-console-serving-cert\") pod \"cc5e9a96-c827-424b-9965-02bf24d05326\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " Jul 08 16:42:53.395037 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.394806 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc5e9a96-c827-424b-9965-02bf24d05326-console-oauth-config\") pod \"cc5e9a96-c827-424b-9965-02bf24d05326\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " Jul 08 16:42:53.395120 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.395093 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cc5e9a96-c827-424b-9965-02bf24d05326" (UID: "cc5e9a96-c827-424b-9965-02bf24d05326"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:42:53.395222 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.395200 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-console-config" (OuterVolumeSpecName: "console-config") pod "cc5e9a96-c827-424b-9965-02bf24d05326" (UID: "cc5e9a96-c827-424b-9965-02bf24d05326"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:42:53.397002 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.396969 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc5e9a96-c827-424b-9965-02bf24d05326-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc5e9a96-c827-424b-9965-02bf24d05326" (UID: "cc5e9a96-c827-424b-9965-02bf24d05326"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:42:53.397002 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.396996 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc5e9a96-c827-424b-9965-02bf24d05326-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc5e9a96-c827-424b-9965-02bf24d05326" (UID: "cc5e9a96-c827-424b-9965-02bf24d05326"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:42:53.397143 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.397040 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc5e9a96-c827-424b-9965-02bf24d05326-kube-api-access-lg9t2" (OuterVolumeSpecName: "kube-api-access-lg9t2") pod "cc5e9a96-c827-424b-9965-02bf24d05326" (UID: "cc5e9a96-c827-424b-9965-02bf24d05326"). InnerVolumeSpecName "kube-api-access-lg9t2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:42:53.495276 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.495240 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-oauth-serving-cert\") pod \"cc5e9a96-c827-424b-9965-02bf24d05326\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " Jul 08 16:42:53.495276 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.495284 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-service-ca\") pod \"cc5e9a96-c827-424b-9965-02bf24d05326\" (UID: \"cc5e9a96-c827-424b-9965-02bf24d05326\") " Jul 08 16:42:53.495586 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.495571 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc5e9a96-c827-424b-9965-02bf24d05326-console-oauth-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:42:53.495658 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.495590 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-trusted-ca-bundle\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:42:53.495658 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.495602 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-console-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:42:53.495658 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.495601 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc5e9a96-c827-424b-9965-02bf24d05326" (UID: "cc5e9a96-c827-424b-9965-02bf24d05326"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:42:53.495658 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.495615 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg9t2\" (UniqueName: \"kubernetes.io/projected/cc5e9a96-c827-424b-9965-02bf24d05326-kube-api-access-lg9t2\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:42:53.495658 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.495628 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc5e9a96-c827-424b-9965-02bf24d05326-console-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:42:53.495806 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.495664 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc5e9a96-c827-424b-9965-02bf24d05326" (UID: "cc5e9a96-c827-424b-9965-02bf24d05326"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:42:53.596824 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.596788 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-oauth-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:42:53.596824 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:53.596816 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5e9a96-c827-424b-9965-02bf24d05326-service-ca\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:42:54.157592 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:54.157555 2567 generic.go:356] "Generic (PLEG): container finished" podID="cc5e9a96-c827-424b-9965-02bf24d05326" containerID="8be9b45d0f191ccf15181d8a0587865fc579f0b60057109fed677fefc1309d0e" exitCode=0 Jul 08 16:42:54.157592 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:54.157589 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f6dc68f-vm4n5" Jul 08 16:42:54.158041 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:54.157627 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f6dc68f-vm4n5" event={"ID":"cc5e9a96-c827-424b-9965-02bf24d05326","Type":"ContainerDied","Data":"8be9b45d0f191ccf15181d8a0587865fc579f0b60057109fed677fefc1309d0e"} Jul 08 16:42:54.158041 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:54.157679 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f6dc68f-vm4n5" event={"ID":"cc5e9a96-c827-424b-9965-02bf24d05326","Type":"ContainerDied","Data":"ca908527d9f24c08284d0412b0793feb3a5b0ea022e15ec04362876cece9a0d3"} Jul 08 16:42:54.158041 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:54.157699 2567 scope.go:117] "RemoveContainer" containerID="8be9b45d0f191ccf15181d8a0587865fc579f0b60057109fed677fefc1309d0e" Jul 08 16:42:54.166557 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:54.166508 2567 scope.go:117] "RemoveContainer" containerID="8be9b45d0f191ccf15181d8a0587865fc579f0b60057109fed677fefc1309d0e" Jul 08 16:42:54.166812 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:42:54.166796 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8be9b45d0f191ccf15181d8a0587865fc579f0b60057109fed677fefc1309d0e\": container with ID starting with 8be9b45d0f191ccf15181d8a0587865fc579f0b60057109fed677fefc1309d0e not found: ID does not exist" containerID="8be9b45d0f191ccf15181d8a0587865fc579f0b60057109fed677fefc1309d0e" Jul 08 16:42:54.166859 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:54.166823 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8be9b45d0f191ccf15181d8a0587865fc579f0b60057109fed677fefc1309d0e"} err="failed to get container status \"8be9b45d0f191ccf15181d8a0587865fc579f0b60057109fed677fefc1309d0e\": rpc error: code = NotFound desc = could not find container \"8be9b45d0f191ccf15181d8a0587865fc579f0b60057109fed677fefc1309d0e\": container with ID starting with 8be9b45d0f191ccf15181d8a0587865fc579f0b60057109fed677fefc1309d0e not found: ID does not exist" Jul 08 16:42:54.178986 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:54.178965 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75f6dc68f-vm4n5"] Jul 08 16:42:54.184255 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:54.184233 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75f6dc68f-vm4n5"] Jul 08 16:42:55.252970 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:42:55.252939 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc5e9a96-c827-424b-9965-02bf24d05326" path="/var/lib/kubelet/pods/cc5e9a96-c827-424b-9965-02bf24d05326/volumes" Jul 08 16:45:08.801027 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.800942 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj"] Jul 08 16:45:08.801421 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.801274 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc5e9a96-c827-424b-9965-02bf24d05326" containerName="console" Jul 08 16:45:08.801421 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.801285 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc5e9a96-c827-424b-9965-02bf24d05326" containerName="console" Jul 08 16:45:08.801421 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.801352 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc5e9a96-c827-424b-9965-02bf24d05326" containerName="console" Jul 08 16:45:08.804421 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.804403 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" Jul 08 16:45:08.807295 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.807278 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 16:45:08.808423 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.808402 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 16:45:08.808568 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.808450 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-llp8w\"" Jul 08 16:45:08.827659 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.827624 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj"] Jul 08 16:45:08.846204 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.846174 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58662\" (UniqueName: \"kubernetes.io/projected/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-kube-api-access-58662\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj\" (UID: \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" Jul 08 16:45:08.846369 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.846221 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj\" (UID: \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" Jul 08 16:45:08.846369 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.846282 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj\" (UID: \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" Jul 08 16:45:08.947775 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.947734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58662\" (UniqueName: \"kubernetes.io/projected/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-kube-api-access-58662\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj\" (UID: \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" Jul 08 16:45:08.947932 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.947792 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj\" (UID: \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" Jul 08 16:45:08.947932 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.947817 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj\" (UID: \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" Jul 08 16:45:08.948146 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.948130 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj\" (UID: \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" Jul 08 16:45:08.948189 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.948169 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj\" (UID: \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" Jul 08 16:45:08.959296 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:08.959263 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58662\" (UniqueName: \"kubernetes.io/projected/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-kube-api-access-58662\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj\" (UID: \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" Jul 08 16:45:09.113387 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:09.113296 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" Jul 08 16:45:09.255978 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:09.255959 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj"] Jul 08 16:45:09.257868 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:45:09.257843 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455a6bb9_ad31_4ca7_ac34_086a6c1d0f5b.slice/crio-d6726625e241501c474061448789300601a3928dc8acfb9e96b03f1fd15716bb WatchSource:0}: Error finding container d6726625e241501c474061448789300601a3928dc8acfb9e96b03f1fd15716bb: Status 404 returned error can't find the container with id d6726625e241501c474061448789300601a3928dc8acfb9e96b03f1fd15716bb Jul 08 16:45:09.727101 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:09.727067 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" event={"ID":"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b","Type":"ContainerStarted","Data":"d6726625e241501c474061448789300601a3928dc8acfb9e96b03f1fd15716bb"} Jul 08 16:45:16.767282 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:16.767249 2567 generic.go:356] "Generic (PLEG): container finished" podID="455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b" containerID="06337ed79f880840bb0963bd8916f3fecb0db5c7676e81a3f2daace63d576259" exitCode=0 Jul 08 16:45:16.767719 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:16.767339 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" event={"ID":"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b","Type":"ContainerDied","Data":"06337ed79f880840bb0963bd8916f3fecb0db5c7676e81a3f2daace63d576259"} Jul 08 16:45:22.794711 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:22.794678 2567 generic.go:356] "Generic (PLEG): container finished" podID="455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b" containerID="8a9a2a4c8eb93ca730a516ecd3fe766d7190d4597aadc7a84740b6be02e44d20" exitCode=0 Jul 08 16:45:22.795101 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:22.794719 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" event={"ID":"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b","Type":"ContainerDied","Data":"8a9a2a4c8eb93ca730a516ecd3fe766d7190d4597aadc7a84740b6be02e44d20"} Jul 08 16:45:30.835930 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:30.835893 2567 generic.go:356] "Generic (PLEG): container finished" podID="455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b" containerID="1892080e00cd14ee416105fa17c49579c5a7c330a358b0252a173c0672b6d4e2" exitCode=0 Jul 08 16:45:30.836369 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:30.835948 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" event={"ID":"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b","Type":"ContainerDied","Data":"1892080e00cd14ee416105fa17c49579c5a7c330a358b0252a173c0672b6d4e2"} Jul 08 16:45:31.981939 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:31.981903 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" Jul 08 16:45:32.172399 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:32.172305 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-util\") pod \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\" (UID: \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\") " Jul 08 16:45:32.172399 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:32.172384 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58662\" (UniqueName: \"kubernetes.io/projected/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-kube-api-access-58662\") pod \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\" (UID: \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\") " Jul 08 16:45:32.172636 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:32.172430 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-bundle\") pod \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\" (UID: \"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b\") " Jul 08 16:45:32.173071 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:32.173044 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-bundle" (OuterVolumeSpecName: "bundle") pod "455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b" (UID: "455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:45:32.174762 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:32.174738 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-kube-api-access-58662" (OuterVolumeSpecName: "kube-api-access-58662") pod "455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b" (UID: "455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b"). InnerVolumeSpecName "kube-api-access-58662". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:45:32.176460 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:32.176439 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-util" (OuterVolumeSpecName: "util") pod "455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b" (UID: "455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:45:32.273583 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:32.273523 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-util\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:45:32.273583 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:32.273579 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58662\" (UniqueName: \"kubernetes.io/projected/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-kube-api-access-58662\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:45:32.273781 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:32.273596 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b-bundle\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:45:32.846523 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:32.846495 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" Jul 08 16:45:32.846523 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:32.846496 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589wptnj" event={"ID":"455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b","Type":"ContainerDied","Data":"d6726625e241501c474061448789300601a3928dc8acfb9e96b03f1fd15716bb"} Jul 08 16:45:32.846746 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:32.846580 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6726625e241501c474061448789300601a3928dc8acfb9e96b03f1fd15716bb" Jul 08 16:45:36.378633 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.378603 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9"] Jul 08 16:45:36.379038 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.378939 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b" containerName="pull" Jul 08 16:45:36.379038 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.378949 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b" containerName="pull" Jul 08 16:45:36.379038 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.378966 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b" containerName="extract" Jul 08 16:45:36.379038 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.378972 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b" containerName="extract" Jul 08 16:45:36.379038 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.378987 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b" containerName="util" Jul 08 16:45:36.379038 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.378994 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b" containerName="util" Jul 08 16:45:36.379213 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.379042 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="455a6bb9-ad31-4ca7-ac34-086a6c1d0f5b" containerName="extract" Jul 08 16:45:36.404378 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.404336 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9"] Jul 08 16:45:36.404573 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.404466 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9" Jul 08 16:45:36.407250 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.407203 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 08 16:45:36.407553 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.407517 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 08 16:45:36.407664 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.407561 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-tdjvc\"" Jul 08 16:45:36.407664 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.407562 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 08 16:45:36.411407 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.411380 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9pp8\" (UniqueName: \"kubernetes.io/projected/d54e3d2f-6b6d-4693-a465-21f69edf8956-kube-api-access-z9pp8\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-94jh9\" (UID: \"d54e3d2f-6b6d-4693-a465-21f69edf8956\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9" Jul 08 16:45:36.411575 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.411496 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d54e3d2f-6b6d-4693-a465-21f69edf8956-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-94jh9\" (UID: \"d54e3d2f-6b6d-4693-a465-21f69edf8956\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9" Jul 08 16:45:36.512063 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.512025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9pp8\" (UniqueName: \"kubernetes.io/projected/d54e3d2f-6b6d-4693-a465-21f69edf8956-kube-api-access-z9pp8\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-94jh9\" (UID: \"d54e3d2f-6b6d-4693-a465-21f69edf8956\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9" Jul 08 16:45:36.512242 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.512100 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d54e3d2f-6b6d-4693-a465-21f69edf8956-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-94jh9\" (UID: \"d54e3d2f-6b6d-4693-a465-21f69edf8956\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9" Jul 08 16:45:36.514460 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.514437 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d54e3d2f-6b6d-4693-a465-21f69edf8956-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-94jh9\" (UID: \"d54e3d2f-6b6d-4693-a465-21f69edf8956\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9" Jul 08 16:45:36.523513 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.523489 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9pp8\" (UniqueName: \"kubernetes.io/projected/d54e3d2f-6b6d-4693-a465-21f69edf8956-kube-api-access-z9pp8\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-94jh9\" (UID: \"d54e3d2f-6b6d-4693-a465-21f69edf8956\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9" Jul 08 16:45:36.716663 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.716567 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9" Jul 08 16:45:36.872302 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:36.872157 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9"] Jul 08 16:45:36.874893 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:45:36.874864 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54e3d2f_6b6d_4693_a465_21f69edf8956.slice/crio-64550ec5f9857d7d91577b1dd6d3cc15cad93c091cc41995c8ec2cb5b8412685 WatchSource:0}: Error finding container 64550ec5f9857d7d91577b1dd6d3cc15cad93c091cc41995c8ec2cb5b8412685: Status 404 returned error can't find the container with id 64550ec5f9857d7d91577b1dd6d3cc15cad93c091cc41995c8ec2cb5b8412685 Jul 08 16:45:37.872580 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:37.872541 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9" event={"ID":"d54e3d2f-6b6d-4693-a465-21f69edf8956","Type":"ContainerStarted","Data":"64550ec5f9857d7d91577b1dd6d3cc15cad93c091cc41995c8ec2cb5b8412685"} Jul 08 16:45:40.889705 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:40.889663 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9" event={"ID":"d54e3d2f-6b6d-4693-a465-21f69edf8956","Type":"ContainerStarted","Data":"f536cc4fbf6ace0681da12aeb7466369090f662a9441293de3c1e6bc07d6dadf"} Jul 08 16:45:40.890142 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:40.889789 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9" Jul 08 16:45:40.913595 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:40.913542 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9" podStartSLOduration=1.323765165 podStartE2EDuration="4.913506449s" totalImagesPullingTime="3.589741284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:45:40.910415584 +0000 UTC m=+654.248340070" watchObservedRunningTime="2026-07-08 16:45:40.913506449 +0000 UTC m=+654.251430938" Jul 08 16:45:41.931614 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:41.931577 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-g47dk"] Jul 08 16:45:41.949861 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:41.949823 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-g47dk"] Jul 08 16:45:41.950101 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:41.949949 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" Jul 08 16:45:41.952481 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:41.952457 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-brw42\"" Jul 08 16:45:41.952481 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:41.952467 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 08 16:45:41.952692 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:41.952471 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 08 16:45:42.064397 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:42.064331 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/abb61f36-6c53-45db-a94f-1f5a65eacb5c-certificates\") pod \"keda-admission-5fbd5c4644-g47dk\" (UID: \"abb61f36-6c53-45db-a94f-1f5a65eacb5c\") " pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" Jul 08 16:45:42.064604 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:42.064449 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggst4\" (UniqueName: \"kubernetes.io/projected/abb61f36-6c53-45db-a94f-1f5a65eacb5c-kube-api-access-ggst4\") pod \"keda-admission-5fbd5c4644-g47dk\" (UID: \"abb61f36-6c53-45db-a94f-1f5a65eacb5c\") " pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" Jul 08 16:45:42.165148 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:42.165104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/abb61f36-6c53-45db-a94f-1f5a65eacb5c-certificates\") pod \"keda-admission-5fbd5c4644-g47dk\" (UID: \"abb61f36-6c53-45db-a94f-1f5a65eacb5c\") " pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" Jul 08 16:45:42.165345 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:42.165202 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggst4\" (UniqueName: \"kubernetes.io/projected/abb61f36-6c53-45db-a94f-1f5a65eacb5c-kube-api-access-ggst4\") pod \"keda-admission-5fbd5c4644-g47dk\" (UID: \"abb61f36-6c53-45db-a94f-1f5a65eacb5c\") " pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" Jul 08 16:45:42.165345 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:45:42.165282 2567 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 08 16:45:42.165345 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:45:42.165313 2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-g47dk: secret "keda-admission-webhooks-certs" not found Jul 08 16:45:42.165477 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:45:42.165373 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/abb61f36-6c53-45db-a94f-1f5a65eacb5c-certificates podName:abb61f36-6c53-45db-a94f-1f5a65eacb5c nodeName:}" failed. No retries permitted until 2026-07-08 16:45:42.665355483 +0000 UTC m=+656.003279952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/abb61f36-6c53-45db-a94f-1f5a65eacb5c-certificates") pod "keda-admission-5fbd5c4644-g47dk" (UID: "abb61f36-6c53-45db-a94f-1f5a65eacb5c") : secret "keda-admission-webhooks-certs" not found Jul 08 16:45:42.174336 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:42.174298 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggst4\" (UniqueName: \"kubernetes.io/projected/abb61f36-6c53-45db-a94f-1f5a65eacb5c-kube-api-access-ggst4\") pod \"keda-admission-5fbd5c4644-g47dk\" (UID: \"abb61f36-6c53-45db-a94f-1f5a65eacb5c\") " pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" Jul 08 16:45:42.670726 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:42.670696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/abb61f36-6c53-45db-a94f-1f5a65eacb5c-certificates\") pod \"keda-admission-5fbd5c4644-g47dk\" (UID: \"abb61f36-6c53-45db-a94f-1f5a65eacb5c\") " pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" Jul 08 16:45:42.673322 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:42.673294 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/abb61f36-6c53-45db-a94f-1f5a65eacb5c-certificates\") pod \"keda-admission-5fbd5c4644-g47dk\" (UID: \"abb61f36-6c53-45db-a94f-1f5a65eacb5c\") " pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" Jul 08 16:45:42.862434 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:42.862400 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" Jul 08 16:45:43.011636 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:43.011604 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-g47dk"] Jul 08 16:45:43.014382 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:45:43.014356 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb61f36_6c53_45db_a94f_1f5a65eacb5c.slice/crio-a5c06350bcc61d03fd34ae60086f8df9261d1c2fcf4ede5f434fe618b6c68cfe WatchSource:0}: Error finding container a5c06350bcc61d03fd34ae60086f8df9261d1c2fcf4ede5f434fe618b6c68cfe: Status 404 returned error can't find the container with id a5c06350bcc61d03fd34ae60086f8df9261d1c2fcf4ede5f434fe618b6c68cfe Jul 08 16:45:43.907765 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:43.907724 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" event={"ID":"abb61f36-6c53-45db-a94f-1f5a65eacb5c","Type":"ContainerStarted","Data":"a5c06350bcc61d03fd34ae60086f8df9261d1c2fcf4ede5f434fe618b6c68cfe"} Jul 08 16:45:44.913667 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:44.913635 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" event={"ID":"abb61f36-6c53-45db-a94f-1f5a65eacb5c","Type":"ContainerStarted","Data":"ac1e2aa5b9e62eb6d21dab1d15e14bfcfb685e2ff1771a16c655989255168379"} Jul 08 16:45:44.914090 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:44.913760 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" Jul 08 16:45:44.931692 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:45:44.931636 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" podStartSLOduration=2.125923903 podStartE2EDuration="3.93162037s" totalImagesPullingTime="1.805696467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:45:44.930475294 +0000 UTC m=+658.268399781" watchObservedRunningTime="2026-07-08 16:45:44.93162037 +0000 UTC m=+658.269544857" Jul 08 16:46:01.897030 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:01.896997 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-94jh9" Jul 08 16:46:05.920351 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:05.920322 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-g47dk" Jul 08 16:46:13.657436 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.657400 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9c74b957b-z4wdj"] Jul 08 16:46:13.661428 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.661403 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.671425 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.671391 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c74b957b-z4wdj"] Jul 08 16:46:13.748082 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.748047 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-console-oauth-config\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.748082 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.748093 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-console-serving-cert\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.748312 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.748115 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-oauth-serving-cert\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.748312 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.748135 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-trusted-ca-bundle\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.748312 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.748168 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wgtv\" (UniqueName: \"kubernetes.io/projected/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-kube-api-access-4wgtv\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.748312 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.748188 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-console-config\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.748312 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.748213 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-service-ca\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.848970 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.848920 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-console-oauth-config\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.849157 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.848996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-console-serving-cert\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.849157 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.849027 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-oauth-serving-cert\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.849157 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.849058 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-trusted-ca-bundle\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.849157 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.849090 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wgtv\" (UniqueName: \"kubernetes.io/projected/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-kube-api-access-4wgtv\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.849157 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.849133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-console-config\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.849415 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.849180 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-service-ca\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.850034 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.850007 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-service-ca\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.850178 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.850043 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-console-config\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.850178 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.850007 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-oauth-serving-cert\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.850296 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.850225 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-trusted-ca-bundle\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.851662 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.851638 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-console-serving-cert\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.851758 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.851737 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-console-oauth-config\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.859042 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.859020 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wgtv\" (UniqueName: \"kubernetes.io/projected/f2a6ea34-287e-4e38-ac45-76a4f2aa6b50-kube-api-access-4wgtv\") pod \"console-9c74b957b-z4wdj\" (UID: \"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50\") " pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:13.971847 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:13.971821 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:14.110935 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:14.110910 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c74b957b-z4wdj"] Jul 08 16:46:14.113484 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:46:14.113454 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a6ea34_287e_4e38_ac45_76a4f2aa6b50.slice/crio-f5770684f5618276c883bcb5f3b21053165d4d28f8486d62c02719fe3a9479df WatchSource:0}: Error finding container f5770684f5618276c883bcb5f3b21053165d4d28f8486d62c02719fe3a9479df: Status 404 returned error can't find the container with id f5770684f5618276c883bcb5f3b21053165d4d28f8486d62c02719fe3a9479df Jul 08 16:46:15.056369 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:15.056333 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c74b957b-z4wdj" event={"ID":"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50","Type":"ContainerStarted","Data":"85c241a8c0a536ce1f43487810be82725bd61582785361a599b000fc73dec324"} Jul 08 16:46:15.056795 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:15.056389 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c74b957b-z4wdj" event={"ID":"f2a6ea34-287e-4e38-ac45-76a4f2aa6b50","Type":"ContainerStarted","Data":"f5770684f5618276c883bcb5f3b21053165d4d28f8486d62c02719fe3a9479df"} Jul 08 16:46:15.077594 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:15.077516 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9c74b957b-z4wdj" podStartSLOduration=2.077499088 podStartE2EDuration="2.077499088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:46:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:46:15.075066246 +0000 UTC m=+688.412990734" watchObservedRunningTime="2026-07-08 16:46:15.077499088 +0000 UTC m=+688.415423575" Jul 08 16:46:23.972005 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:23.971969 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:23.972404 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:23.972025 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:23.976730 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:23.976710 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:24.103136 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:24.103113 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9c74b957b-z4wdj" Jul 08 16:46:24.149747 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:24.149718 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bdfc6c996-cdhbq"] Jul 08 16:46:48.931958 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:48.931885 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-cb6t8"] Jul 08 16:46:48.934583 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:48.934568 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" Jul 08 16:46:48.937568 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:48.937522 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 08 16:46:48.937568 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:48.937558 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 08 16:46:48.937827 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:48.937811 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-785sb\"" Jul 08 16:46:48.938600 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:48.938586 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 08 16:46:48.947072 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:48.947050 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-cb6t8"] Jul 08 16:46:49.042942 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.042902 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45bc2cce-9985-49ec-a3e9-f687728c5481-cert\") pod \"kserve-controller-manager-c8c545f5f-cb6t8\" (UID: \"45bc2cce-9985-49ec-a3e9-f687728c5481\") " pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" Jul 08 16:46:49.043126 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.043032 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78m5n\" (UniqueName: \"kubernetes.io/projected/45bc2cce-9985-49ec-a3e9-f687728c5481-kube-api-access-78m5n\") pod \"kserve-controller-manager-c8c545f5f-cb6t8\" (UID: \"45bc2cce-9985-49ec-a3e9-f687728c5481\") " pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" Jul 08 16:46:49.143714 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.143666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78m5n\" (UniqueName: \"kubernetes.io/projected/45bc2cce-9985-49ec-a3e9-f687728c5481-kube-api-access-78m5n\") pod \"kserve-controller-manager-c8c545f5f-cb6t8\" (UID: \"45bc2cce-9985-49ec-a3e9-f687728c5481\") " pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" Jul 08 16:46:49.143714 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.143727 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45bc2cce-9985-49ec-a3e9-f687728c5481-cert\") pod \"kserve-controller-manager-c8c545f5f-cb6t8\" (UID: \"45bc2cce-9985-49ec-a3e9-f687728c5481\") " pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" Jul 08 16:46:49.143928 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:46:49.143826 2567 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 08 16:46:49.143928 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:46:49.143886 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45bc2cce-9985-49ec-a3e9-f687728c5481-cert podName:45bc2cce-9985-49ec-a3e9-f687728c5481 nodeName:}" failed. No retries permitted until 2026-07-08 16:46:49.643870945 +0000 UTC m=+722.981795410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/45bc2cce-9985-49ec-a3e9-f687728c5481-cert") pod "kserve-controller-manager-c8c545f5f-cb6t8" (UID: "45bc2cce-9985-49ec-a3e9-f687728c5481") : secret "kserve-webhook-server-cert" not found Jul 08 16:46:49.153047 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.153024 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78m5n\" (UniqueName: \"kubernetes.io/projected/45bc2cce-9985-49ec-a3e9-f687728c5481-kube-api-access-78m5n\") pod \"kserve-controller-manager-c8c545f5f-cb6t8\" (UID: \"45bc2cce-9985-49ec-a3e9-f687728c5481\") " pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" Jul 08 16:46:49.171385 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.171340 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bdfc6c996-cdhbq" podUID="a1be16b9-5285-4e59-bf1b-9742a1bb0081" containerName="console" containerID="cri-o://7e660992b67e3db9bbeded60574f62088fe84c53aa6c5ce0065199888067d64d" gracePeriod=15 Jul 08 16:46:49.410450 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.410420 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:46:49.447041 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.446952 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-oauth-config\") pod \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " Jul 08 16:46:49.447041 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.446985 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-trusted-ca-bundle\") pod \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " Jul 08 16:46:49.447041 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.447022 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-config\") pod \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " Jul 08 16:46:49.447307 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.447065 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ldk6\" (UniqueName: \"kubernetes.io/projected/a1be16b9-5285-4e59-bf1b-9742a1bb0081-kube-api-access-6ldk6\") pod \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " Jul 08 16:46:49.447307 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.447108 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-serving-cert\") pod \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " Jul 08 16:46:49.447307 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.447126 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-oauth-serving-cert\") pod \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " Jul 08 16:46:49.447307 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.447146 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-service-ca\") pod \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\" (UID: \"a1be16b9-5285-4e59-bf1b-9742a1bb0081\") " Jul 08 16:46:49.447503 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.447387 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a1be16b9-5285-4e59-bf1b-9742a1bb0081" (UID: "a1be16b9-5285-4e59-bf1b-9742a1bb0081"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:46:49.447503 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.447485 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-config" (OuterVolumeSpecName: "console-config") pod "a1be16b9-5285-4e59-bf1b-9742a1bb0081" (UID: "a1be16b9-5285-4e59-bf1b-9742a1bb0081"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:46:49.447630 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.447548 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a1be16b9-5285-4e59-bf1b-9742a1bb0081" (UID: "a1be16b9-5285-4e59-bf1b-9742a1bb0081"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:46:49.447795 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.447770 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-service-ca" (OuterVolumeSpecName: "service-ca") pod "a1be16b9-5285-4e59-bf1b-9742a1bb0081" (UID: "a1be16b9-5285-4e59-bf1b-9742a1bb0081"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:46:49.449318 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.449289 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a1be16b9-5285-4e59-bf1b-9742a1bb0081" (UID: "a1be16b9-5285-4e59-bf1b-9742a1bb0081"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:46:49.449415 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.449330 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1be16b9-5285-4e59-bf1b-9742a1bb0081-kube-api-access-6ldk6" (OuterVolumeSpecName: "kube-api-access-6ldk6") pod "a1be16b9-5285-4e59-bf1b-9742a1bb0081" (UID: "a1be16b9-5285-4e59-bf1b-9742a1bb0081"). InnerVolumeSpecName "kube-api-access-6ldk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:46:49.449415 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.449388 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a1be16b9-5285-4e59-bf1b-9742a1bb0081" (UID: "a1be16b9-5285-4e59-bf1b-9742a1bb0081"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:46:49.548453 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.548400 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ldk6\" (UniqueName: \"kubernetes.io/projected/a1be16b9-5285-4e59-bf1b-9742a1bb0081-kube-api-access-6ldk6\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:46:49.548453 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.548445 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:46:49.548453 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.548454 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-oauth-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:46:49.548453 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.548463 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-service-ca\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:46:49.548453 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.548471 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-oauth-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:46:49.548792 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.548479 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-trusted-ca-bundle\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:46:49.548792 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.548487 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1be16b9-5285-4e59-bf1b-9742a1bb0081-console-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:46:49.649337 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.649296 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45bc2cce-9985-49ec-a3e9-f687728c5481-cert\") pod \"kserve-controller-manager-c8c545f5f-cb6t8\" (UID: \"45bc2cce-9985-49ec-a3e9-f687728c5481\") " pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" Jul 08 16:46:49.651845 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.651824 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45bc2cce-9985-49ec-a3e9-f687728c5481-cert\") pod \"kserve-controller-manager-c8c545f5f-cb6t8\" (UID: \"45bc2cce-9985-49ec-a3e9-f687728c5481\") " pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" Jul 08 16:46:49.844722 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.844679 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" Jul 08 16:46:49.979439 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.979405 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-cb6t8"] Jul 08 16:46:49.982926 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:46:49.982901 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45bc2cce_9985_49ec_a3e9_f687728c5481.slice/crio-752bc249275e3bc73d1e893a3b443becd0fceb587dbbd11f35405776b92bdf60 WatchSource:0}: Error finding container 752bc249275e3bc73d1e893a3b443becd0fceb587dbbd11f35405776b92bdf60: Status 404 returned error can't find the container with id 752bc249275e3bc73d1e893a3b443becd0fceb587dbbd11f35405776b92bdf60 Jul 08 16:46:49.984271 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:49.984250 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:46:50.222459 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:50.222429 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" event={"ID":"45bc2cce-9985-49ec-a3e9-f687728c5481","Type":"ContainerStarted","Data":"752bc249275e3bc73d1e893a3b443becd0fceb587dbbd11f35405776b92bdf60"} Jul 08 16:46:50.223616 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:50.223590 2567 generic.go:356] "Generic (PLEG): container finished" podID="a1be16b9-5285-4e59-bf1b-9742a1bb0081" containerID="7e660992b67e3db9bbeded60574f62088fe84c53aa6c5ce0065199888067d64d" exitCode=0 Jul 08 16:46:50.223744 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:50.223643 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdfc6c996-cdhbq" Jul 08 16:46:50.223744 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:50.223683 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdfc6c996-cdhbq" event={"ID":"a1be16b9-5285-4e59-bf1b-9742a1bb0081","Type":"ContainerDied","Data":"7e660992b67e3db9bbeded60574f62088fe84c53aa6c5ce0065199888067d64d"} Jul 08 16:46:50.223744 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:50.223729 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdfc6c996-cdhbq" event={"ID":"a1be16b9-5285-4e59-bf1b-9742a1bb0081","Type":"ContainerDied","Data":"1e5b20d961e533363142f8ef5a7650e371cb030ce1dfb43b6ce35f331f299bd0"} Jul 08 16:46:50.223841 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:50.223750 2567 scope.go:117] "RemoveContainer" containerID="7e660992b67e3db9bbeded60574f62088fe84c53aa6c5ce0065199888067d64d" Jul 08 16:46:50.233156 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:50.233137 2567 scope.go:117] "RemoveContainer" containerID="7e660992b67e3db9bbeded60574f62088fe84c53aa6c5ce0065199888067d64d" Jul 08 16:46:50.233427 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:46:50.233409 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e660992b67e3db9bbeded60574f62088fe84c53aa6c5ce0065199888067d64d\": container with ID starting with 7e660992b67e3db9bbeded60574f62088fe84c53aa6c5ce0065199888067d64d not found: ID does not exist" containerID="7e660992b67e3db9bbeded60574f62088fe84c53aa6c5ce0065199888067d64d" Jul 08 16:46:50.233472 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:50.233438 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e660992b67e3db9bbeded60574f62088fe84c53aa6c5ce0065199888067d64d"} err="failed to get container status \"7e660992b67e3db9bbeded60574f62088fe84c53aa6c5ce0065199888067d64d\": rpc error: code = NotFound desc = could not find container \"7e660992b67e3db9bbeded60574f62088fe84c53aa6c5ce0065199888067d64d\": container with ID starting with 7e660992b67e3db9bbeded60574f62088fe84c53aa6c5ce0065199888067d64d not found: ID does not exist" Jul 08 16:46:50.247128 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:50.247103 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bdfc6c996-cdhbq"] Jul 08 16:46:50.250963 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:50.250939 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bdfc6c996-cdhbq"] Jul 08 16:46:51.254204 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:51.254174 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1be16b9-5285-4e59-bf1b-9742a1bb0081" path="/var/lib/kubelet/pods/a1be16b9-5285-4e59-bf1b-9742a1bb0081/volumes" Jul 08 16:46:54.247635 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:54.247588 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" event={"ID":"45bc2cce-9985-49ec-a3e9-f687728c5481","Type":"ContainerStarted","Data":"d4374f36d858984f92436e90495088474a0fdcadfe50fc6fa43d2ebe09edd202"} Jul 08 16:46:54.248050 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:54.247707 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" Jul 08 16:46:54.264976 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:46:54.264921 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" podStartSLOduration=2.386616679 podStartE2EDuration="6.26490332s" totalImagesPullingTime="3.878286641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:46:54.264122237 +0000 UTC m=+727.602046723" watchObservedRunningTime="2026-07-08 16:46:54.26490332 +0000 UTC m=+727.602827852" Jul 08 16:47:25.261130 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:25.261103 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" Jul 08 16:47:25.888395 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:25.888363 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-cb6t8"] Jul 08 16:47:25.888582 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:25.888542 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" podUID="45bc2cce-9985-49ec-a3e9-f687728c5481" containerName="manager" containerID="cri-o://d4374f36d858984f92436e90495088474a0fdcadfe50fc6fa43d2ebe09edd202" gracePeriod=10 Jul 08 16:47:25.908469 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:25.908447 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-h9266"] Jul 08 16:47:25.908937 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:25.908919 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1be16b9-5285-4e59-bf1b-9742a1bb0081" containerName="console" Jul 08 16:47:25.908937 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:25.908939 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1be16b9-5285-4e59-bf1b-9742a1bb0081" containerName="console" Jul 08 16:47:25.909086 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:25.909058 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1be16b9-5285-4e59-bf1b-9742a1bb0081" containerName="console" Jul 08 16:47:25.911318 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:25.911304 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-c8c545f5f-h9266" Jul 08 16:47:25.919708 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:25.919689 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-h9266"] Jul 08 16:47:25.959339 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:25.959310 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7f3fdfc-5660-491b-aa25-4928f4143d96-cert\") pod \"kserve-controller-manager-c8c545f5f-h9266\" (UID: \"b7f3fdfc-5660-491b-aa25-4928f4143d96\") " pod="kserve/kserve-controller-manager-c8c545f5f-h9266" Jul 08 16:47:25.959448 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:25.959353 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhvrc\" (UniqueName: \"kubernetes.io/projected/b7f3fdfc-5660-491b-aa25-4928f4143d96-kube-api-access-zhvrc\") pod \"kserve-controller-manager-c8c545f5f-h9266\" (UID: \"b7f3fdfc-5660-491b-aa25-4928f4143d96\") " pod="kserve/kserve-controller-manager-c8c545f5f-h9266" Jul 08 16:47:26.060134 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.060104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7f3fdfc-5660-491b-aa25-4928f4143d96-cert\") pod \"kserve-controller-manager-c8c545f5f-h9266\" (UID: \"b7f3fdfc-5660-491b-aa25-4928f4143d96\") " pod="kserve/kserve-controller-manager-c8c545f5f-h9266" Jul 08 16:47:26.060272 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.060142 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhvrc\" (UniqueName: \"kubernetes.io/projected/b7f3fdfc-5660-491b-aa25-4928f4143d96-kube-api-access-zhvrc\") pod \"kserve-controller-manager-c8c545f5f-h9266\" (UID: \"b7f3fdfc-5660-491b-aa25-4928f4143d96\") " pod="kserve/kserve-controller-manager-c8c545f5f-h9266" Jul 08 16:47:26.062329 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.062308 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7f3fdfc-5660-491b-aa25-4928f4143d96-cert\") pod \"kserve-controller-manager-c8c545f5f-h9266\" (UID: \"b7f3fdfc-5660-491b-aa25-4928f4143d96\") " pod="kserve/kserve-controller-manager-c8c545f5f-h9266" Jul 08 16:47:26.068674 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.068651 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhvrc\" (UniqueName: \"kubernetes.io/projected/b7f3fdfc-5660-491b-aa25-4928f4143d96-kube-api-access-zhvrc\") pod \"kserve-controller-manager-c8c545f5f-h9266\" (UID: \"b7f3fdfc-5660-491b-aa25-4928f4143d96\") " pod="kserve/kserve-controller-manager-c8c545f5f-h9266" Jul 08 16:47:26.133584 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.133562 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" Jul 08 16:47:26.161225 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.161148 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45bc2cce-9985-49ec-a3e9-f687728c5481-cert\") pod \"45bc2cce-9985-49ec-a3e9-f687728c5481\" (UID: \"45bc2cce-9985-49ec-a3e9-f687728c5481\") " Jul 08 16:47:26.161336 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.161228 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78m5n\" (UniqueName: \"kubernetes.io/projected/45bc2cce-9985-49ec-a3e9-f687728c5481-kube-api-access-78m5n\") pod \"45bc2cce-9985-49ec-a3e9-f687728c5481\" (UID: \"45bc2cce-9985-49ec-a3e9-f687728c5481\") " Jul 08 16:47:26.163396 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.163368 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45bc2cce-9985-49ec-a3e9-f687728c5481-kube-api-access-78m5n" (OuterVolumeSpecName: "kube-api-access-78m5n") pod "45bc2cce-9985-49ec-a3e9-f687728c5481" (UID: "45bc2cce-9985-49ec-a3e9-f687728c5481"). InnerVolumeSpecName "kube-api-access-78m5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:47:26.163486 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.163397 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45bc2cce-9985-49ec-a3e9-f687728c5481-cert" (OuterVolumeSpecName: "cert") pod "45bc2cce-9985-49ec-a3e9-f687728c5481" (UID: "45bc2cce-9985-49ec-a3e9-f687728c5481"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:47:26.261877 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.261836 2567 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45bc2cce-9985-49ec-a3e9-f687728c5481-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:47:26.261877 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.261872 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78m5n\" (UniqueName: \"kubernetes.io/projected/45bc2cce-9985-49ec-a3e9-f687728c5481-kube-api-access-78m5n\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:47:26.271441 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.271420 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-c8c545f5f-h9266" Jul 08 16:47:26.397757 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.397742 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-h9266"] Jul 08 16:47:26.400070 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:47:26.400046 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f3fdfc_5660_491b_aa25_4928f4143d96.slice/crio-1a92ac1acedb618f5500fe91dc1e86170e5cb935c5113b08f2e11920c0b83a48 WatchSource:0}: Error finding container 1a92ac1acedb618f5500fe91dc1e86170e5cb935c5113b08f2e11920c0b83a48: Status 404 returned error can't find the container with id 1a92ac1acedb618f5500fe91dc1e86170e5cb935c5113b08f2e11920c0b83a48 Jul 08 16:47:26.400438 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.400419 2567 generic.go:356] "Generic (PLEG): container finished" podID="45bc2cce-9985-49ec-a3e9-f687728c5481" containerID="d4374f36d858984f92436e90495088474a0fdcadfe50fc6fa43d2ebe09edd202" exitCode=0 Jul 08 16:47:26.400522 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.400456 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" Jul 08 16:47:26.400522 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.400503 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" event={"ID":"45bc2cce-9985-49ec-a3e9-f687728c5481","Type":"ContainerDied","Data":"d4374f36d858984f92436e90495088474a0fdcadfe50fc6fa43d2ebe09edd202"} Jul 08 16:47:26.400828 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.400575 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-c8c545f5f-cb6t8" event={"ID":"45bc2cce-9985-49ec-a3e9-f687728c5481","Type":"ContainerDied","Data":"752bc249275e3bc73d1e893a3b443becd0fceb587dbbd11f35405776b92bdf60"} Jul 08 16:47:26.400828 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.400603 2567 scope.go:117] "RemoveContainer" containerID="d4374f36d858984f92436e90495088474a0fdcadfe50fc6fa43d2ebe09edd202" Jul 08 16:47:26.415517 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.415499 2567 scope.go:117] "RemoveContainer" containerID="d4374f36d858984f92436e90495088474a0fdcadfe50fc6fa43d2ebe09edd202" Jul 08 16:47:26.415796 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:47:26.415778 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4374f36d858984f92436e90495088474a0fdcadfe50fc6fa43d2ebe09edd202\": container with ID starting with d4374f36d858984f92436e90495088474a0fdcadfe50fc6fa43d2ebe09edd202 not found: ID does not exist" containerID="d4374f36d858984f92436e90495088474a0fdcadfe50fc6fa43d2ebe09edd202" Jul 08 16:47:26.415860 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.415807 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4374f36d858984f92436e90495088474a0fdcadfe50fc6fa43d2ebe09edd202"} err="failed to get container status \"d4374f36d858984f92436e90495088474a0fdcadfe50fc6fa43d2ebe09edd202\": rpc error: code = NotFound desc = could not find container \"d4374f36d858984f92436e90495088474a0fdcadfe50fc6fa43d2ebe09edd202\": container with ID starting with d4374f36d858984f92436e90495088474a0fdcadfe50fc6fa43d2ebe09edd202 not found: ID does not exist" Jul 08 16:47:26.426770 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.426742 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-cb6t8"] Jul 08 16:47:26.431488 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:26.431465 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-cb6t8"] Jul 08 16:47:27.253828 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:27.253792 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45bc2cce-9985-49ec-a3e9-f687728c5481" path="/var/lib/kubelet/pods/45bc2cce-9985-49ec-a3e9-f687728c5481/volumes" Jul 08 16:47:27.406973 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:27.406937 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-c8c545f5f-h9266" event={"ID":"b7f3fdfc-5660-491b-aa25-4928f4143d96","Type":"ContainerStarted","Data":"6573f5158368a5f7de5e28476d243808ee05dec22578fb4b1ff687d8c9a3c89f"} Jul 08 16:47:27.407344 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:27.406991 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-c8c545f5f-h9266" event={"ID":"b7f3fdfc-5660-491b-aa25-4928f4143d96","Type":"ContainerStarted","Data":"1a92ac1acedb618f5500fe91dc1e86170e5cb935c5113b08f2e11920c0b83a48"} Jul 08 16:47:27.407344 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:27.407070 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-c8c545f5f-h9266" Jul 08 16:47:27.426612 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:27.426572 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-c8c545f5f-h9266" podStartSLOduration=1.8991558259999999 podStartE2EDuration="2.426557616s" totalImagesPullingTime="527.40179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:47:27.425482285 +0000 UTC m=+760.763406773" watchObservedRunningTime="2026-07-08 16:47:27.426557616 +0000 UTC m=+760.764482102" Jul 08 16:47:58.415495 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:58.415467 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-c8c545f5f-h9266" Jul 08 16:47:59.964838 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:59.964783 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-ttdp7"] Jul 08 16:47:59.965363 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:59.965343 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45bc2cce-9985-49ec-a3e9-f687728c5481" containerName="manager" Jul 08 16:47:59.965451 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:59.965366 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="45bc2cce-9985-49ec-a3e9-f687728c5481" containerName="manager" Jul 08 16:47:59.965503 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:59.965451 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="45bc2cce-9985-49ec-a3e9-f687728c5481" containerName="manager" Jul 08 16:47:59.969916 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:59.969896 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-ttdp7" Jul 08 16:47:59.972551 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:59.972520 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-jprdc\"" Jul 08 16:47:59.972551 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:59.972543 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 08 16:47:59.980052 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:59.980031 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-ttdp7"] Jul 08 16:47:59.987707 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:59.987687 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-c9bbr"] Jul 08 16:47:59.991548 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:59.991510 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-c9bbr" Jul 08 16:47:59.994166 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:59.994147 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-qzkh9\"" Jul 08 16:47:59.994283 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:59.994182 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 08 16:47:59.998680 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:47:59.998659 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-c9bbr"] Jul 08 16:48:00.044258 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.044238 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4tv7\" (UniqueName: \"kubernetes.io/projected/b8578510-1e2d-4e33-be42-030bd5176600-kube-api-access-s4tv7\") pod \"model-serving-api-fd65d7d6-ttdp7\" (UID: \"b8578510-1e2d-4e33-be42-030bd5176600\") " pod="kserve/model-serving-api-fd65d7d6-ttdp7" Jul 08 16:48:00.044366 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.044280 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8578510-1e2d-4e33-be42-030bd5176600-tls-certs\") pod \"model-serving-api-fd65d7d6-ttdp7\" (UID: \"b8578510-1e2d-4e33-be42-030bd5176600\") " pod="kserve/model-serving-api-fd65d7d6-ttdp7" Jul 08 16:48:00.144610 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.144586 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4tv7\" (UniqueName: \"kubernetes.io/projected/b8578510-1e2d-4e33-be42-030bd5176600-kube-api-access-s4tv7\") pod \"model-serving-api-fd65d7d6-ttdp7\" (UID: \"b8578510-1e2d-4e33-be42-030bd5176600\") " pod="kserve/model-serving-api-fd65d7d6-ttdp7" Jul 08 16:48:00.144714 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.144630 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8578510-1e2d-4e33-be42-030bd5176600-tls-certs\") pod \"model-serving-api-fd65d7d6-ttdp7\" (UID: \"b8578510-1e2d-4e33-be42-030bd5176600\") " pod="kserve/model-serving-api-fd65d7d6-ttdp7" Jul 08 16:48:00.144714 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.144650 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4e3f64f-4685-4166-8659-89e03f0d5699-cert\") pod \"odh-model-controller-84b54b7f97-c9bbr\" (UID: \"f4e3f64f-4685-4166-8659-89e03f0d5699\") " pod="kserve/odh-model-controller-84b54b7f97-c9bbr" Jul 08 16:48:00.144714 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.144690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2phx\" (UniqueName: \"kubernetes.io/projected/f4e3f64f-4685-4166-8659-89e03f0d5699-kube-api-access-k2phx\") pod \"odh-model-controller-84b54b7f97-c9bbr\" (UID: \"f4e3f64f-4685-4166-8659-89e03f0d5699\") " pod="kserve/odh-model-controller-84b54b7f97-c9bbr" Jul 08 16:48:00.144859 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:48:00.144716 2567 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 08 16:48:00.144859 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:48:00.144782 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8578510-1e2d-4e33-be42-030bd5176600-tls-certs podName:b8578510-1e2d-4e33-be42-030bd5176600 nodeName:}" failed. No retries permitted until 2026-07-08 16:48:00.644761026 +0000 UTC m=+793.982685492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b8578510-1e2d-4e33-be42-030bd5176600-tls-certs") pod "model-serving-api-fd65d7d6-ttdp7" (UID: "b8578510-1e2d-4e33-be42-030bd5176600") : secret "model-serving-api-tls" not found Jul 08 16:48:00.152862 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.152845 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4tv7\" (UniqueName: \"kubernetes.io/projected/b8578510-1e2d-4e33-be42-030bd5176600-kube-api-access-s4tv7\") pod \"model-serving-api-fd65d7d6-ttdp7\" (UID: \"b8578510-1e2d-4e33-be42-030bd5176600\") " pod="kserve/model-serving-api-fd65d7d6-ttdp7" Jul 08 16:48:00.246025 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.245996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2phx\" (UniqueName: \"kubernetes.io/projected/f4e3f64f-4685-4166-8659-89e03f0d5699-kube-api-access-k2phx\") pod \"odh-model-controller-84b54b7f97-c9bbr\" (UID: \"f4e3f64f-4685-4166-8659-89e03f0d5699\") " pod="kserve/odh-model-controller-84b54b7f97-c9bbr" Jul 08 16:48:00.246130 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.246091 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4e3f64f-4685-4166-8659-89e03f0d5699-cert\") pod \"odh-model-controller-84b54b7f97-c9bbr\" (UID: \"f4e3f64f-4685-4166-8659-89e03f0d5699\") " pod="kserve/odh-model-controller-84b54b7f97-c9bbr" Jul 08 16:48:00.246193 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:48:00.246180 2567 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 08 16:48:00.246252 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:48:00.246242 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e3f64f-4685-4166-8659-89e03f0d5699-cert podName:f4e3f64f-4685-4166-8659-89e03f0d5699 nodeName:}" failed. No retries permitted until 2026-07-08 16:48:00.746227084 +0000 UTC m=+794.084151551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f4e3f64f-4685-4166-8659-89e03f0d5699-cert") pod "odh-model-controller-84b54b7f97-c9bbr" (UID: "f4e3f64f-4685-4166-8659-89e03f0d5699") : secret "odh-model-controller-webhook-cert" not found Jul 08 16:48:00.254521 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.254497 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2phx\" (UniqueName: \"kubernetes.io/projected/f4e3f64f-4685-4166-8659-89e03f0d5699-kube-api-access-k2phx\") pod \"odh-model-controller-84b54b7f97-c9bbr\" (UID: \"f4e3f64f-4685-4166-8659-89e03f0d5699\") " pod="kserve/odh-model-controller-84b54b7f97-c9bbr" Jul 08 16:48:00.650604 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.650516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8578510-1e2d-4e33-be42-030bd5176600-tls-certs\") pod \"model-serving-api-fd65d7d6-ttdp7\" (UID: \"b8578510-1e2d-4e33-be42-030bd5176600\") " pod="kserve/model-serving-api-fd65d7d6-ttdp7" Jul 08 16:48:00.652845 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.652827 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8578510-1e2d-4e33-be42-030bd5176600-tls-certs\") pod \"model-serving-api-fd65d7d6-ttdp7\" (UID: \"b8578510-1e2d-4e33-be42-030bd5176600\") " pod="kserve/model-serving-api-fd65d7d6-ttdp7" Jul 08 16:48:00.750879 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.750856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4e3f64f-4685-4166-8659-89e03f0d5699-cert\") pod \"odh-model-controller-84b54b7f97-c9bbr\" (UID: \"f4e3f64f-4685-4166-8659-89e03f0d5699\") " pod="kserve/odh-model-controller-84b54b7f97-c9bbr" Jul 08 16:48:00.752989 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.752973 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4e3f64f-4685-4166-8659-89e03f0d5699-cert\") pod \"odh-model-controller-84b54b7f97-c9bbr\" (UID: \"f4e3f64f-4685-4166-8659-89e03f0d5699\") " pod="kserve/odh-model-controller-84b54b7f97-c9bbr" Jul 08 16:48:00.882395 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.882371 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-ttdp7" Jul 08 16:48:00.903598 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:00.903520 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-c9bbr" Jul 08 16:48:01.022798 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:01.022773 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-ttdp7"] Jul 08 16:48:01.024461 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:48:01.024437 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8578510_1e2d_4e33_be42_030bd5176600.slice/crio-9938858df210c4f4cbeeaf2667cb779460708d2adc0c5dddb8c3f130f058ff79 WatchSource:0}: Error finding container 9938858df210c4f4cbeeaf2667cb779460708d2adc0c5dddb8c3f130f058ff79: Status 404 returned error can't find the container with id 9938858df210c4f4cbeeaf2667cb779460708d2adc0c5dddb8c3f130f058ff79 Jul 08 16:48:01.039748 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:01.039728 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-c9bbr"] Jul 08 16:48:01.041324 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:48:01.041301 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e3f64f_4685_4166_8659_89e03f0d5699.slice/crio-9f88b58ad81814090c15c8d71acb1810498c7489279385465a85442afdff7e37 WatchSource:0}: Error finding container 9f88b58ad81814090c15c8d71acb1810498c7489279385465a85442afdff7e37: Status 404 returned error can't find the container with id 9f88b58ad81814090c15c8d71acb1810498c7489279385465a85442afdff7e37 Jul 08 16:48:01.567575 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:01.567546 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-ttdp7" event={"ID":"b8578510-1e2d-4e33-be42-030bd5176600","Type":"ContainerStarted","Data":"9938858df210c4f4cbeeaf2667cb779460708d2adc0c5dddb8c3f130f058ff79"} Jul 08 16:48:01.568565 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:01.568541 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-c9bbr" event={"ID":"f4e3f64f-4685-4166-8659-89e03f0d5699","Type":"ContainerStarted","Data":"9f88b58ad81814090c15c8d71acb1810498c7489279385465a85442afdff7e37"} Jul 08 16:48:04.587563 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:04.587509 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-c9bbr" event={"ID":"f4e3f64f-4685-4166-8659-89e03f0d5699","Type":"ContainerStarted","Data":"2a15dcd058769a4e5626fbb299f3adbb031056bb6ab362398602b9331f15fa95"} Jul 08 16:48:04.587999 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:04.587592 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-c9bbr" Jul 08 16:48:04.588990 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:04.588969 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-ttdp7" event={"ID":"b8578510-1e2d-4e33-be42-030bd5176600","Type":"ContainerStarted","Data":"e6180347bd8eb6711bdfd85c0ac9fed194cf9747081914f7780ffed9c42521c8"} Jul 08 16:48:04.589104 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:04.589087 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-ttdp7" Jul 08 16:48:04.605997 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:04.605957 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-c9bbr" podStartSLOduration=2.526814991 podStartE2EDuration="5.60594314s" totalImagesPullingTime="3.079128149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:48:04.604204976 +0000 UTC m=+797.942129473" watchObservedRunningTime="2026-07-08 16:48:04.60594314 +0000 UTC m=+797.943867627" Jul 08 16:48:04.620983 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:04.620942 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-ttdp7" podStartSLOduration=2.572922876 podStartE2EDuration="5.620928964s" totalImagesPullingTime="3.048006088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:48:04.620327855 +0000 UTC m=+797.958252342" watchObservedRunningTime="2026-07-08 16:48:04.620928964 +0000 UTC m=+797.958853490" Jul 08 16:48:15.596689 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:15.596622 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-c9bbr" Jul 08 16:48:15.598483 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:48:15.598465 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-ttdp7" Jul 08 16:53:22.970664 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:22.970631 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7"] Jul 08 16:53:22.974028 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:22.974010 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" Jul 08 16:53:22.979447 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:22.979424 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-5d281-serving-cert\"" Jul 08 16:53:22.979921 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:22.979901 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-5d281-kube-rbac-proxy-sar-config\"" Jul 08 16:53:22.979921 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:22.979915 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vkqpp\"" Jul 08 16:53:22.980036 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:22.979913 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 08 16:53:22.989657 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:22.989635 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7"] Jul 08 16:53:23.123416 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:23.123385 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf8227f9-ee3c-4297-94e4-b44f4f89c48b-openshift-service-ca-bundle\") pod \"model-chainer-raw-5d281-676947cfc6-6zlv7\" (UID: \"cf8227f9-ee3c-4297-94e4-b44f4f89c48b\") " pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" Jul 08 16:53:23.123598 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:23.123465 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf8227f9-ee3c-4297-94e4-b44f4f89c48b-proxy-tls\") pod \"model-chainer-raw-5d281-676947cfc6-6zlv7\" (UID: \"cf8227f9-ee3c-4297-94e4-b44f4f89c48b\") " pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" Jul 08 16:53:23.224326 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:23.224247 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf8227f9-ee3c-4297-94e4-b44f4f89c48b-proxy-tls\") pod \"model-chainer-raw-5d281-676947cfc6-6zlv7\" (UID: \"cf8227f9-ee3c-4297-94e4-b44f4f89c48b\") " pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" Jul 08 16:53:23.224485 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:23.224332 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf8227f9-ee3c-4297-94e4-b44f4f89c48b-openshift-service-ca-bundle\") pod \"model-chainer-raw-5d281-676947cfc6-6zlv7\" (UID: \"cf8227f9-ee3c-4297-94e4-b44f4f89c48b\") " pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" Jul 08 16:53:23.225066 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:23.225048 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf8227f9-ee3c-4297-94e4-b44f4f89c48b-openshift-service-ca-bundle\") pod \"model-chainer-raw-5d281-676947cfc6-6zlv7\" (UID: \"cf8227f9-ee3c-4297-94e4-b44f4f89c48b\") " pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" Jul 08 16:53:23.226654 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:23.226639 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf8227f9-ee3c-4297-94e4-b44f4f89c48b-proxy-tls\") pod \"model-chainer-raw-5d281-676947cfc6-6zlv7\" (UID: \"cf8227f9-ee3c-4297-94e4-b44f4f89c48b\") " pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" Jul 08 16:53:23.284208 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:23.284180 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" Jul 08 16:53:23.434692 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:23.434670 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7"] Jul 08 16:53:23.437647 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:53:23.437610 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8227f9_ee3c_4297_94e4_b44f4f89c48b.slice/crio-b7f15a06fd5e542814e1c9979b3c2a600e14a1d25c0253ac1bfe2571316b3902 WatchSource:0}: Error finding container b7f15a06fd5e542814e1c9979b3c2a600e14a1d25c0253ac1bfe2571316b3902: Status 404 returned error can't find the container with id b7f15a06fd5e542814e1c9979b3c2a600e14a1d25c0253ac1bfe2571316b3902 Jul 08 16:53:23.439809 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:23.439793 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:53:24.112185 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:24.112143 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" event={"ID":"cf8227f9-ee3c-4297-94e4-b44f4f89c48b","Type":"ContainerStarted","Data":"b7f15a06fd5e542814e1c9979b3c2a600e14a1d25c0253ac1bfe2571316b3902"} Jul 08 16:53:26.124498 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:26.124406 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" event={"ID":"cf8227f9-ee3c-4297-94e4-b44f4f89c48b","Type":"ContainerStarted","Data":"2d2e6d46ac427293bdec1adeaba2941e3acb08cdbe22aa277b21d3398c998ef2"} Jul 08 16:53:26.124952 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:26.124540 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" Jul 08 16:53:26.147853 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:26.147806 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" podStartSLOduration=1.8357471520000002 podStartE2EDuration="4.147790697s" totalImagesPullingTime="2.312043545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:53:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:53:26.146322563 +0000 UTC m=+1119.484247051" watchObservedRunningTime="2026-07-08 16:53:26.147790697 +0000 UTC m=+1119.485715183" Jul 08 16:53:32.135342 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:32.135312 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" Jul 08 16:53:32.986064 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:32.986030 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7"] Jul 08 16:53:32.986248 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:32.986209 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" podUID="cf8227f9-ee3c-4297-94e4-b44f4f89c48b" containerName="model-chainer-raw-5d281" containerID="cri-o://2d2e6d46ac427293bdec1adeaba2941e3acb08cdbe22aa277b21d3398c998ef2" gracePeriod=30 Jul 08 16:53:37.133947 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:37.133903 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" podUID="cf8227f9-ee3c-4297-94e4-b44f4f89c48b" containerName="model-chainer-raw-5d281" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 16:53:42.134439 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:42.134394 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" podUID="cf8227f9-ee3c-4297-94e4-b44f4f89c48b" containerName="model-chainer-raw-5d281" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 16:53:47.133614 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:47.133575 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" podUID="cf8227f9-ee3c-4297-94e4-b44f4f89c48b" containerName="model-chainer-raw-5d281" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 16:53:47.134175 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:47.133679 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" Jul 08 16:53:52.133452 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:52.133411 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" podUID="cf8227f9-ee3c-4297-94e4-b44f4f89c48b" containerName="model-chainer-raw-5d281" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 16:53:57.133762 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:53:57.133717 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" podUID="cf8227f9-ee3c-4297-94e4-b44f4f89c48b" containerName="model-chainer-raw-5d281" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 16:54:02.133606 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:02.133566 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" podUID="cf8227f9-ee3c-4297-94e4-b44f4f89c48b" containerName="model-chainer-raw-5d281" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 16:54:03.136862 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.136836 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" Jul 08 16:54:03.169749 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.169720 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf8227f9-ee3c-4297-94e4-b44f4f89c48b-openshift-service-ca-bundle\") pod \"cf8227f9-ee3c-4297-94e4-b44f4f89c48b\" (UID: \"cf8227f9-ee3c-4297-94e4-b44f4f89c48b\") " Jul 08 16:54:03.169922 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.169792 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf8227f9-ee3c-4297-94e4-b44f4f89c48b-proxy-tls\") pod \"cf8227f9-ee3c-4297-94e4-b44f4f89c48b\" (UID: \"cf8227f9-ee3c-4297-94e4-b44f4f89c48b\") " Jul 08 16:54:03.170087 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.170063 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf8227f9-ee3c-4297-94e4-b44f4f89c48b-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "cf8227f9-ee3c-4297-94e4-b44f4f89c48b" (UID: "cf8227f9-ee3c-4297-94e4-b44f4f89c48b"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:54:03.171990 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.171966 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf8227f9-ee3c-4297-94e4-b44f4f89c48b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "cf8227f9-ee3c-4297-94e4-b44f4f89c48b" (UID: "cf8227f9-ee3c-4297-94e4-b44f4f89c48b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:54:03.270965 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.270935 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf8227f9-ee3c-4297-94e4-b44f4f89c48b-openshift-service-ca-bundle\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:54:03.270965 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.270962 2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf8227f9-ee3c-4297-94e4-b44f4f89c48b-proxy-tls\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:54:03.300064 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.300031 2567 generic.go:356] "Generic (PLEG): container finished" podID="cf8227f9-ee3c-4297-94e4-b44f4f89c48b" containerID="2d2e6d46ac427293bdec1adeaba2941e3acb08cdbe22aa277b21d3398c998ef2" exitCode=0 Jul 08 16:54:03.300211 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.300074 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" Jul 08 16:54:03.300211 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.300105 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" event={"ID":"cf8227f9-ee3c-4297-94e4-b44f4f89c48b","Type":"ContainerDied","Data":"2d2e6d46ac427293bdec1adeaba2941e3acb08cdbe22aa277b21d3398c998ef2"} Jul 08 16:54:03.300211 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.300148 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7" event={"ID":"cf8227f9-ee3c-4297-94e4-b44f4f89c48b","Type":"ContainerDied","Data":"b7f15a06fd5e542814e1c9979b3c2a600e14a1d25c0253ac1bfe2571316b3902"} Jul 08 16:54:03.300211 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.300168 2567 scope.go:117] "RemoveContainer" containerID="2d2e6d46ac427293bdec1adeaba2941e3acb08cdbe22aa277b21d3398c998ef2" Jul 08 16:54:03.308916 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.308900 2567 scope.go:117] "RemoveContainer" containerID="2d2e6d46ac427293bdec1adeaba2941e3acb08cdbe22aa277b21d3398c998ef2" Jul 08 16:54:03.309190 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:54:03.309170 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d2e6d46ac427293bdec1adeaba2941e3acb08cdbe22aa277b21d3398c998ef2\": container with ID starting with 2d2e6d46ac427293bdec1adeaba2941e3acb08cdbe22aa277b21d3398c998ef2 not found: ID does not exist" containerID="2d2e6d46ac427293bdec1adeaba2941e3acb08cdbe22aa277b21d3398c998ef2" Jul 08 16:54:03.309273 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.309198 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2e6d46ac427293bdec1adeaba2941e3acb08cdbe22aa277b21d3398c998ef2"} err="failed to get container status \"2d2e6d46ac427293bdec1adeaba2941e3acb08cdbe22aa277b21d3398c998ef2\": rpc error: code = NotFound desc = could not find container \"2d2e6d46ac427293bdec1adeaba2941e3acb08cdbe22aa277b21d3398c998ef2\": container with ID starting with 2d2e6d46ac427293bdec1adeaba2941e3acb08cdbe22aa277b21d3398c998ef2 not found: ID does not exist" Jul 08 16:54:03.325381 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.325354 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7"] Jul 08 16:54:03.327005 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:03.326984 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5d281-676947cfc6-6zlv7"] Jul 08 16:54:05.253296 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:54:05.253261 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf8227f9-ee3c-4297-94e4-b44f4f89c48b" path="/var/lib/kubelet/pods/cf8227f9-ee3c-4297-94e4-b44f4f89c48b/volumes" Jul 08 16:55:13.299307 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.299271 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n"] Jul 08 16:55:13.299708 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.299657 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf8227f9-ee3c-4297-94e4-b44f4f89c48b" containerName="model-chainer-raw-5d281" Jul 08 16:55:13.299708 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.299668 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf8227f9-ee3c-4297-94e4-b44f4f89c48b" containerName="model-chainer-raw-5d281" Jul 08 16:55:13.299781 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.299739 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf8227f9-ee3c-4297-94e4-b44f4f89c48b" containerName="model-chainer-raw-5d281" Jul 08 16:55:13.304078 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.304061 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:13.306625 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.306598 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-3e871-serving-cert\"" Jul 08 16:55:13.306741 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.306640 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 08 16:55:13.306791 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.306747 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-3e871-kube-rbac-proxy-sar-config\"" Jul 08 16:55:13.306841 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.306794 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vkqpp\"" Jul 08 16:55:13.314285 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.314264 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n"] Jul 08 16:55:13.436376 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.436348 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3dfe0c93-941a-477c-adba-484df85df76a-proxy-tls\") pod \"model-chainer-raw-hpa-3e871-578944cc48-rhd7n\" (UID: \"3dfe0c93-941a-477c-adba-484df85df76a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:13.436517 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.436416 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dfe0c93-941a-477c-adba-484df85df76a-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-3e871-578944cc48-rhd7n\" (UID: \"3dfe0c93-941a-477c-adba-484df85df76a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:13.537766 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.537737 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dfe0c93-941a-477c-adba-484df85df76a-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-3e871-578944cc48-rhd7n\" (UID: \"3dfe0c93-941a-477c-adba-484df85df76a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:13.537865 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.537791 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3dfe0c93-941a-477c-adba-484df85df76a-proxy-tls\") pod \"model-chainer-raw-hpa-3e871-578944cc48-rhd7n\" (UID: \"3dfe0c93-941a-477c-adba-484df85df76a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:13.537914 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:55:13.537899 2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-serving-cert: secret "model-chainer-raw-hpa-3e871-serving-cert" not found Jul 08 16:55:13.537975 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:55:13.537966 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfe0c93-941a-477c-adba-484df85df76a-proxy-tls podName:3dfe0c93-941a-477c-adba-484df85df76a nodeName:}" failed. No retries permitted until 2026-07-08 16:55:14.037946998 +0000 UTC m=+1227.375871463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3dfe0c93-941a-477c-adba-484df85df76a-proxy-tls") pod "model-chainer-raw-hpa-3e871-578944cc48-rhd7n" (UID: "3dfe0c93-941a-477c-adba-484df85df76a") : secret "model-chainer-raw-hpa-3e871-serving-cert" not found Jul 08 16:55:13.538456 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:13.538440 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dfe0c93-941a-477c-adba-484df85df76a-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-3e871-578944cc48-rhd7n\" (UID: \"3dfe0c93-941a-477c-adba-484df85df76a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:14.041766 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:14.041741 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3dfe0c93-941a-477c-adba-484df85df76a-proxy-tls\") pod \"model-chainer-raw-hpa-3e871-578944cc48-rhd7n\" (UID: \"3dfe0c93-941a-477c-adba-484df85df76a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:14.043948 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:14.043923 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3dfe0c93-941a-477c-adba-484df85df76a-proxy-tls\") pod \"model-chainer-raw-hpa-3e871-578944cc48-rhd7n\" (UID: \"3dfe0c93-941a-477c-adba-484df85df76a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:14.214590 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:14.214564 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:14.341713 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:14.341638 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n"] Jul 08 16:55:14.344321 ip-10-0-131-106 kubenswrapper[2567]: W0708 16:55:14.344292 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dfe0c93_941a_477c_adba_484df85df76a.slice/crio-aa175e846fd2c7b26ac68267380a2cc424933d03df10f89e2f4d2649d07ea07e WatchSource:0}: Error finding container aa175e846fd2c7b26ac68267380a2cc424933d03df10f89e2f4d2649d07ea07e: Status 404 returned error can't find the container with id aa175e846fd2c7b26ac68267380a2cc424933d03df10f89e2f4d2649d07ea07e Jul 08 16:55:14.634389 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:14.634314 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" event={"ID":"3dfe0c93-941a-477c-adba-484df85df76a","Type":"ContainerStarted","Data":"8b1abf567bde4b653669cea36c5b9021ba4a280012ed39703bdd4c378d81b31f"} Jul 08 16:55:14.634389 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:14.634361 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" event={"ID":"3dfe0c93-941a-477c-adba-484df85df76a","Type":"ContainerStarted","Data":"aa175e846fd2c7b26ac68267380a2cc424933d03df10f89e2f4d2649d07ea07e"} Jul 08 16:55:14.634389 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:14.634390 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:14.652995 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:14.652954 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" podStartSLOduration=1.652939093 podStartE2EDuration="1.652939093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:55:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:55:14.650568193 +0000 UTC m=+1227.988492682" watchObservedRunningTime="2026-07-08 16:55:14.652939093 +0000 UTC m=+1227.990863580" Jul 08 16:55:20.644300 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:20.644265 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:23.353676 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:23.353646 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n"] Jul 08 16:55:23.354071 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:23.353839 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" podUID="3dfe0c93-941a-477c-adba-484df85df76a" containerName="model-chainer-raw-hpa-3e871" containerID="cri-o://8b1abf567bde4b653669cea36c5b9021ba4a280012ed39703bdd4c378d81b31f" gracePeriod=30 Jul 08 16:55:25.642427 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:25.642385 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" podUID="3dfe0c93-941a-477c-adba-484df85df76a" containerName="model-chainer-raw-hpa-3e871" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 16:55:30.642128 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:30.642083 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" podUID="3dfe0c93-941a-477c-adba-484df85df76a" containerName="model-chainer-raw-hpa-3e871" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 16:55:35.642832 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:35.642790 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" podUID="3dfe0c93-941a-477c-adba-484df85df76a" containerName="model-chainer-raw-hpa-3e871" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 16:55:35.643249 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:35.642910 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:40.643236 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:40.643151 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" podUID="3dfe0c93-941a-477c-adba-484df85df76a" containerName="model-chainer-raw-hpa-3e871" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 16:55:45.642989 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:45.642947 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" podUID="3dfe0c93-941a-477c-adba-484df85df76a" containerName="model-chainer-raw-hpa-3e871" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 16:55:50.642167 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:50.642130 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" podUID="3dfe0c93-941a-477c-adba-484df85df76a" containerName="model-chainer-raw-hpa-3e871" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 16:55:53.502195 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.502170 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:53.567755 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.567725 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dfe0c93-941a-477c-adba-484df85df76a-openshift-service-ca-bundle\") pod \"3dfe0c93-941a-477c-adba-484df85df76a\" (UID: \"3dfe0c93-941a-477c-adba-484df85df76a\") " Jul 08 16:55:53.567945 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.567793 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3dfe0c93-941a-477c-adba-484df85df76a-proxy-tls\") pod \"3dfe0c93-941a-477c-adba-484df85df76a\" (UID: \"3dfe0c93-941a-477c-adba-484df85df76a\") " Jul 08 16:55:53.568096 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.568069 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dfe0c93-941a-477c-adba-484df85df76a-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "3dfe0c93-941a-477c-adba-484df85df76a" (UID: "3dfe0c93-941a-477c-adba-484df85df76a"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:55:53.569827 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.569794 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dfe0c93-941a-477c-adba-484df85df76a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3dfe0c93-941a-477c-adba-484df85df76a" (UID: "3dfe0c93-941a-477c-adba-484df85df76a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:55:53.668482 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.668393 2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3dfe0c93-941a-477c-adba-484df85df76a-proxy-tls\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:55:53.668482 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.668426 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dfe0c93-941a-477c-adba-484df85df76a-openshift-service-ca-bundle\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jul 08 16:55:53.833099 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.833064 2567 generic.go:356] "Generic (PLEG): container finished" podID="3dfe0c93-941a-477c-adba-484df85df76a" containerID="8b1abf567bde4b653669cea36c5b9021ba4a280012ed39703bdd4c378d81b31f" exitCode=0 Jul 08 16:55:53.833296 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.833111 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" Jul 08 16:55:53.833296 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.833131 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" event={"ID":"3dfe0c93-941a-477c-adba-484df85df76a","Type":"ContainerDied","Data":"8b1abf567bde4b653669cea36c5b9021ba4a280012ed39703bdd4c378d81b31f"} Jul 08 16:55:53.833296 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.833183 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n" event={"ID":"3dfe0c93-941a-477c-adba-484df85df76a","Type":"ContainerDied","Data":"aa175e846fd2c7b26ac68267380a2cc424933d03df10f89e2f4d2649d07ea07e"} Jul 08 16:55:53.833296 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.833212 2567 scope.go:117] "RemoveContainer" containerID="8b1abf567bde4b653669cea36c5b9021ba4a280012ed39703bdd4c378d81b31f" Jul 08 16:55:53.842516 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.842500 2567 scope.go:117] "RemoveContainer" containerID="8b1abf567bde4b653669cea36c5b9021ba4a280012ed39703bdd4c378d81b31f" Jul 08 16:55:53.842845 ip-10-0-131-106 kubenswrapper[2567]: E0708 16:55:53.842825 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b1abf567bde4b653669cea36c5b9021ba4a280012ed39703bdd4c378d81b31f\": container with ID starting with 8b1abf567bde4b653669cea36c5b9021ba4a280012ed39703bdd4c378d81b31f not found: ID does not exist" containerID="8b1abf567bde4b653669cea36c5b9021ba4a280012ed39703bdd4c378d81b31f" Jul 08 16:55:53.842910 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.842861 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b1abf567bde4b653669cea36c5b9021ba4a280012ed39703bdd4c378d81b31f"} err="failed to get container status \"8b1abf567bde4b653669cea36c5b9021ba4a280012ed39703bdd4c378d81b31f\": rpc error: code = NotFound desc = could not find container \"8b1abf567bde4b653669cea36c5b9021ba4a280012ed39703bdd4c378d81b31f\": container with ID starting with 8b1abf567bde4b653669cea36c5b9021ba4a280012ed39703bdd4c378d81b31f not found: ID does not exist" Jul 08 16:55:53.853803 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.853769 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n"] Jul 08 16:55:53.863779 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:53.863750 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-3e871-578944cc48-rhd7n"] Jul 08 16:55:55.253742 ip-10-0-131-106 kubenswrapper[2567]: I0708 16:55:55.253702 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dfe0c93-941a-477c-adba-484df85df76a" path="/var/lib/kubelet/pods/3dfe0c93-941a-477c-adba-484df85df76a/volumes" Jul 08 17:05:42.966900 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:42.966862 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mcg99/must-gather-75tq9"] Jul 08 17:05:42.967306 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:42.967292 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dfe0c93-941a-477c-adba-484df85df76a" containerName="model-chainer-raw-hpa-3e871" Jul 08 17:05:42.967306 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:42.967304 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dfe0c93-941a-477c-adba-484df85df76a" containerName="model-chainer-raw-hpa-3e871" Jul 08 17:05:42.967387 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:42.967376 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dfe0c93-941a-477c-adba-484df85df76a" containerName="model-chainer-raw-hpa-3e871" Jul 08 17:05:42.970705 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:42.970691 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mcg99/must-gather-75tq9" Jul 08 17:05:42.973048 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:42.973019 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mcg99\"/\"kube-root-ca.crt\"" Jul 08 17:05:42.973048 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:42.973041 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mcg99\"/\"openshift-service-ca.crt\"" Jul 08 17:05:42.973991 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:42.973975 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mcg99\"/\"default-dockercfg-z6gtz\"" Jul 08 17:05:42.978813 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:42.978789 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mcg99/must-gather-75tq9"] Jul 08 17:05:43.142832 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:43.142797 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3abac6d1-16e7-40cf-ba84-26f86a0c4f8d-must-gather-output\") pod \"must-gather-75tq9\" (UID: \"3abac6d1-16e7-40cf-ba84-26f86a0c4f8d\") " pod="openshift-must-gather-mcg99/must-gather-75tq9" Jul 08 17:05:43.142832 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:43.142836 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4ns5\" (UniqueName: \"kubernetes.io/projected/3abac6d1-16e7-40cf-ba84-26f86a0c4f8d-kube-api-access-n4ns5\") pod \"must-gather-75tq9\" (UID: \"3abac6d1-16e7-40cf-ba84-26f86a0c4f8d\") " pod="openshift-must-gather-mcg99/must-gather-75tq9" Jul 08 17:05:43.243477 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:43.243435 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3abac6d1-16e7-40cf-ba84-26f86a0c4f8d-must-gather-output\") pod \"must-gather-75tq9\" (UID: \"3abac6d1-16e7-40cf-ba84-26f86a0c4f8d\") " pod="openshift-must-gather-mcg99/must-gather-75tq9" Jul 08 17:05:43.243477 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:43.243481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4ns5\" (UniqueName: \"kubernetes.io/projected/3abac6d1-16e7-40cf-ba84-26f86a0c4f8d-kube-api-access-n4ns5\") pod \"must-gather-75tq9\" (UID: \"3abac6d1-16e7-40cf-ba84-26f86a0c4f8d\") " pod="openshift-must-gather-mcg99/must-gather-75tq9" Jul 08 17:05:43.243829 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:43.243809 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3abac6d1-16e7-40cf-ba84-26f86a0c4f8d-must-gather-output\") pod \"must-gather-75tq9\" (UID: \"3abac6d1-16e7-40cf-ba84-26f86a0c4f8d\") " pod="openshift-must-gather-mcg99/must-gather-75tq9" Jul 08 17:05:43.252204 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:43.252179 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4ns5\" (UniqueName: \"kubernetes.io/projected/3abac6d1-16e7-40cf-ba84-26f86a0c4f8d-kube-api-access-n4ns5\") pod \"must-gather-75tq9\" (UID: \"3abac6d1-16e7-40cf-ba84-26f86a0c4f8d\") " pod="openshift-must-gather-mcg99/must-gather-75tq9" Jul 08 17:05:43.290241 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:43.290204 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mcg99/must-gather-75tq9" Jul 08 17:05:43.427877 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:43.427851 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mcg99/must-gather-75tq9"] Jul 08 17:05:43.430343 ip-10-0-131-106 kubenswrapper[2567]: W0708 17:05:43.430317 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3abac6d1_16e7_40cf_ba84_26f86a0c4f8d.slice/crio-46b9beb499ce9a47599ac45e56393d8713db7b97cc44a0eb3478ca2b51898169 WatchSource:0}: Error finding container 46b9beb499ce9a47599ac45e56393d8713db7b97cc44a0eb3478ca2b51898169: Status 404 returned error can't find the container with id 46b9beb499ce9a47599ac45e56393d8713db7b97cc44a0eb3478ca2b51898169 Jul 08 17:05:43.432239 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:43.432224 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:05:43.631018 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:43.630925 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mcg99/must-gather-75tq9" event={"ID":"3abac6d1-16e7-40cf-ba84-26f86a0c4f8d","Type":"ContainerStarted","Data":"46b9beb499ce9a47599ac45e56393d8713db7b97cc44a0eb3478ca2b51898169"} Jul 08 17:05:44.640837 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:44.640743 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mcg99/must-gather-75tq9" event={"ID":"3abac6d1-16e7-40cf-ba84-26f86a0c4f8d","Type":"ContainerStarted","Data":"7e7ae1d44026081f2a1830e18aa2e94c77a5deb21d75cf3b1cd06134ef4480f0"} Jul 08 17:05:44.640837 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:44.640798 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mcg99/must-gather-75tq9" event={"ID":"3abac6d1-16e7-40cf-ba84-26f86a0c4f8d","Type":"ContainerStarted","Data":"9e66804b5006a166c374c53b107fe845797882ed6f4ac9e379885795ae9fcf41"} Jul 08 17:05:44.657415 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:44.657355 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mcg99/must-gather-75tq9" podStartSLOduration=1.861491615 podStartE2EDuration="2.657340428s" totalImagesPullingTime="795.848813ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:05:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:05:44.657102649 +0000 UTC m=+1857.995027138" watchObservedRunningTime="2026-07-08 17:05:44.657340428 +0000 UTC m=+1857.995264916" Jul 08 17:05:45.769106 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:45.769080 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xrljb_560f38bc-2223-47dc-bbed-7d8750d7894a/global-pull-secret-syncer/0.log" Jul 08 17:05:45.906707 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:45.906670 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jtjn9_d8136738-b751-40ab-be2b-3d1a63f618a4/konnectivity-agent/0.log" Jul 08 17:05:45.929343 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:45.929308 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-106.ec2.internal_188ef7b029f22b3628e6f2183332d139/haproxy/0.log" Jul 08 17:05:49.688610 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:49.688574 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae571e70-0a43-4ec6-a181-b71aa96214b4/alertmanager/0.log" Jul 08 17:05:49.713409 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:49.713375 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae571e70-0a43-4ec6-a181-b71aa96214b4/config-reloader/0.log" Jul 08 17:05:49.739424 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:49.739388 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae571e70-0a43-4ec6-a181-b71aa96214b4/kube-rbac-proxy-web/0.log" Jul 08 17:05:49.761602 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:49.761575 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae571e70-0a43-4ec6-a181-b71aa96214b4/kube-rbac-proxy/0.log" Jul 08 17:05:49.794102 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:49.794077 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae571e70-0a43-4ec6-a181-b71aa96214b4/kube-rbac-proxy-metric/0.log" Jul 08 17:05:49.826348 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:49.826318 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae571e70-0a43-4ec6-a181-b71aa96214b4/prom-label-proxy/0.log" Jul 08 17:05:49.854211 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:49.854184 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae571e70-0a43-4ec6-a181-b71aa96214b4/init-config-reloader/0.log" Jul 08 17:05:49.897880 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:49.897836 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-4zkj5_0842d1ff-72b9-424d-af59-3d25ee3df89d/cluster-monitoring-operator/0.log" Jul 08 17:05:49.926266 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:49.926237 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-z6c5f_1181c031-e377-406d-a11d-0fb905e6bf89/kube-state-metrics/0.log" Jul 08 17:05:49.952519 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:49.952440 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-z6c5f_1181c031-e377-406d-a11d-0fb905e6bf89/kube-rbac-proxy-main/0.log" Jul 08 17:05:49.982548 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:49.982508 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-z6c5f_1181c031-e377-406d-a11d-0fb905e6bf89/kube-rbac-proxy-self/0.log" Jul 08 17:05:50.268312 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.268285 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qlmkv_f0101b37-fb84-42ba-8fb0-9566eb9fe2e3/node-exporter/0.log" Jul 08 17:05:50.290562 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.290517 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qlmkv_f0101b37-fb84-42ba-8fb0-9566eb9fe2e3/kube-rbac-proxy/0.log" Jul 08 17:05:50.312498 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.312470 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qlmkv_f0101b37-fb84-42ba-8fb0-9566eb9fe2e3/init-textfile/0.log" Jul 08 17:05:50.341568 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.341516 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-sjvv4_3170188e-cf8d-4f1f-a68f-85f492f7f47f/kube-rbac-proxy-main/0.log" Jul 08 17:05:50.365193 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.365152 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-sjvv4_3170188e-cf8d-4f1f-a68f-85f492f7f47f/kube-rbac-proxy-self/0.log" Jul 08 17:05:50.387703 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.387672 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-sjvv4_3170188e-cf8d-4f1f-a68f-85f492f7f47f/openshift-state-metrics/0.log" Jul 08 17:05:50.634181 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.634047 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-bfnx5_a18b9b6a-b38c-42cf-b618-c3dfd5648fa0/prometheus-operator-admission-webhook/0.log" Jul 08 17:05:50.661777 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.661746 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f9ff948c-m7pfq_73cfb596-f137-44e2-b46b-9d436b5f919f/telemeter-client/0.log" Jul 08 17:05:50.692882 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.692848 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f9ff948c-m7pfq_73cfb596-f137-44e2-b46b-9d436b5f919f/reload/0.log" Jul 08 17:05:50.761819 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.761786 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f9ff948c-m7pfq_73cfb596-f137-44e2-b46b-9d436b5f919f/kube-rbac-proxy/0.log" Jul 08 17:05:50.797571 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.797539 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b6dc7f47b-jlhqt_8e82df89-9076-4262-b727-d657a2dcc8ca/thanos-query/0.log" Jul 08 17:05:50.820217 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.820187 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b6dc7f47b-jlhqt_8e82df89-9076-4262-b727-d657a2dcc8ca/kube-rbac-proxy-web/0.log" Jul 08 17:05:50.844445 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.844410 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b6dc7f47b-jlhqt_8e82df89-9076-4262-b727-d657a2dcc8ca/kube-rbac-proxy/0.log" Jul 08 17:05:50.866019 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.865988 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b6dc7f47b-jlhqt_8e82df89-9076-4262-b727-d657a2dcc8ca/prom-label-proxy/0.log" Jul 08 17:05:50.889223 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.889144 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b6dc7f47b-jlhqt_8e82df89-9076-4262-b727-d657a2dcc8ca/kube-rbac-proxy-rules/0.log" Jul 08 17:05:50.912074 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:50.912026 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b6dc7f47b-jlhqt_8e82df89-9076-4262-b727-d657a2dcc8ca/kube-rbac-proxy-metrics/0.log" Jul 08 17:05:53.275780 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:53.275752 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9c74b957b-z4wdj_f2a6ea34-287e-4e38-ac45-76a4f2aa6b50/console/0.log" Jul 08 17:05:53.311089 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:53.311057 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-b9rh9_0a3993bc-25ec-4852-8333-0ef3d216968d/download-server/0.log" Jul 08 17:05:54.080642 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.080601 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v"] Jul 08 17:05:54.087198 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.087167 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.096137 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.096106 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v"] Jul 08 17:05:54.144017 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.143975 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-proc\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.144344 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.144323 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-lib-modules\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.144518 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.144502 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-podres\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.144700 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.144685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg4t5\" (UniqueName: \"kubernetes.io/projected/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-kube-api-access-cg4t5\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.144896 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.144879 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-sys\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.245826 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.245784 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-sys\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.246010 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.245872 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-proc\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.246010 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.245929 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-lib-modules\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.246010 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.245963 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-podres\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.246010 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.246001 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg4t5\" (UniqueName: \"kubernetes.io/projected/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-kube-api-access-cg4t5\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.246424 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.246366 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-sys\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.246424 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.246365 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-proc\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.246599 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.246434 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-podres\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.246599 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.246471 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-lib-modules\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.254579 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.254546 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg4t5\" (UniqueName: \"kubernetes.io/projected/ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e-kube-api-access-cg4t5\") pod \"perf-node-gather-daemonset-6xk4v\" (UID: \"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e\") " pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.403487 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.403389 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:54.585592 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.585555 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v"] Jul 08 17:05:54.716946 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.716910 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" event={"ID":"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e","Type":"ContainerStarted","Data":"121caefed5cf9c54238aa7e119e889e9d22d03471a184de87591672b4603b305"} Jul 08 17:05:54.785936 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.785904 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2l522_9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71/dns/0.log" Jul 08 17:05:54.809846 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.809820 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2l522_9590cf9d-5a23-4ab4-8b62-ce4a5bb85e71/kube-rbac-proxy/0.log" Jul 08 17:05:54.932842 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:54.932764 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7b6vx_b3c1f306-e11e-46e6-8ac6-e96e6652587d/dns-node-resolver/0.log" Jul 08 17:05:55.499602 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:55.499569 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-58tpf_84099618-1b2d-4ae6-adbb-28141b6cde6d/node-ca/0.log" Jul 08 17:05:55.724833 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:55.724800 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" event={"ID":"ebdd678a-4f0a-49b8-aec2-82fe7c75ff5e","Type":"ContainerStarted","Data":"587185cfa17440de87304763f73f7fcd255da3cc557e931a0408b94297e78491"} Jul 08 17:05:55.725000 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:55.724923 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:05:55.741277 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:55.741225 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" podStartSLOduration=1.741208171 podStartE2EDuration="1.741208171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:05:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:05:55.740115972 +0000 UTC m=+1869.078040461" watchObservedRunningTime="2026-07-08 17:05:55.741208171 +0000 UTC m=+1869.079132714" Jul 08 17:05:56.459993 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:56.459961 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6879d7ccd5-7jg6n_cb54e00d-1b8f-4cc4-8eb6-ba3b50c56b96/router/0.log" Jul 08 17:05:56.852847 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:56.852814 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-82djv_cea34dd4-9352-469b-a435-2e373be078d4/serve-healthcheck-canary/0.log" Jul 08 17:05:57.360126 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:57.360095 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f57rh_5be7c8c6-981e-4353-81d9-38135fe81075/kube-rbac-proxy/0.log" Jul 08 17:05:57.379595 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:57.379555 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f57rh_5be7c8c6-981e-4353-81d9-38135fe81075/exporter/0.log" Jul 08 17:05:57.403374 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:57.403338 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f57rh_5be7c8c6-981e-4353-81d9-38135fe81075/extractor/0.log" Jul 08 17:05:59.588454 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:59.588424 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-c8c545f5f-h9266_b7f3fdfc-5660-491b-aa25-4928f4143d96/manager/0.log" Jul 08 17:05:59.633797 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:59.633772 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-ttdp7_b8578510-1e2d-4e33-be42-030bd5176600/server/0.log" Jul 08 17:05:59.785612 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:05:59.785579 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-c9bbr_f4e3f64f-4685-4166-8659-89e03f0d5699/manager/0.log" Jul 08 17:06:01.743871 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:01.743839 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mcg99/perf-node-gather-daemonset-6xk4v" Jul 08 17:06:04.158330 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:04.158255 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j775w_f463ee9f-e90b-48dc-86b6-4ab9bf01d298/migrator/0.log" Jul 08 17:06:04.179342 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:04.179316 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j775w_f463ee9f-e90b-48dc-86b6-4ab9bf01d298/graceful-termination/0.log" Jul 08 17:06:04.498345 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:04.498310 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-8pxcn_4e55c310-80cc-43db-8a8e-bbc970dd7fbf/kube-storage-version-migrator-operator/1.log" Jul 08 17:06:04.500212 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:04.500186 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-8pxcn_4e55c310-80cc-43db-8a8e-bbc970dd7fbf/kube-storage-version-migrator-operator/0.log" Jul 08 17:06:05.765369 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:05.765341 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxqqv_03cd9c94-0548-4f48-b538-e406e0c32b7f/kube-multus-additional-cni-plugins/0.log" Jul 08 17:06:05.792833 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:05.792799 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxqqv_03cd9c94-0548-4f48-b538-e406e0c32b7f/egress-router-binary-copy/0.log" Jul 08 17:06:05.819416 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:05.819383 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxqqv_03cd9c94-0548-4f48-b538-e406e0c32b7f/cni-plugins/0.log" Jul 08 17:06:05.843176 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:05.843087 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxqqv_03cd9c94-0548-4f48-b538-e406e0c32b7f/bond-cni-plugin/0.log" Jul 08 17:06:05.868909 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:05.868878 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxqqv_03cd9c94-0548-4f48-b538-e406e0c32b7f/routeoverride-cni/0.log" Jul 08 17:06:05.895411 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:05.895379 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxqqv_03cd9c94-0548-4f48-b538-e406e0c32b7f/whereabouts-cni-bincopy/0.log" Jul 08 17:06:05.922766 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:05.922736 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cxqqv_03cd9c94-0548-4f48-b538-e406e0c32b7f/whereabouts-cni/0.log" Jul 08 17:06:06.141769 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:06.141727 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gbwgs_c8f78dae-70ef-428f-898f-49da806d8912/kube-multus/0.log" Jul 08 17:06:06.287854 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:06.287828 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t6fms_31bdf910-65ce-489b-ba71-64d9080e8443/network-metrics-daemon/0.log" Jul 08 17:06:06.312422 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:06.312399 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t6fms_31bdf910-65ce-489b-ba71-64d9080e8443/kube-rbac-proxy/0.log" Jul 08 17:06:07.564782 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:07.564753 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6nhn_b8f20d10-33c9-46ef-b331-51e7ce568566/ovn-controller/0.log" Jul 08 17:06:07.581261 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:07.581231 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6nhn_b8f20d10-33c9-46ef-b331-51e7ce568566/ovn-acl-logging/0.log" Jul 08 17:06:07.612088 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:07.612049 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6nhn_b8f20d10-33c9-46ef-b331-51e7ce568566/kube-rbac-proxy-node/0.log" Jul 08 17:06:07.642269 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:07.642241 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6nhn_b8f20d10-33c9-46ef-b331-51e7ce568566/kube-rbac-proxy-ovn-metrics/0.log" Jul 08 17:06:07.660094 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:07.660068 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6nhn_b8f20d10-33c9-46ef-b331-51e7ce568566/northd/0.log" Jul 08 17:06:07.683176 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:07.683147 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6nhn_b8f20d10-33c9-46ef-b331-51e7ce568566/nbdb/0.log" Jul 08 17:06:07.706312 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:07.706282 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6nhn_b8f20d10-33c9-46ef-b331-51e7ce568566/sbdb/0.log" Jul 08 17:06:07.765003 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:07.764967 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6nhn_b8f20d10-33c9-46ef-b331-51e7ce568566/ovnkube-controller/0.log" Jul 08 17:06:08.769649 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:08.769572 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ntrb9_5938b63a-f2f4-4903-b7ad-bacf3f4c10b5/network-check-target-container/0.log" Jul 08 17:06:09.769540 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:09.769497 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-fsmqh_1fd27338-5a40-47d4-83e0-a1b0097d74db/iptables-alerter/0.log" Jul 08 17:06:10.382504 ip-10-0-131-106 kubenswrapper[2567]: I0708 17:06:10.382467 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-ct2c8_91bdeead-c876-46c5-9ca6-d6bdfa439db7/tuned/0.log"