Jul 15 10:07:35.079061 ip-10-0-128-144 systemd[1]: Starting Kubernetes Kubelet... Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.698505 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702063 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702074 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702078 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702082 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702086 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702089 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702092 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 10:07:37.828515 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702095 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 10:07:37.775438 ip-10-0-128-144 systemd[1]: Started Kubernetes Kubelet. Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702098 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702101 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702104 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702106 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702109 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702111 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702114 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702117 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702120 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702123 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702125 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702128 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702133 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702136 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702140 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702143 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702146 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702149 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 10:07:37.829611 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702152 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702155 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702158 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702161 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702164 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702166 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702169 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702171 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702174 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702177 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702179 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702182 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702185 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702187 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702190 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702192 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702195 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702198 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702200 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702203 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 10:07:37.830969 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702205 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702208 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702210 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702213 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702217 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702220 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702223 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702225 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702230 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702234 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702237 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702239 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702242 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702246 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702250 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702253 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702256 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702259 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702262 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702264 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 10:07:37.831765 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702267 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702270 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702273 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702275 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702277 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702280 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702283 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702285 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702288 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702292 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702295 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702297 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702300 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702302 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702305 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702308 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702311 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702314 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702316 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 10:07:37.832451 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702319 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702321 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702324 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702326 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702329 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702332 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702335 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702338 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702340 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702343 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702346 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702349 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702351 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.702354 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703063 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703070 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703073 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703075 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703078 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703087 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 10:07:37.833054 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703090 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703094 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703096 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703099 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703102 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703104 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703107 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703110 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703112 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703115 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703118 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703120 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703123 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703126 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703128 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703131 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703133 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703136 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703139 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703141 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 10:07:37.833686 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703144 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703147 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703150 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703152 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703155 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703158 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703160 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703163 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703165 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703170 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703173 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703176 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703186 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703189 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703191 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703194 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703197 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703199 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703202 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 10:07:37.834485 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703204 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703207 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703209 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703212 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703214 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703217 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703219 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703221 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703224 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703226 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703229 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703232 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703235 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703237 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703240 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703244 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703248 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703251 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703254 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703257 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 10:07:37.835390 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703260 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703262 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703266 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703270 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703273 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703275 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703281 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703284 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703287 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703289 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703292 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703294 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703297 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703299 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703301 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703304 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703306 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703309 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703311 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 10:07:37.836016 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703314 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703317 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703319 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703322 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703325 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703327 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703330 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703333 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703336 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703338 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703341 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703344 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703346 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703349 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703351 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703747 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703752 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703757 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703760 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 10:07:37.836563 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703764 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703767 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703770 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703773 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703777 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703780 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703782 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703785 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703788 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703790 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703793 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703796 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703799 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703801 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703803 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703806 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703809 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703812 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703814 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703817 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 10:07:37.837136 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703820 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703823 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703825 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703828 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703831 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703833 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703836 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703840 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703844 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703846 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703849 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703852 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703854 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703858 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703860 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703863 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703865 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703868 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703870 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703872 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 10:07:37.837812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703877 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703880 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703882 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703884 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703887 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703889 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703892 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703894 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703897 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703899 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703902 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703905 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703907 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703910 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703912 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703914 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703917 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703919 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703936 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 10:07:37.838582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703939 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703942 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703944 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703947 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703950 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703952 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703955 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703958 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703961 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703963 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703966 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703969 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703971 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703974 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703977 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703979 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703981 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703984 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703986 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703990 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 10:07:37.839209 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703993 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.703995 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704000 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704003 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704006 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704008 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704010 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704013 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704015 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704018 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704021 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704023 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704026 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704028 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704031 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704034 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704108 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704115 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704130 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704137 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704144 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 10:07:37.839881 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704148 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704156 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704160 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704163 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704167 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704170 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704173 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704177 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704180 2580 flags.go:64] FLAG: --cgroup-root="" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704183 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704186 2580 flags.go:64] FLAG: --client-ca-file="" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704189 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704192 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704198 2580 flags.go:64] FLAG: --cluster-domain="" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704201 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704204 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704207 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704210 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704214 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704217 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704220 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704224 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704227 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704230 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 10:07:37.841040 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704233 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704236 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704239 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704244 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704247 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704249 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704252 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704255 2580 flags.go:64] FLAG: --enable-server="true" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704258 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704264 2580 flags.go:64] FLAG: --event-burst="100" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704267 2580 flags.go:64] FLAG: --event-qps="50" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704270 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704273 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704276 2580 flags.go:64] FLAG: --eviction-hard="" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704279 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704282 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704285 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704288 2580 flags.go:64] FLAG: --eviction-soft="" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704291 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704294 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704298 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704302 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704304 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704307 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704310 2580 flags.go:64] FLAG: --feature-gates="" Jul 15 10:07:37.843395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704314 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704317 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704320 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704323 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704326 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704329 2580 flags.go:64] FLAG: --help="false" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704332 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-128-144.ec2.internal" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704335 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704338 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704341 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704344 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704348 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704351 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704354 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704356 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704359 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704364 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704367 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704370 2580 flags.go:64] FLAG: --kube-reserved="" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704373 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704375 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704378 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704381 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704384 2580 flags.go:64] FLAG: --lock-file="" Jul 15 10:07:37.844967 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704387 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704390 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704393 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704398 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704402 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704405 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704407 2580 flags.go:64] FLAG: --logging-format="text" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704410 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704413 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704416 2580 flags.go:64] FLAG: --manifest-url="" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704419 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704423 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704426 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704431 2580 flags.go:64] FLAG: --max-pods="110" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704434 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704437 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704440 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704443 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704446 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704449 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704451 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704458 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704461 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704464 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 10:07:37.845963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704469 2580 flags.go:64] FLAG: --pod-cidr="" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704472 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704477 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704480 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704483 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704486 2580 flags.go:64] FLAG: --port="10250" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704489 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704492 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bc4433444f215462" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704495 2580 flags.go:64] FLAG: --qos-reserved="" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704498 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704501 2580 flags.go:64] FLAG: --register-node="true" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704504 2580 flags.go:64] FLAG: --register-with-taints="" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704508 2580 flags.go:64] FLAG: --registry-burst="10" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704511 2580 flags.go:64] FLAG: --registry-qps="5" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704514 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704516 2580 flags.go:64] FLAG: --reserved-memory="" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704520 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704523 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704527 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704530 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704533 2580 flags.go:64] FLAG: --runonce="false" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704536 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704539 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704542 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704544 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 10:07:37.847133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704547 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704550 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704553 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704557 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704560 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704563 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704566 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704568 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704573 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704576 2580 flags.go:64] FLAG: --system-cgroups="" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704579 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704584 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704587 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704590 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704594 2580 flags.go:64] FLAG: --tls-min-version="" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704597 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704600 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704602 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704605 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704610 2580 flags.go:64] FLAG: --v="2" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704613 2580 flags.go:64] FLAG: --version="false" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704617 2580 flags.go:64] FLAG: --vmodule="" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704621 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.704624 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704749 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 10:07:37.848004 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704753 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704756 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704759 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704762 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704765 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704767 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704770 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704772 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704775 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704777 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704780 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704782 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704785 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704787 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704790 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704794 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704797 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704800 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704803 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704805 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 10:07:37.848690 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704807 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704810 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704812 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704816 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704820 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704823 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704828 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704830 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704833 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704836 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704838 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704842 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704846 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704849 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704851 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704854 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704856 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704859 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 10:07:38.026776 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704861 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704864 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704867 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704869 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704872 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704874 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704877 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704881 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704884 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704889 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704892 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704895 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704898 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704901 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704904 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704906 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704909 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704912 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704914 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 10:07:38.042582 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704917 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704921 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704936 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704938 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704941 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704943 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704946 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704949 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704951 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704954 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704957 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704959 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704962 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704965 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704968 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704971 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704973 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704976 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704978 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704981 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 10:07:38.043455 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704983 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704986 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704990 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704992 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704995 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.704998 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705001 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705004 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705007 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705009 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705012 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705014 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705017 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705021 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705023 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705026 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705028 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705031 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705033 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705036 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 10:07:38.044356 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.705038 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.705044 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.713756 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.713773 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.713793 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.713799 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713874 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713879 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713882 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713885 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713888 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713891 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713893 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713896 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713899 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 10:07:38.045244 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713901 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713904 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713907 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713909 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713912 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713915 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713918 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713942 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713946 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713949 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713952 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713954 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713957 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713959 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713962 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713965 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713967 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713970 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713973 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713976 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 10:07:38.045908 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713989 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713993 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713996 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.713999 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714001 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714004 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714007 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714010 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714012 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714015 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714017 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714020 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714023 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714025 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714028 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714032 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714035 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714038 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714041 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714046 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 10:07:38.047214 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714048 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714051 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714054 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714056 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714059 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714062 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714065 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714069 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714071 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714074 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714077 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714086 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714089 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714098 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714101 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714104 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714107 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714109 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714112 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714115 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 10:07:38.050218 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714118 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714120 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714123 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714126 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714128 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714131 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714133 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714136 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714138 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714141 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714144 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714148 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714151 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714153 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714156 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714159 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714161 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714164 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714166 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 10:07:38.051087 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714169 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714171 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714174 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714176 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714179 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714182 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714184 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714193 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714195 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714198 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714200 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.714206 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714365 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714371 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714375 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 10:07:38.052366 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714379 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714382 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714385 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714388 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714391 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714394 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714396 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714401 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714404 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714406 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714411 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714414 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714417 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714420 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714423 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714425 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714428 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714430 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714433 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714436 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 10:07:38.053446 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714438 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714440 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714443 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714445 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714448 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714456 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714459 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714461 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714463 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714466 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714468 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714471 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714474 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714476 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714478 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714481 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714483 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714486 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714488 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714492 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 10:07:38.054503 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714495 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714497 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714501 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714504 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714508 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714511 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714514 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714516 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714519 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714522 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714525 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714528 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714531 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714534 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714536 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714539 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714541 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714544 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714553 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 10:07:38.055377 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714556 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714559 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714561 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714565 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714568 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714571 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714574 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714577 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714580 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714583 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714585 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714588 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714593 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714595 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714598 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714601 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714604 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714606 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714609 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714611 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 10:07:38.056444 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714614 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714617 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714619 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714622 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714624 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714627 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714629 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714632 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714634 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714637 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714639 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714642 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714650 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714653 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714655 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714657 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 10:07:38.057519 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:37.714660 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 10:07:38.058584 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.714665 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 10:07:38.058584 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.714786 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 10:07:38.058584 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.717709 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 10:07:38.058584 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.719575 2580 server.go:1019] "Starting client certificate rotation" Jul 15 10:07:38.058584 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.719678 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 10:07:38.058584 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.719711 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 10:07:38.058584 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.722306 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 10:07:38.058584 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.724869 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 10:07:38.058584 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.738291 2580 log.go:25] "Validated CRI v1 runtime API" Jul 15 10:07:38.058584 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.740348 2580 log.go:25] "Validated CRI v1 image API" Jul 15 10:07:38.058584 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.741843 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 10:07:38.058584 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.745374 2580 fs.go:135] Filesystem UUIDs: map[5d0cc167-7d2f-4974-97bd-f0dfaa4b491c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fc1b7f70-d4dd-40d0-b5c6-4710c582bd7e:/dev/nvme0n1p4] Jul 15 10:07:38.059230 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.745391 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 10:07:38.059230 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.749247 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.751010 2580 manager.go:216] Machine: {Timestamp:2026-07-15 10:07:37.750516412 +0000 UTC m=+0.336183736 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104900 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b50dfa202a97e2698d9d36dd46cde SystemUUID:ec2b50df-a202-a97e-2698-d9d36dd46cde BootID:588daa70-0520-4c1c-a2c2-c882edc43995 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:71:58:7f:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:71:58:7f:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:28:37:09:e7:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.751101 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.751186 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.753779 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.753809 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-144.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.754512 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.754522 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.754529 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.754540 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.755586 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.758303 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.758432 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.758460 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.758471 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.758489 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.758501 2580 kubelet.go:398] "Adding apiserver pod source" Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.758510 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 10:07:38.059869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.758875 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.758889 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.766818 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.769457 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.769500 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.770238 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.770256 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.770262 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.770268 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.770276 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.770283 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.770291 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.770297 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.770305 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.770311 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.770320 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.770325 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.771075 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.771084 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.772110 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dpldt" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:37.772558 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:37.772571 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.774483 2580 server.go:1268] "Started kubelet" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.774567 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.774711 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.774777 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.776075 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.777707 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.777869 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dpldt" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:37.781501 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.782401 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.782408 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:37.782466 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.782912 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.782941 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.783056 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.783064 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.783214 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.783248 2580 factory.go:55] Registering systemd factory Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.783263 2580 factory.go:223] Registration of the systemd container factory successfully Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.783477 2580 factory.go:153] Registering CRI-O factory Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.783492 2580 factory.go:223] Registration of the crio container factory successfully Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.783537 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.783555 2580 factory.go:103] Registering Raw factory Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.783569 2580 manager.go:1196] Started watching for new ooms in manager Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.785074 2580 manager.go:349] Starting recovery of all containers Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.787485 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:37.793118 2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-144.ec2.internal\" not found" node="ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.061153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.794820 2580 manager.go:354] Recovery completed Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.795585 2580 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-144.ec2.internal" not found Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.802643 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.804425 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.804448 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.804458 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.804988 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.804988 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.805018 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.805035 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.805655 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.805678 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.805688 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.806238 2580 policy_none.go:49] "None policy: Start" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.806250 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.806261 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.807321 2580 policy_none.go:47] "Start" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.811279 2580 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-144.ec2.internal" not found Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.863553 2580 manager.go:337] "Starting Device Plugin manager" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:37.863585 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.863595 2580 server.go:87] "Starting device plugin registration server" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.863857 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.863868 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.863969 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.864044 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.864053 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:37.864665 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:37.864704 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.870751 2580 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-144.ec2.internal" not found Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.964163 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.966087 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.966117 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.966128 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.966155 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.979485 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:37.979508 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-144.ec2.internal\": node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.980536 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.981829 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.981877 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.981899 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:37.981949 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:37.984768 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 10:07:38.063129 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:38.035156 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.082217 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal"] Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.082321 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.083419 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.083448 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.083461 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.084712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b107ab28aa0bcaf4bbc363b6b4563c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal\" (UID: \"8b107ab28aa0bcaf4bbc363b6b4563c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.084740 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b107ab28aa0bcaf4bbc363b6b4563c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal\" (UID: \"8b107ab28aa0bcaf4bbc363b6b4563c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.084948 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.085018 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.085054 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.085766 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.085788 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.085798 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.085821 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.085844 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.085856 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.086942 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.086963 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.087642 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.087667 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.087680 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:38.124678 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-144.ec2.internal\" not found" node="ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:38.129233 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-144.ec2.internal\" not found" node="ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:38.135221 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.185171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b107ab28aa0bcaf4bbc363b6b4563c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal\" (UID: \"8b107ab28aa0bcaf4bbc363b6b4563c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.185199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b107ab28aa0bcaf4bbc363b6b4563c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal\" (UID: \"8b107ab28aa0bcaf4bbc363b6b4563c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.185225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0124dca64ed1505b90e32949bfca1c08-config\") pod \"kube-apiserver-proxy-ip-10-0-128-144.ec2.internal\" (UID: \"0124dca64ed1505b90e32949bfca1c08\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.208618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.185265 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b107ab28aa0bcaf4bbc363b6b4563c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal\" (UID: \"8b107ab28aa0bcaf4bbc363b6b4563c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.209621 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.185290 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b107ab28aa0bcaf4bbc363b6b4563c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal\" (UID: \"8b107ab28aa0bcaf4bbc363b6b4563c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.364258 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:38.235471 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:38.364258 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.285998 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0124dca64ed1505b90e32949bfca1c08-config\") pod \"kube-apiserver-proxy-ip-10-0-128-144.ec2.internal\" (UID: \"0124dca64ed1505b90e32949bfca1c08\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.364258 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.286044 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0124dca64ed1505b90e32949bfca1c08-config\") pod \"kube-apiserver-proxy-ip-10-0-128-144.ec2.internal\" (UID: \"0124dca64ed1505b90e32949bfca1c08\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.364258 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:38.336128 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:38.505133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.426586 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.505133 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:38.436659 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:38.505133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.440813 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" Jul 15 10:07:38.642227 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:38.537010 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:38.642227 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:38.637586 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:38.802569 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.719057 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 10:07:38.802569 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.719261 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 10:07:38.802569 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.719273 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 10:07:38.802569 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:38.738466 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:38.802569 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.783043 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 10:02:37 +0000 UTC" deadline="2028-03-11 22:43:00.73773148 +0000 UTC" Jul 15 10:07:38.802569 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.783187 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14532h35m21.954548936s" Jul 15 10:07:38.839425 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:38.839395 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:38.896796 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:38.896720 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 10:07:38.940053 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:38.940018 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:39.040788 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:39.040751 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:39.076920 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:39.076883 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b107ab28aa0bcaf4bbc363b6b4563c3.slice/crio-37cf8c1d019b666707635ebcac29673b3bf15845efd5c13859e4d092855fe9fe WatchSource:0}: Error finding container 37cf8c1d019b666707635ebcac29673b3bf15845efd5c13859e4d092855fe9fe: Status 404 returned error can't find the container with id 37cf8c1d019b666707635ebcac29673b3bf15845efd5c13859e4d092855fe9fe Jul 15 10:07:39.077224 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:39.077201 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0124dca64ed1505b90e32949bfca1c08.slice/crio-2a8a2447e40765181f9d9fe0ec5516428c060f30b91ccb7683b068dba9042325 WatchSource:0}: Error finding container 2a8a2447e40765181f9d9fe0ec5516428c060f30b91ccb7683b068dba9042325: Status 404 returned error can't find the container with id 2a8a2447e40765181f9d9fe0ec5516428c060f30b91ccb7683b068dba9042325 Jul 15 10:07:39.082277 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.082262 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 10:07:39.141131 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:39.141086 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:39.241770 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:39.241699 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:39.342361 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:39.342322 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 15 10:07:39.356189 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.356168 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 10:07:39.383239 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.383210 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" Jul 15 10:07:39.393476 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.393458 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 10:07:39.394376 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.394364 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 15 10:07:39.403776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.403761 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 10:07:39.688813 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.688731 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 10:07:39.760372 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.760338 2580 apiserver.go:52] "Watching apiserver" Jul 15 10:07:39.768225 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.768193 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 10:07:39.768596 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.768573 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-jbtcn","openshift-network-diagnostics/network-check-target-zvvh9","openshift-network-operator/iptables-alerter-lg7t8","openshift-ovn-kubernetes/ovnkube-node-bkhzv","kube-system/konnectivity-agent-rrjcd","kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2","openshift-image-registry/node-ca-zdcrg","openshift-multus/multus-additional-cni-plugins-5l4zn","openshift-multus/multus-mwqr5","kube-system/global-pull-secret-syncer-vhn9t","openshift-cluster-node-tuning-operator/tuned-r6267","openshift-dns/node-resolver-lxhkh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal"] Jul 15 10:07:39.771326 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.771296 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rrjcd" Jul 15 10:07:39.774094 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.774069 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kz98l\"" Jul 15 10:07:39.774198 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.774156 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 10:07:39.774529 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.774504 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.774529 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.774521 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 10:07:39.777889 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.776860 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 10:07:39.777889 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.776883 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 10:07:39.777889 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.777011 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q67z8\"" Jul 15 10:07:39.777889 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.777125 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 10:07:39.777889 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.777559 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.779879 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.779838 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 10:07:39.779984 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.779879 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 10:07:39.779984 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.779883 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-489zj\"" Jul 15 10:07:39.779984 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.779965 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 10:07:39.780293 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.780273 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:39.780394 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:39.780343 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:07:39.780613 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.780592 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 10:07:39.780680 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.780593 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 10:07:39.780680 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.780675 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 10:07:39.782624 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.782598 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lg7t8" Jul 15 10:07:39.783061 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.783043 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 10:07:39.784757 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.784740 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 10:07:39.784849 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.784805 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 10:07:39.784849 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.784835 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 10:07:39.784977 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.784962 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bznnf\"" Jul 15 10:07:39.785358 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.785340 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:39.785448 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:39.785427 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:07:39.787825 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.787796 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zdcrg" Jul 15 10:07:39.790332 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.790013 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:39.790508 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.790491 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 10:07:39.790658 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.790643 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 10:07:39.790726 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.790676 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 10:07:39.790726 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.790713 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6chct\"" Jul 15 10:07:39.792014 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.791998 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 10:07:39.792298 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.792282 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 10:07:39.792395 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.792320 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.792452 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.792418 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 10:07:39.792503 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.792474 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dqrs6\"" Jul 15 10:07:39.792818 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.792801 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 10:07:39.793029 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.793017 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 10:07:39.794162 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.794141 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 10:07:39.794555 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.794464 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p4zvq\"" Jul 15 10:07:39.794875 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.794858 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.794982 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.794887 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f999c8ca-9638-4bae-93a8-52743104c377-agent-certs\") pod \"konnectivity-agent-rrjcd\" (UID: \"f999c8ca-9638-4bae-93a8-52743104c377\") " pod="kube-system/konnectivity-agent-rrjcd" Jul 15 10:07:39.794982 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.794952 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbfl8\" (UniqueName: \"kubernetes.io/projected/f0c4f627-7172-40cc-be6f-e51950a86868-kube-api-access-pbfl8\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.795104 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795003 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:39.795104 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:39.795058 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:07:39.795104 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795000 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-kubelet\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.795284 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795111 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-ovn-node-metrics-cert\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.795284 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z267q\" (UniqueName: \"kubernetes.io/projected/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-kube-api-access-z267q\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.795284 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795169 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.795284 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795197 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-socket-dir\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.795284 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-env-overrides\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.795284 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-cni-netd\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.795284 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-ovnkube-config\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.795284 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zwwm\" (UniqueName: \"kubernetes.io/projected/916c2a1c-c547-4f49-b00e-634ca84eb08e-kube-api-access-6zwwm\") pod \"iptables-alerter-lg7t8\" (UID: \"916c2a1c-c547-4f49-b00e-634ca84eb08e\") " pod="openshift-network-operator/iptables-alerter-lg7t8" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795303 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff2rf\" (UniqueName: \"kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf\") pod \"network-check-target-zvvh9\" (UID: \"012026aa-ec92-4600-930b-1bf89b1f1653\") " pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795318 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-etc-openvswitch\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/916c2a1c-c547-4f49-b00e-634ca84eb08e-iptables-alerter-script\") pod \"iptables-alerter-lg7t8\" (UID: \"916c2a1c-c547-4f49-b00e-634ca84eb08e\") " pod="openshift-network-operator/iptables-alerter-lg7t8" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795369 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-registration-dir\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795395 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-device-dir\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-etc-selinux\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795445 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-systemd-units\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795480 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-run-netns\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795504 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-var-lib-openvswitch\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795529 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-ovnkube-script-lib\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795551 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs\") pod \"network-metrics-daemon-jbtcn\" (UID: \"318fb46e-f43b-48f1-8fc3-07f871da0b1e\") " pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f999c8ca-9638-4bae-93a8-52743104c377-konnectivity-ca\") pod \"konnectivity-agent-rrjcd\" (UID: \"f999c8ca-9638-4bae-93a8-52743104c377\") " pod="kube-system/konnectivity-agent-rrjcd" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-sys-fs\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795633 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-log-socket\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.795662 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795654 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/916c2a1c-c547-4f49-b00e-634ca84eb08e-host-slash\") pod \"iptables-alerter-lg7t8\" (UID: \"916c2a1c-c547-4f49-b00e-634ca84eb08e\") " pod="openshift-network-operator/iptables-alerter-lg7t8" Jul 15 10:07:39.796342 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795680 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-run-systemd\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.796342 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795702 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-run-ovn\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.796342 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795724 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-node-log\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.796342 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-run-ovn-kubernetes\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.796342 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bb4z\" (UniqueName: \"kubernetes.io/projected/318fb46e-f43b-48f1-8fc3-07f871da0b1e-kube-api-access-6bb4z\") pod \"network-metrics-daemon-jbtcn\" (UID: \"318fb46e-f43b-48f1-8fc3-07f871da0b1e\") " pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:39.796342 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795823 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-slash\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.796342 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795857 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-run-openvswitch\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.796342 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.795879 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-cni-bin\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.797379 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.797358 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.797642 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.797618 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 10:07:39.799481 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.799458 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 10:07:39.799570 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.799501 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 10:07:39.799570 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.799531 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-55b56\"" Jul 15 10:07:39.799828 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.799809 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lxhkh" Jul 15 10:07:39.801809 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.801791 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 10:07:39.802021 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.802006 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pvcq8\"" Jul 15 10:07:39.802109 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.802052 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 10:07:39.820273 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.820242 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmwpt" Jul 15 10:07:39.825986 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.825969 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmwpt" Jul 15 10:07:39.884147 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.884118 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 10:07:39.896547 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896522 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.896687 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896562 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/738da552-87c0-4b57-9a12-3de99011fb3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:39.896687 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896584 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skltw\" (UniqueName: \"kubernetes.io/projected/fd8d9e78-4582-40da-8104-cebed9aab183-kube-api-access-skltw\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.896687 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-kubernetes\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.896687 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896654 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-systemd\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.896687 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896662 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.896687 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896672 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-hostroot\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.896971 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896721 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-sysctl-d\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.896971 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896748 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-tuned\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.896971 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a6aceba-caa7-4a51-a6c8-d958eab077b4-tmp\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.896971 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896797 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/738da552-87c0-4b57-9a12-3de99011fb3c-os-release\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:39.896971 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-multus-socket-dir-parent\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.896971 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896847 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-var-lib-cni-bin\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.896971 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896874 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-device-dir\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.896971 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-systemd-units\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.896971 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896956 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-run-netns\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896977 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-device-dir\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896988 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-systemd-units\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.896993 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/756700bc-c6f9-4a06-8fc2-aae762d968c3-host\") pod \"node-ca-zdcrg\" (UID: \"756700bc-c6f9-4a06-8fc2-aae762d968c3\") " pod="openshift-image-registry/node-ca-zdcrg" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897015 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-run-netns\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-modprobe-d\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897045 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-etc-kubernetes\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-sys-fs\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-log-socket\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897165 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-log-socket\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/916c2a1c-c547-4f49-b00e-634ca84eb08e-host-slash\") pod \"iptables-alerter-lg7t8\" (UID: \"916c2a1c-c547-4f49-b00e-634ca84eb08e\") " pod="openshift-network-operator/iptables-alerter-lg7t8" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897218 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-sys-fs\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897257 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/916c2a1c-c547-4f49-b00e-634ca84eb08e-host-slash\") pod \"iptables-alerter-lg7t8\" (UID: \"916c2a1c-c547-4f49-b00e-634ca84eb08e\") " pod="openshift-network-operator/iptables-alerter-lg7t8" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897255 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-system-cni-dir\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.897308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-var-lib-cni-multus\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bb4z\" (UniqueName: \"kubernetes.io/projected/318fb46e-f43b-48f1-8fc3-07f871da0b1e-kube-api-access-6bb4z\") pod \"network-metrics-daemon-jbtcn\" (UID: \"318fb46e-f43b-48f1-8fc3-07f871da0b1e\") " pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897345 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twkss\" (UniqueName: \"kubernetes.io/projected/4a6aceba-caa7-4a51-a6c8-d958eab077b4-kube-api-access-twkss\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897373 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/738da552-87c0-4b57-9a12-3de99011fb3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-multus-conf-dir\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897524 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-cni-bin\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897590 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-cni-bin\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897592 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fd8d9e78-4582-40da-8104-cebed9aab183-multus-daemon-config\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897667 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897693 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f999c8ca-9638-4bae-93a8-52743104c377-agent-certs\") pod \"konnectivity-agent-rrjcd\" (UID: \"f999c8ca-9638-4bae-93a8-52743104c377\") " pod="kube-system/konnectivity-agent-rrjcd" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897718 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-ovn-node-metrics-cert\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897745 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z267q\" (UniqueName: \"kubernetes.io/projected/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-kube-api-access-z267q\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897798 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897843 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81869c04-f7bf-4cc7-81e2-c7279e070c38-dbus\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-run-netns\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.897992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897906 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-socket-dir\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-env-overrides\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897968 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-sysctl-conf\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.897989 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-lib-modules\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/738da552-87c0-4b57-9a12-3de99011fb3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898039 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-run-k8s-cni-cncf-io\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898120 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-socket-dir\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898123 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898160 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-var-lib-kubelet\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898184 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-cni-netd\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898242 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-ovnkube-config\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898294 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-cni-netd\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898317 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zwwm\" (UniqueName: \"kubernetes.io/projected/916c2a1c-c547-4f49-b00e-634ca84eb08e-kube-api-access-6zwwm\") pod \"iptables-alerter-lg7t8\" (UID: \"916c2a1c-c547-4f49-b00e-634ca84eb08e\") " pod="openshift-network-operator/iptables-alerter-lg7t8" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff2rf\" (UniqueName: \"kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf\") pod \"network-check-target-zvvh9\" (UID: \"012026aa-ec92-4600-930b-1bf89b1f1653\") " pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898357 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-sysconfig\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-run\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-var-lib-kubelet\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.898772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898420 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/738da552-87c0-4b57-9a12-3de99011fb3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898425 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-env-overrides\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898451 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-etc-openvswitch\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/916c2a1c-c547-4f49-b00e-634ca84eb08e-iptables-alerter-script\") pod \"iptables-alerter-lg7t8\" (UID: \"916c2a1c-c547-4f49-b00e-634ca84eb08e\") " pod="openshift-network-operator/iptables-alerter-lg7t8" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-sys\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898535 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-host\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898559 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bd6de8e-5daf-4e9f-b0e7-f149908e966b-hosts-file\") pod \"node-resolver-lxhkh\" (UID: \"2bd6de8e-5daf-4e9f-b0e7-f149908e966b\") " pod="openshift-dns/node-resolver-lxhkh" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898582 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-multus-cni-dir\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-os-release\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd8d9e78-4582-40da-8104-cebed9aab183-cni-binary-copy\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898646 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-registration-dir\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-etc-selinux\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-var-lib-openvswitch\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898745 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-etc-openvswitch\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898745 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-ovnkube-config\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-ovnkube-script-lib\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs\") pod \"network-metrics-daemon-jbtcn\" (UID: \"318fb46e-f43b-48f1-8fc3-07f871da0b1e\") " pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:39.899654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpwh5\" (UniqueName: \"kubernetes.io/projected/756700bc-c6f9-4a06-8fc2-aae762d968c3-kube-api-access-qpwh5\") pod \"node-ca-zdcrg\" (UID: \"756700bc-c6f9-4a06-8fc2-aae762d968c3\") " pod="openshift-image-registry/node-ca-zdcrg" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898857 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f999c8ca-9638-4bae-93a8-52743104c377-konnectivity-ca\") pod \"konnectivity-agent-rrjcd\" (UID: \"f999c8ca-9638-4bae-93a8-52743104c377\") " pod="kube-system/konnectivity-agent-rrjcd" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:39.898884 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898901 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bd6de8e-5daf-4e9f-b0e7-f149908e966b-tmp-dir\") pod \"node-resolver-lxhkh\" (UID: \"2bd6de8e-5daf-4e9f-b0e7-f149908e966b\") " pod="openshift-dns/node-resolver-lxhkh" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898948 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tpxs\" (UniqueName: \"kubernetes.io/projected/2bd6de8e-5daf-4e9f-b0e7-f149908e966b-kube-api-access-9tpxs\") pod \"node-resolver-lxhkh\" (UID: \"2bd6de8e-5daf-4e9f-b0e7-f149908e966b\") " pod="openshift-dns/node-resolver-lxhkh" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.898977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxxvc\" (UniqueName: \"kubernetes.io/projected/738da552-87c0-4b57-9a12-3de99011fb3c-kube-api-access-lxxvc\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:39.899020 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs podName:318fb46e-f43b-48f1-8fc3-07f871da0b1e nodeName:}" failed. No retries permitted until 2026-07-15 10:07:40.398983392 +0000 UTC m=+2.984650718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs") pod "network-metrics-daemon-jbtcn" (UID: "318fb46e-f43b-48f1-8fc3-07f871da0b1e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899035 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-var-lib-openvswitch\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899048 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-run-systemd\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899085 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-registration-dir\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-run-ovn\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-node-log\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-run-ovn-kubernetes\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899224 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81869c04-f7bf-4cc7-81e2-c7279e070c38-kubelet-config\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899242 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-run-systemd\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899255 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/738da552-87c0-4b57-9a12-3de99011fb3c-cnibin\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899260 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-run-ovn-kubernetes\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-slash\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-run-openvswitch\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899311 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-run-ovn\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899308 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/916c2a1c-c547-4f49-b00e-634ca84eb08e-iptables-alerter-script\") pod \"iptables-alerter-lg7t8\" (UID: \"916c2a1c-c547-4f49-b00e-634ca84eb08e\") " pod="openshift-network-operator/iptables-alerter-lg7t8" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899310 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-node-log\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899334 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/756700bc-c6f9-4a06-8fc2-aae762d968c3-serviceca\") pod \"node-ca-zdcrg\" (UID: \"756700bc-c6f9-4a06-8fc2-aae762d968c3\") " pod="openshift-image-registry/node-ca-zdcrg" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899353 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-slash\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899348 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-ovnkube-script-lib\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899363 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-run-openvswitch\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-cnibin\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899425 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0c4f627-7172-40cc-be6f-e51950a86868-etc-selinux\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899450 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbfl8\" (UniqueName: \"kubernetes.io/projected/f0c4f627-7172-40cc-be6f-e51950a86868-kube-api-access-pbfl8\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899485 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-kubelet\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/738da552-87c0-4b57-9a12-3de99011fb3c-system-cni-dir\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899538 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-host-kubelet\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899566 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-run-multus-certs\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:39.900776 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.899637 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f999c8ca-9638-4bae-93a8-52743104c377-konnectivity-ca\") pod \"konnectivity-agent-rrjcd\" (UID: \"f999c8ca-9638-4bae-93a8-52743104c377\") " pod="kube-system/konnectivity-agent-rrjcd" Jul 15 10:07:39.902013 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.901995 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f999c8ca-9638-4bae-93a8-52743104c377-agent-certs\") pod \"konnectivity-agent-rrjcd\" (UID: \"f999c8ca-9638-4bae-93a8-52743104c377\") " pod="kube-system/konnectivity-agent-rrjcd" Jul 15 10:07:39.902128 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.902108 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-ovn-node-metrics-cert\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.904613 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:39.904594 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:07:39.904613 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:39.904615 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:07:39.904767 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:39.904629 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ff2rf for pod openshift-network-diagnostics/network-check-target-zvvh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:07:39.904767 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:39.904697 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf podName:012026aa-ec92-4600-930b-1bf89b1f1653 nodeName:}" failed. No retries permitted until 2026-07-15 10:07:40.404680444 +0000 UTC m=+2.990347757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ff2rf" (UniqueName: "kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf") pod "network-check-target-zvvh9" (UID: "012026aa-ec92-4600-930b-1bf89b1f1653") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:07:39.906895 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.906828 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z267q\" (UniqueName: \"kubernetes.io/projected/cbc94ec3-6996-4e3e-897c-8e1eb72fbe84-kube-api-access-z267q\") pod \"ovnkube-node-bkhzv\" (UID: \"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84\") " pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:39.907529 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.907261 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bb4z\" (UniqueName: \"kubernetes.io/projected/318fb46e-f43b-48f1-8fc3-07f871da0b1e-kube-api-access-6bb4z\") pod \"network-metrics-daemon-jbtcn\" (UID: \"318fb46e-f43b-48f1-8fc3-07f871da0b1e\") " pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:39.907616 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.907545 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zwwm\" (UniqueName: \"kubernetes.io/projected/916c2a1c-c547-4f49-b00e-634ca84eb08e-kube-api-access-6zwwm\") pod \"iptables-alerter-lg7t8\" (UID: \"916c2a1c-c547-4f49-b00e-634ca84eb08e\") " pod="openshift-network-operator/iptables-alerter-lg7t8" Jul 15 10:07:39.907616 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.907563 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbfl8\" (UniqueName: \"kubernetes.io/projected/f0c4f627-7172-40cc-be6f-e51950a86868-kube-api-access-pbfl8\") pod \"aws-ebs-csi-driver-node-5bnm2\" (UID: \"f0c4f627-7172-40cc-be6f-e51950a86868\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:39.988347 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.988218 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" event={"ID":"0124dca64ed1505b90e32949bfca1c08","Type":"ContainerStarted","Data":"2a8a2447e40765181f9d9fe0ec5516428c060f30b91ccb7683b068dba9042325"} Jul 15 10:07:39.990601 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:39.990572 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" event={"ID":"8b107ab28aa0bcaf4bbc363b6b4563c3","Type":"ContainerStarted","Data":"37cf8c1d019b666707635ebcac29673b3bf15845efd5c13859e4d092855fe9fe"} Jul 15 10:07:40.000652 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81869c04-f7bf-4cc7-81e2-c7279e070c38-kubelet-config\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:40.000769 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000664 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/738da552-87c0-4b57-9a12-3de99011fb3c-cnibin\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.000769 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000691 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/756700bc-c6f9-4a06-8fc2-aae762d968c3-serviceca\") pod \"node-ca-zdcrg\" (UID: \"756700bc-c6f9-4a06-8fc2-aae762d968c3\") " pod="openshift-image-registry/node-ca-zdcrg" Jul 15 10:07:40.000769 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000716 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-cnibin\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.000769 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000741 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/738da552-87c0-4b57-9a12-3de99011fb3c-system-cni-dir\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.000769 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-run-multus-certs\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000763 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81869c04-f7bf-4cc7-81e2-c7279e070c38-kubelet-config\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000790 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/738da552-87c0-4b57-9a12-3de99011fb3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skltw\" (UniqueName: \"kubernetes.io/projected/fd8d9e78-4582-40da-8104-cebed9aab183-kube-api-access-skltw\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000834 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-cnibin\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000840 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-kubernetes\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000902 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-kubernetes\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000911 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-systemd\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-hostroot\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000960 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/738da552-87c0-4b57-9a12-3de99011fb3c-system-cni-dir\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000987 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-sysctl-d\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.000997 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-hostroot\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001010 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-tuned\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a6aceba-caa7-4a51-a6c8-d958eab077b4-tmp\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001038 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/738da552-87c0-4b57-9a12-3de99011fb3c-cnibin\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.001057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/738da552-87c0-4b57-9a12-3de99011fb3c-os-release\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-multus-socket-dir-parent\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-var-lib-cni-bin\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/756700bc-c6f9-4a06-8fc2-aae762d968c3-host\") pod \"node-ca-zdcrg\" (UID: \"756700bc-c6f9-4a06-8fc2-aae762d968c3\") " pod="openshift-image-registry/node-ca-zdcrg" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001149 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-modprobe-d\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-etc-kubernetes\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-system-cni-dir\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001222 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-var-lib-cni-multus\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twkss\" (UniqueName: \"kubernetes.io/projected/4a6aceba-caa7-4a51-a6c8-d958eab077b4-kube-api-access-twkss\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/738da552-87c0-4b57-9a12-3de99011fb3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-multus-conf-dir\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001334 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fd8d9e78-4582-40da-8104-cebed9aab183-multus-daemon-config\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001386 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81869c04-f7bf-4cc7-81e2-c7279e070c38-dbus\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-run-netns\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001434 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-sysctl-conf\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-lib-modules\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.001742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/738da552-87c0-4b57-9a12-3de99011fb3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-run-k8s-cni-cncf-io\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001522 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/756700bc-c6f9-4a06-8fc2-aae762d968c3-serviceca\") pod \"node-ca-zdcrg\" (UID: \"756700bc-c6f9-4a06-8fc2-aae762d968c3\") " pod="openshift-image-registry/node-ca-zdcrg" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001528 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-var-lib-kubelet\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001586 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-systemd\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001570 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-sysconfig\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-run\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001639 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-var-lib-kubelet\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/738da552-87c0-4b57-9a12-3de99011fb3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001671 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-run-multus-certs\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-sys\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-host\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001746 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bd6de8e-5daf-4e9f-b0e7-f149908e966b-hosts-file\") pod \"node-resolver-lxhkh\" (UID: \"2bd6de8e-5daf-4e9f-b0e7-f149908e966b\") " pod="openshift-dns/node-resolver-lxhkh" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001769 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-multus-cni-dir\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001792 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-os-release\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd8d9e78-4582-40da-8104-cebed9aab183-cni-binary-copy\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpwh5\" (UniqueName: \"kubernetes.io/projected/756700bc-c6f9-4a06-8fc2-aae762d968c3-kube-api-access-qpwh5\") pod \"node-ca-zdcrg\" (UID: \"756700bc-c6f9-4a06-8fc2-aae762d968c3\") " pod="openshift-image-registry/node-ca-zdcrg" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001885 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bd6de8e-5daf-4e9f-b0e7-f149908e966b-tmp-dir\") pod \"node-resolver-lxhkh\" (UID: \"2bd6de8e-5daf-4e9f-b0e7-f149908e966b\") " pod="openshift-dns/node-resolver-lxhkh" Jul 15 10:07:40.002506 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tpxs\" (UniqueName: \"kubernetes.io/projected/2bd6de8e-5daf-4e9f-b0e7-f149908e966b-kube-api-access-9tpxs\") pod \"node-resolver-lxhkh\" (UID: \"2bd6de8e-5daf-4e9f-b0e7-f149908e966b\") " pod="openshift-dns/node-resolver-lxhkh" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.002063 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-sysctl-d\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.002103 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxxvc\" (UniqueName: \"kubernetes.io/projected/738da552-87c0-4b57-9a12-3de99011fb3c-kube-api-access-lxxvc\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.002177 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-var-lib-cni-multus\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.002674 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-var-lib-kubelet\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.002740 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-multus-conf-dir\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.002801 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/738da552-87c0-4b57-9a12-3de99011fb3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:40.002822 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:40.002877 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret podName:81869c04-f7bf-4cc7-81e2-c7279e070c38 nodeName:}" failed. No retries permitted until 2026-07-15 10:07:40.502858753 +0000 UTC m=+3.088526075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret") pod "global-pull-secret-syncer-vhn9t" (UID: "81869c04-f7bf-4cc7-81e2-c7279e070c38") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.002874 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bd6de8e-5daf-4e9f-b0e7-f149908e966b-hosts-file\") pod \"node-resolver-lxhkh\" (UID: \"2bd6de8e-5daf-4e9f-b0e7-f149908e966b\") " pod="openshift-dns/node-resolver-lxhkh" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.002896 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-host\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.002907 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-var-lib-cni-bin\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.002904 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-multus-socket-dir-parent\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.002938 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-lib-modules\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.001640 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-system-cni-dir\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.002998 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-run-netns\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003039 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/738da552-87c0-4b57-9a12-3de99011fb3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.003354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003058 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-multus-cni-dir\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003079 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-run-k8s-cni-cncf-io\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003109 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81869c04-f7bf-4cc7-81e2-c7279e070c38-dbus\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003118 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-host-var-lib-kubelet\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003123 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-os-release\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003120 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-sysctl-conf\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003177 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-sysconfig\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003224 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-run\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003464 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/738da552-87c0-4b57-9a12-3de99011fb3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003476 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-modprobe-d\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003524 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/756700bc-c6f9-4a06-8fc2-aae762d968c3-host\") pod \"node-ca-zdcrg\" (UID: \"756700bc-c6f9-4a06-8fc2-aae762d968c3\") " pod="openshift-image-registry/node-ca-zdcrg" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003541 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd8d9e78-4582-40da-8104-cebed9aab183-cni-binary-copy\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003584 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/738da552-87c0-4b57-9a12-3de99011fb3c-os-release\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003609 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/738da552-87c0-4b57-9a12-3de99011fb3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003650 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a6aceba-caa7-4a51-a6c8-d958eab077b4-sys\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003664 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd8d9e78-4582-40da-8104-cebed9aab183-etc-kubernetes\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003689 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fd8d9e78-4582-40da-8104-cebed9aab183-multus-daemon-config\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.004130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.003960 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bd6de8e-5daf-4e9f-b0e7-f149908e966b-tmp-dir\") pod \"node-resolver-lxhkh\" (UID: \"2bd6de8e-5daf-4e9f-b0e7-f149908e966b\") " pod="openshift-dns/node-resolver-lxhkh" Jul 15 10:07:40.005054 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.005017 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a6aceba-caa7-4a51-a6c8-d958eab077b4-etc-tuned\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.006187 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.006164 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a6aceba-caa7-4a51-a6c8-d958eab077b4-tmp\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.010524 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.010501 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tpxs\" (UniqueName: \"kubernetes.io/projected/2bd6de8e-5daf-4e9f-b0e7-f149908e966b-kube-api-access-9tpxs\") pod \"node-resolver-lxhkh\" (UID: \"2bd6de8e-5daf-4e9f-b0e7-f149908e966b\") " pod="openshift-dns/node-resolver-lxhkh" Jul 15 10:07:40.010769 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.010687 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skltw\" (UniqueName: \"kubernetes.io/projected/fd8d9e78-4582-40da-8104-cebed9aab183-kube-api-access-skltw\") pod \"multus-mwqr5\" (UID: \"fd8d9e78-4582-40da-8104-cebed9aab183\") " pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.011269 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.010837 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxxvc\" (UniqueName: \"kubernetes.io/projected/738da552-87c0-4b57-9a12-3de99011fb3c-kube-api-access-lxxvc\") pod \"multus-additional-cni-plugins-5l4zn\" (UID: \"738da552-87c0-4b57-9a12-3de99011fb3c\") " pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.011269 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.011230 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twkss\" (UniqueName: \"kubernetes.io/projected/4a6aceba-caa7-4a51-a6c8-d958eab077b4-kube-api-access-twkss\") pod \"tuned-r6267\" (UID: \"4a6aceba-caa7-4a51-a6c8-d958eab077b4\") " pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.013486 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.013465 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpwh5\" (UniqueName: \"kubernetes.io/projected/756700bc-c6f9-4a06-8fc2-aae762d968c3-kube-api-access-qpwh5\") pod \"node-ca-zdcrg\" (UID: \"756700bc-c6f9-4a06-8fc2-aae762d968c3\") " pod="openshift-image-registry/node-ca-zdcrg" Jul 15 10:07:40.085315 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.085276 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rrjcd" Jul 15 10:07:40.090941 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.090902 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" Jul 15 10:07:40.099749 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.099725 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:07:40.106706 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.106687 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lg7t8" Jul 15 10:07:40.113386 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.113363 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zdcrg" Jul 15 10:07:40.121384 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.121363 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5l4zn" Jul 15 10:07:40.122739 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.122722 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 10:07:40.127724 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.127705 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mwqr5" Jul 15 10:07:40.133513 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.133488 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6267" Jul 15 10:07:40.138255 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.138232 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lxhkh" Jul 15 10:07:40.167679 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:40.167653 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0c4f627_7172_40cc_be6f_e51950a86868.slice/crio-a76355516f01bd223d932c54238eda3a595dd36537ddab3ed77b92910622dbc1 WatchSource:0}: Error finding container a76355516f01bd223d932c54238eda3a595dd36537ddab3ed77b92910622dbc1: Status 404 returned error can't find the container with id a76355516f01bd223d932c54238eda3a595dd36537ddab3ed77b92910622dbc1 Jul 15 10:07:40.168991 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:40.168958 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916c2a1c_c547_4f49_b00e_634ca84eb08e.slice/crio-71404ebf12db11f851990290540735f9400b45ff787aaf3e45160c711dca5722 WatchSource:0}: Error finding container 71404ebf12db11f851990290540735f9400b45ff787aaf3e45160c711dca5722: Status 404 returned error can't find the container with id 71404ebf12db11f851990290540735f9400b45ff787aaf3e45160c711dca5722 Jul 15 10:07:40.174294 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:40.174269 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756700bc_c6f9_4a06_8fc2_aae762d968c3.slice/crio-c949fdf1e4a56e8282d664ba0f9064e163eb19e19bb0948f5ab0193fa8cc5541 WatchSource:0}: Error finding container c949fdf1e4a56e8282d664ba0f9064e163eb19e19bb0948f5ab0193fa8cc5541: Status 404 returned error can't find the container with id c949fdf1e4a56e8282d664ba0f9064e163eb19e19bb0948f5ab0193fa8cc5541 Jul 15 10:07:40.175012 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:40.174973 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8d9e78_4582_40da_8104_cebed9aab183.slice/crio-edbb064e5ecb355d66ae153c69e03b812be83946c3ca8cc86f9a538728e19670 WatchSource:0}: Error finding container edbb064e5ecb355d66ae153c69e03b812be83946c3ca8cc86f9a538728e19670: Status 404 returned error can't find the container with id edbb064e5ecb355d66ae153c69e03b812be83946c3ca8cc86f9a538728e19670 Jul 15 10:07:40.175812 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:40.175793 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738da552_87c0_4b57_9a12_3de99011fb3c.slice/crio-400ff9b10908afe23f4450f8d89f4fcbc293a1ebc80f30a91d6ad18f8e44550d WatchSource:0}: Error finding container 400ff9b10908afe23f4450f8d89f4fcbc293a1ebc80f30a91d6ad18f8e44550d: Status 404 returned error can't find the container with id 400ff9b10908afe23f4450f8d89f4fcbc293a1ebc80f30a91d6ad18f8e44550d Jul 15 10:07:40.195230 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:40.195203 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a6aceba_caa7_4a51_a6c8_d958eab077b4.slice/crio-3bbfdc2817da942a54eebd88c9cefe65522529d39d7706d551f0710f950473fe WatchSource:0}: Error finding container 3bbfdc2817da942a54eebd88c9cefe65522529d39d7706d551f0710f950473fe: Status 404 returned error can't find the container with id 3bbfdc2817da942a54eebd88c9cefe65522529d39d7706d551f0710f950473fe Jul 15 10:07:40.196029 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:40.196002 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd6de8e_5daf_4e9f_b0e7_f149908e966b.slice/crio-710b9b4ad97a8449d9c772e559dad421cb39f17a6c22f79de26cae50ffb3fa26 WatchSource:0}: Error finding container 710b9b4ad97a8449d9c772e559dad421cb39f17a6c22f79de26cae50ffb3fa26: Status 404 returned error can't find the container with id 710b9b4ad97a8449d9c772e559dad421cb39f17a6c22f79de26cae50ffb3fa26 Jul 15 10:07:40.196749 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:40.196670 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf999c8ca_9638_4bae_93a8_52743104c377.slice/crio-dd011007e167fc9d8c7079c50fb795c73c2c5fa565fb1cf82919f7a8153a9b59 WatchSource:0}: Error finding container dd011007e167fc9d8c7079c50fb795c73c2c5fa565fb1cf82919f7a8153a9b59: Status 404 returned error can't find the container with id dd011007e167fc9d8c7079c50fb795c73c2c5fa565fb1cf82919f7a8153a9b59 Jul 15 10:07:40.198271 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:07:40.198224 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc94ec3_6996_4e3e_897c_8e1eb72fbe84.slice/crio-37e95fa590b7a7dbbc03334c2e9c145314a8c84697e55f36ab6ee301d09450b3 WatchSource:0}: Error finding container 37e95fa590b7a7dbbc03334c2e9c145314a8c84697e55f36ab6ee301d09450b3: Status 404 returned error can't find the container with id 37e95fa590b7a7dbbc03334c2e9c145314a8c84697e55f36ab6ee301d09450b3 Jul 15 10:07:40.404547 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.404404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs\") pod \"network-metrics-daemon-jbtcn\" (UID: \"318fb46e-f43b-48f1-8fc3-07f871da0b1e\") " pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:40.404662 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:40.404550 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:07:40.404662 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:40.404611 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs podName:318fb46e-f43b-48f1-8fc3-07f871da0b1e nodeName:}" failed. No retries permitted until 2026-07-15 10:07:41.404596384 +0000 UTC m=+3.990263696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs") pod "network-metrics-daemon-jbtcn" (UID: "318fb46e-f43b-48f1-8fc3-07f871da0b1e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:07:40.505521 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.505477 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:40.505684 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.505531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff2rf\" (UniqueName: \"kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf\") pod \"network-check-target-zvvh9\" (UID: \"012026aa-ec92-4600-930b-1bf89b1f1653\") " pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:40.505684 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:40.505647 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:07:40.505684 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:40.505661 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:07:40.505684 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:40.505680 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:07:40.505831 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:40.505692 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ff2rf for pod openshift-network-diagnostics/network-check-target-zvvh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:07:40.505831 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:40.505736 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret podName:81869c04-f7bf-4cc7-81e2-c7279e070c38 nodeName:}" failed. No retries permitted until 2026-07-15 10:07:41.505709756 +0000 UTC m=+4.091377082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret") pod "global-pull-secret-syncer-vhn9t" (UID: "81869c04-f7bf-4cc7-81e2-c7279e070c38") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:07:40.505831 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:40.505752 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf podName:012026aa-ec92-4600-930b-1bf89b1f1653 nodeName:}" failed. No retries permitted until 2026-07-15 10:07:41.505745719 +0000 UTC m=+4.091413034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ff2rf" (UniqueName: "kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf") pod "network-check-target-zvvh9" (UID: "012026aa-ec92-4600-930b-1bf89b1f1653") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:07:40.830371 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.830214 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 10:02:39 +0000 UTC" deadline="2028-03-21 09:21:52.265463303 +0000 UTC" Jul 15 10:07:40.830371 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.830308 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14759h14m11.435160832s" Jul 15 10:07:40.982227 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.982178 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:40.982773 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:40.982296 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:07:40.982773 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:40.982705 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:40.982894 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:40.982804 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:07:41.000742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.000572 2580 generic.go:356] "Generic (PLEG): container finished" podID="8b107ab28aa0bcaf4bbc363b6b4563c3" containerID="7a953dc8eb011bca1ef729b5ba75ced23c6cd2a2171f9389b6c7bd25658deb84" exitCode=0 Jul 15 10:07:41.000742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.000674 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" event={"ID":"8b107ab28aa0bcaf4bbc363b6b4563c3","Type":"ContainerDied","Data":"7a953dc8eb011bca1ef729b5ba75ced23c6cd2a2171f9389b6c7bd25658deb84"} Jul 15 10:07:41.007401 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.007322 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lxhkh" event={"ID":"2bd6de8e-5daf-4e9f-b0e7-f149908e966b","Type":"ContainerStarted","Data":"710b9b4ad97a8449d9c772e559dad421cb39f17a6c22f79de26cae50ffb3fa26"} Jul 15 10:07:41.019314 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.019230 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6267" event={"ID":"4a6aceba-caa7-4a51-a6c8-d958eab077b4","Type":"ContainerStarted","Data":"3bbfdc2817da942a54eebd88c9cefe65522529d39d7706d551f0710f950473fe"} Jul 15 10:07:41.029790 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.029759 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zn" event={"ID":"738da552-87c0-4b57-9a12-3de99011fb3c","Type":"ContainerStarted","Data":"400ff9b10908afe23f4450f8d89f4fcbc293a1ebc80f30a91d6ad18f8e44550d"} Jul 15 10:07:41.035065 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.035035 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mwqr5" event={"ID":"fd8d9e78-4582-40da-8104-cebed9aab183","Type":"ContainerStarted","Data":"edbb064e5ecb355d66ae153c69e03b812be83946c3ca8cc86f9a538728e19670"} Jul 15 10:07:41.040982 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.040880 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zdcrg" event={"ID":"756700bc-c6f9-4a06-8fc2-aae762d968c3","Type":"ContainerStarted","Data":"c949fdf1e4a56e8282d664ba0f9064e163eb19e19bb0948f5ab0193fa8cc5541"} Jul 15 10:07:41.056118 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.056084 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lg7t8" event={"ID":"916c2a1c-c547-4f49-b00e-634ca84eb08e","Type":"ContainerStarted","Data":"71404ebf12db11f851990290540735f9400b45ff787aaf3e45160c711dca5722"} Jul 15 10:07:41.071335 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.071300 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" event={"ID":"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84","Type":"ContainerStarted","Data":"37e95fa590b7a7dbbc03334c2e9c145314a8c84697e55f36ab6ee301d09450b3"} Jul 15 10:07:41.077151 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.077069 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rrjcd" event={"ID":"f999c8ca-9638-4bae-93a8-52743104c377","Type":"ContainerStarted","Data":"dd011007e167fc9d8c7079c50fb795c73c2c5fa565fb1cf82919f7a8153a9b59"} Jul 15 10:07:41.087485 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.087410 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" event={"ID":"f0c4f627-7172-40cc-be6f-e51950a86868","Type":"ContainerStarted","Data":"a76355516f01bd223d932c54238eda3a595dd36537ddab3ed77b92910622dbc1"} Jul 15 10:07:41.413020 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.412580 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs\") pod \"network-metrics-daemon-jbtcn\" (UID: \"318fb46e-f43b-48f1-8fc3-07f871da0b1e\") " pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:41.413020 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:41.412772 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:07:41.413020 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:41.412839 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs podName:318fb46e-f43b-48f1-8fc3-07f871da0b1e nodeName:}" failed. No retries permitted until 2026-07-15 10:07:43.412816393 +0000 UTC m=+5.998483708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs") pod "network-metrics-daemon-jbtcn" (UID: "318fb46e-f43b-48f1-8fc3-07f871da0b1e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:07:41.514305 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.513496 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff2rf\" (UniqueName: \"kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf\") pod \"network-check-target-zvvh9\" (UID: \"012026aa-ec92-4600-930b-1bf89b1f1653\") " pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:41.514305 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.513594 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:41.514305 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:41.513712 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:07:41.514305 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:41.513774 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret podName:81869c04-f7bf-4cc7-81e2-c7279e070c38 nodeName:}" failed. No retries permitted until 2026-07-15 10:07:43.513752636 +0000 UTC m=+6.099419953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret") pod "global-pull-secret-syncer-vhn9t" (UID: "81869c04-f7bf-4cc7-81e2-c7279e070c38") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:07:41.514305 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:41.514192 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:07:41.514305 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:41.514210 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:07:41.514305 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:41.514223 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ff2rf for pod openshift-network-diagnostics/network-check-target-zvvh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:07:41.514305 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:41.514268 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf podName:012026aa-ec92-4600-930b-1bf89b1f1653 nodeName:}" failed. No retries permitted until 2026-07-15 10:07:43.514252975 +0000 UTC m=+6.099920298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ff2rf" (UniqueName: "kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf") pod "network-check-target-zvvh9" (UID: "012026aa-ec92-4600-930b-1bf89b1f1653") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:07:41.831074 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.830956 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 10:02:39 +0000 UTC" deadline="2028-01-16 03:59:21.980166197 +0000 UTC" Jul 15 10:07:41.831074 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.830996 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13193h51m40.149175248s" Jul 15 10:07:41.985894 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:41.985367 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:41.985894 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:41.985503 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:07:42.117326 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:42.116422 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" event={"ID":"8b107ab28aa0bcaf4bbc363b6b4563c3","Type":"ContainerStarted","Data":"6c055cbc62bb759970f2d86dd8925244c2efca395ad8f4fb0ff7b22ed2ef53a7"} Jul 15 10:07:42.984004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:42.982262 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:42.984004 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:42.982421 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:07:42.984004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:42.982868 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:42.984004 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:42.983026 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:07:43.429857 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:43.429173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs\") pod \"network-metrics-daemon-jbtcn\" (UID: \"318fb46e-f43b-48f1-8fc3-07f871da0b1e\") " pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:43.429857 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:43.429371 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:07:43.429857 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:43.429441 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs podName:318fb46e-f43b-48f1-8fc3-07f871da0b1e nodeName:}" failed. No retries permitted until 2026-07-15 10:07:47.429421297 +0000 UTC m=+10.015088623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs") pod "network-metrics-daemon-jbtcn" (UID: "318fb46e-f43b-48f1-8fc3-07f871da0b1e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:07:43.530172 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:43.530130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:43.530345 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:43.530197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff2rf\" (UniqueName: \"kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf\") pod \"network-check-target-zvvh9\" (UID: \"012026aa-ec92-4600-930b-1bf89b1f1653\") " pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:43.530419 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:43.530388 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:07:43.530419 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:43.530406 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:07:43.530510 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:43.530419 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ff2rf for pod openshift-network-diagnostics/network-check-target-zvvh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:07:43.530510 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:43.530483 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf podName:012026aa-ec92-4600-930b-1bf89b1f1653 nodeName:}" failed. No retries permitted until 2026-07-15 10:07:47.530465698 +0000 UTC m=+10.116133030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ff2rf" (UniqueName: "kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf") pod "network-check-target-zvvh9" (UID: "012026aa-ec92-4600-930b-1bf89b1f1653") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:07:43.530617 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:43.530556 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:07:43.530617 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:43.530589 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret podName:81869c04-f7bf-4cc7-81e2-c7279e070c38 nodeName:}" failed. No retries permitted until 2026-07-15 10:07:47.530577009 +0000 UTC m=+10.116244360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret") pod "global-pull-secret-syncer-vhn9t" (UID: "81869c04-f7bf-4cc7-81e2-c7279e070c38") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:07:43.984235 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:43.983716 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:43.984235 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:43.983848 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:07:44.982734 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:44.982696 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:44.983240 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:44.982828 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:07:44.983240 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:44.982921 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:44.983240 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:44.983061 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:07:45.983313 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:45.983089 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:45.983313 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:45.983227 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:07:46.983323 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:46.982840 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:46.983323 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:46.982879 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:46.983323 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:46.982984 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:07:46.983323 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:46.983120 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:07:47.464704 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:47.464466 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs\") pod \"network-metrics-daemon-jbtcn\" (UID: \"318fb46e-f43b-48f1-8fc3-07f871da0b1e\") " pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:47.464704 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:47.464638 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:07:47.464966 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:47.464721 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs podName:318fb46e-f43b-48f1-8fc3-07f871da0b1e nodeName:}" failed. No retries permitted until 2026-07-15 10:07:55.46469827 +0000 UTC m=+18.050365601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs") pod "network-metrics-daemon-jbtcn" (UID: "318fb46e-f43b-48f1-8fc3-07f871da0b1e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:07:47.565502 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:47.565463 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:47.565684 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:47.565522 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff2rf\" (UniqueName: \"kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf\") pod \"network-check-target-zvvh9\" (UID: \"012026aa-ec92-4600-930b-1bf89b1f1653\") " pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:47.565752 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:47.565694 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:07:47.565752 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:47.565715 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:07:47.565752 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:47.565728 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ff2rf for pod openshift-network-diagnostics/network-check-target-zvvh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:07:47.565897 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:47.565786 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf podName:012026aa-ec92-4600-930b-1bf89b1f1653 nodeName:}" failed. No retries permitted until 2026-07-15 10:07:55.565767561 +0000 UTC m=+18.151434884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ff2rf" (UniqueName: "kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf") pod "network-check-target-zvvh9" (UID: "012026aa-ec92-4600-930b-1bf89b1f1653") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:07:47.566209 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:47.566192 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:07:47.566302 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:47.566243 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret podName:81869c04-f7bf-4cc7-81e2-c7279e070c38 nodeName:}" failed. No retries permitted until 2026-07-15 10:07:55.566227936 +0000 UTC m=+18.151895260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret") pod "global-pull-secret-syncer-vhn9t" (UID: "81869c04-f7bf-4cc7-81e2-c7279e070c38") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:07:47.983989 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:47.983958 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:47.984538 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:47.984070 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:07:48.983024 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:48.982947 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:48.983024 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:48.982979 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:48.983257 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:48.983076 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:07:48.983471 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:48.983421 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:07:49.983211 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:49.983150 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:49.983661 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:49.983274 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:07:50.982746 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:50.982713 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:50.982940 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:50.982845 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:07:50.982940 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:50.982912 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:50.983058 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:50.983033 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:07:51.982733 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:51.982705 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:51.983170 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:51.982836 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:07:52.983110 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:52.983071 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:52.983548 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:52.983205 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:07:52.983548 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:52.983254 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:52.983548 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:52.983360 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:07:53.982899 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:53.982861 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:53.983070 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:53.983021 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:07:54.982804 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:54.982762 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:54.983337 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:54.982757 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:54.983337 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:54.982917 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:07:54.983337 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:54.982969 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:07:55.526719 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:55.526681 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs\") pod \"network-metrics-daemon-jbtcn\" (UID: \"318fb46e-f43b-48f1-8fc3-07f871da0b1e\") " pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:55.526886 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:55.526819 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:07:55.526886 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:55.526875 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs podName:318fb46e-f43b-48f1-8fc3-07f871da0b1e nodeName:}" failed. No retries permitted until 2026-07-15 10:08:11.526860646 +0000 UTC m=+34.112527956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs") pod "network-metrics-daemon-jbtcn" (UID: "318fb46e-f43b-48f1-8fc3-07f871da0b1e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:07:55.627981 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:55.627948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff2rf\" (UniqueName: \"kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf\") pod \"network-check-target-zvvh9\" (UID: \"012026aa-ec92-4600-930b-1bf89b1f1653\") " pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:55.628162 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:55.628048 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:55.628162 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:55.628131 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:07:55.628162 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:55.628154 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:07:55.628162 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:55.628158 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:07:55.628361 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:55.628176 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ff2rf for pod openshift-network-diagnostics/network-check-target-zvvh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:07:55.628361 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:55.628219 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret podName:81869c04-f7bf-4cc7-81e2-c7279e070c38 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:11.628199862 +0000 UTC m=+34.213867198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret") pod "global-pull-secret-syncer-vhn9t" (UID: "81869c04-f7bf-4cc7-81e2-c7279e070c38") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:07:55.628361 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:55.628237 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf podName:012026aa-ec92-4600-930b-1bf89b1f1653 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:11.628228063 +0000 UTC m=+34.213895373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ff2rf" (UniqueName: "kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf") pod "network-check-target-zvvh9" (UID: "012026aa-ec92-4600-930b-1bf89b1f1653") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:07:55.983060 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:55.982978 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:55.983472 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:55.983103 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:07:56.982264 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:56.982228 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:56.982264 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:56.982259 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:56.982469 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:56.982369 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:07:56.982527 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:56.982498 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:07:57.984090 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:57.984051 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:57.984546 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:57.984172 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:07:58.983183 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:58.983148 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:07:58.983183 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:58.983191 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:07:58.983426 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:58.983295 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:07:58.983484 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:58.983445 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:07:59.984458 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:07:59.984260 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:07:59.984829 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:07:59.984561 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:08:00.152327 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.152269 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" event={"ID":"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84","Type":"ContainerStarted","Data":"714c096d7a143cc165ba12f26bf8465e725ca39037e608d3809dc65f720d681b"} Jul 15 10:08:00.152409 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.152370 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" event={"ID":"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84","Type":"ContainerStarted","Data":"52de4043cc713b72fb2f38d7263d4169424e28e3819ff11a8958fc12e9f69a3f"} Jul 15 10:08:00.154143 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.154099 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rrjcd" event={"ID":"f999c8ca-9638-4bae-93a8-52743104c377","Type":"ContainerStarted","Data":"ee909ac105dcce9b314a5e0288f688e281e478ef6654eb9f5ea52a448d10fa8c"} Jul 15 10:08:00.155248 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.155224 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" event={"ID":"f0c4f627-7172-40cc-be6f-e51950a86868","Type":"ContainerStarted","Data":"5f02337fe1949b468bc1c7830ac1bc2658ca1f5f0b88b8df5d7a672a73539c00"} Jul 15 10:08:00.156322 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.156302 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" event={"ID":"0124dca64ed1505b90e32949bfca1c08","Type":"ContainerStarted","Data":"0e954c967dfe91c11ff3802f54fbded7cabf92458ac4199872eccb2964672a97"} Jul 15 10:08:00.157648 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.157619 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lxhkh" event={"ID":"2bd6de8e-5daf-4e9f-b0e7-f149908e966b","Type":"ContainerStarted","Data":"d96902b8a85ff4edeb3d311aba29b1a15557aa301137228468ac37e9da4e74c2"} Jul 15 10:08:00.159124 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.159089 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6267" event={"ID":"4a6aceba-caa7-4a51-a6c8-d958eab077b4","Type":"ContainerStarted","Data":"4a0132b19ce7f6eca5680f9537ac3d8a14191d4cb5133e0dec41d86d8aee8717"} Jul 15 10:08:00.162667 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.162239 2580 generic.go:356] "Generic (PLEG): container finished" podID="738da552-87c0-4b57-9a12-3de99011fb3c" containerID="b19ed28838b9f622755002c9dacc16b4f0017b5ace200af4341fe25c4cd92427" exitCode=0 Jul 15 10:08:00.162667 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.162313 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zn" event={"ID":"738da552-87c0-4b57-9a12-3de99011fb3c","Type":"ContainerDied","Data":"b19ed28838b9f622755002c9dacc16b4f0017b5ace200af4341fe25c4cd92427"} Jul 15 10:08:00.165560 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.165513 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mwqr5" event={"ID":"fd8d9e78-4582-40da-8104-cebed9aab183","Type":"ContainerStarted","Data":"ddff87d7f6d1538788a6e8c08620e4b3faf5e04aaa32204ae3e6f15ce32380bc"} Jul 15 10:08:00.167835 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.167463 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zdcrg" event={"ID":"756700bc-c6f9-4a06-8fc2-aae762d968c3","Type":"ContainerStarted","Data":"1e3aca89ee69a5e4de48f01e7acd2aa2d3fdad5783310ec26e9fb032195bd922"} Jul 15 10:08:00.169807 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.169761 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" podStartSLOduration=21.16974438 podStartE2EDuration="21.16974438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:07:42.135340461 +0000 UTC m=+4.721007796" watchObservedRunningTime="2026-07-15 10:08:00.16974438 +0000 UTC m=+22.755411713" Jul 15 10:08:00.170156 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.170129 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rrjcd" podStartSLOduration=3.533010263 podStartE2EDuration="23.17012188s" totalImagesPullingTime="19.637111617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:00.169158737 +0000 UTC m=+22.754826067" watchObservedRunningTime="2026-07-15 10:08:00.17012188 +0000 UTC m=+22.755789211" Jul 15 10:08:00.206599 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.206555 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r6267" podStartSLOduration=2.563573255 podStartE2EDuration="22.206539427s" totalImagesPullingTime="19.642966172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:00.206464725 +0000 UTC m=+22.792132056" watchObservedRunningTime="2026-07-15 10:08:00.206539427 +0000 UTC m=+22.792206757" Jul 15 10:08:00.223527 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.223483 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mwqr5" podStartSLOduration=2.44511465 podStartE2EDuration="22.223462971s" totalImagesPullingTime="19.778348321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:00.223048057 +0000 UTC m=+22.808715389" watchObservedRunningTime="2026-07-15 10:08:00.223462971 +0000 UTC m=+22.809130302" Jul 15 10:08:00.237287 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.237248 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lxhkh" podStartSLOduration=2.599597359 podStartE2EDuration="22.237233451s" totalImagesPullingTime="19.637636092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:00.236768874 +0000 UTC m=+22.822436204" watchObservedRunningTime="2026-07-15 10:08:00.237233451 +0000 UTC m=+22.822900782" Jul 15 10:08:00.250293 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.250252 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" podStartSLOduration=21.250240862 podStartE2EDuration="21.250240862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:00.249915399 +0000 UTC m=+22.835582729" watchObservedRunningTime="2026-07-15 10:08:00.250240862 +0000 UTC m=+22.835908192" Jul 15 10:08:00.267796 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.267749 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zdcrg" podStartSLOduration=10.922302113 podStartE2EDuration="22.26773022s" totalImagesPullingTime="11.345428107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:00.267613314 +0000 UTC m=+22.853280644" watchObservedRunningTime="2026-07-15 10:08:00.26773022 +0000 UTC m=+22.853397557" Jul 15 10:08:00.982422 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.982168 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:08:00.982565 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:00.982531 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:08:00.982565 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:00.982266 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:08:00.982805 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:00.982764 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:08:01.172696 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:01.172628 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkhzv_cbc94ec3-6996-4e3e-897c-8e1eb72fbe84/ovn-acl-logging/0.log" Jul 15 10:08:01.173521 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:01.172950 2580 generic.go:356] "Generic (PLEG): container finished" podID="cbc94ec3-6996-4e3e-897c-8e1eb72fbe84" containerID="714c096d7a143cc165ba12f26bf8465e725ca39037e608d3809dc65f720d681b" exitCode=1 Jul 15 10:08:01.173521 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:01.173041 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" event={"ID":"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84","Type":"ContainerDied","Data":"714c096d7a143cc165ba12f26bf8465e725ca39037e608d3809dc65f720d681b"} Jul 15 10:08:01.173521 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:01.173126 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" event={"ID":"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84","Type":"ContainerStarted","Data":"2431c94fa953c3beccde992f6be49c48cd21d385e087ad5ff0898225eb3978dd"} Jul 15 10:08:01.173521 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:01.173180 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" event={"ID":"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84","Type":"ContainerStarted","Data":"5a4cde47034a6eab8a7a42e24d4aff4de2fc92d8488cedb2d16b8061b7a0e032"} Jul 15 10:08:01.173521 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:01.173249 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" event={"ID":"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84","Type":"ContainerStarted","Data":"0dffffe653df4ddad86273994036445e2619d8328c052333d017294640da529b"} Jul 15 10:08:01.173521 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:01.173293 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" event={"ID":"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84","Type":"ContainerStarted","Data":"2942e41c8eeae0953e3c1f8cc22a7da6385cd0a8f950f96005492badf9877613"} Jul 15 10:08:01.617363 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:01.617320 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 10:08:01.875768 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:01.875663 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T10:08:01.617342092Z","UUID":"73c84787-953d-4d1e-80b6-3b71cf7ee52c","Handler":null,"Name":"","Endpoint":""} Jul 15 10:08:01.877552 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:01.877528 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 10:08:01.877667 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:01.877574 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 10:08:01.982759 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:01.982728 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:08:01.983046 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:01.982866 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:08:02.177555 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:02.177472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lg7t8" event={"ID":"916c2a1c-c547-4f49-b00e-634ca84eb08e","Type":"ContainerStarted","Data":"d6ae86662b39d8ed6e43db9b7b37e6ebe5ea746a48bac261c1499afc7f2369dc"} Jul 15 10:08:02.180197 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:02.180170 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" event={"ID":"f0c4f627-7172-40cc-be6f-e51950a86868","Type":"ContainerStarted","Data":"74299a86c66aa63b7f4c6d13c0e69ba4f3d037830fcee8d13c0dedaf1009047f"} Jul 15 10:08:02.192770 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:02.192720 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lg7t8" podStartSLOduration=4.527613804 podStartE2EDuration="24.192704303s" totalImagesPullingTime="19.665090499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:02.192393115 +0000 UTC m=+24.778060448" watchObservedRunningTime="2026-07-15 10:08:02.192704303 +0000 UTC m=+24.778371660" Jul 15 10:08:02.982731 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:02.982529 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:08:02.982905 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:02.982579 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:08:02.982905 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:02.982827 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:08:02.983052 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:02.982968 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:08:03.185876 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:03.185795 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkhzv_cbc94ec3-6996-4e3e-897c-8e1eb72fbe84/ovn-acl-logging/0.log" Jul 15 10:08:03.186329 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:03.186240 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" event={"ID":"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84","Type":"ContainerStarted","Data":"d8db2e9915991787b3cbaf6d0eaf611517833198e263d1d2b27a0179830e7c04"} Jul 15 10:08:03.188654 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:03.188625 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" event={"ID":"f0c4f627-7172-40cc-be6f-e51950a86868","Type":"ContainerStarted","Data":"a6fdb91619c6e297f002cb58c2281834d326f9bebea52e56988109d333400cca"} Jul 15 10:08:03.209801 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:03.209747 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5bnm2" podStartSLOduration=4.007991871 podStartE2EDuration="26.209726636s" totalImagesPullingTime="22.201734765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:07:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:03.209039073 +0000 UTC m=+25.794706403" watchObservedRunningTime="2026-07-15 10:08:03.209726636 +0000 UTC m=+25.795393965" Jul 15 10:08:03.281553 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:03.281525 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rrjcd" Jul 15 10:08:03.282085 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:03.282063 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rrjcd" Jul 15 10:08:03.982555 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:03.982523 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:08:03.982782 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:03.982654 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:08:04.191044 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:04.191009 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rrjcd" Jul 15 10:08:04.191594 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:04.191423 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rrjcd" Jul 15 10:08:04.982479 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:04.982453 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:08:04.982625 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:04.982555 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:08:04.982625 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:04.982611 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:08:04.982733 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:04.982707 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:08:05.195479 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:05.195132 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zn" event={"ID":"738da552-87c0-4b57-9a12-3de99011fb3c","Type":"ContainerStarted","Data":"3a0d133c89de863e16ac339258a0f6c3dd80f6748a0614d72d31d5bf9deffadf"} Jul 15 10:08:05.198962 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:05.198942 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkhzv_cbc94ec3-6996-4e3e-897c-8e1eb72fbe84/ovn-acl-logging/0.log" Jul 15 10:08:05.199360 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:05.199333 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" event={"ID":"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84","Type":"ContainerStarted","Data":"38719faa9156007807f0e9c8d3e31aea0eff7919fbe196a127ba36f7c2a62ac0"} Jul 15 10:08:05.199844 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:05.199817 2580 scope.go:117] "RemoveContainer" containerID="714c096d7a143cc165ba12f26bf8465e725ca39037e608d3809dc65f720d681b" Jul 15 10:08:05.199999 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:05.199828 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:08:05.199999 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:05.199960 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:08:05.216008 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:05.215981 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:08:05.982665 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:05.982641 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:08:05.982819 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:05.982779 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:08:06.205418 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:06.205390 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkhzv_cbc94ec3-6996-4e3e-897c-8e1eb72fbe84/ovn-acl-logging/0.log" Jul 15 10:08:06.205829 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:06.205782 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" event={"ID":"cbc94ec3-6996-4e3e-897c-8e1eb72fbe84","Type":"ContainerStarted","Data":"364aa358ae88797f2f00399001b5a983134a4ec49e8c7810a7a6474ccb82c106"} Jul 15 10:08:06.206151 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:06.206129 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:08:06.207739 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:06.207703 2580 generic.go:356] "Generic (PLEG): container finished" podID="738da552-87c0-4b57-9a12-3de99011fb3c" containerID="3a0d133c89de863e16ac339258a0f6c3dd80f6748a0614d72d31d5bf9deffadf" exitCode=0 Jul 15 10:08:06.207846 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:06.207747 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zn" event={"ID":"738da552-87c0-4b57-9a12-3de99011fb3c","Type":"ContainerDied","Data":"3a0d133c89de863e16ac339258a0f6c3dd80f6748a0614d72d31d5bf9deffadf"} Jul 15 10:08:06.226379 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:06.226349 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:08:06.234994 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:06.234889 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" podStartSLOduration=8.578330256 podStartE2EDuration="28.234868371s" totalImagesPullingTime="19.656538115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:06.234530314 +0000 UTC m=+28.820197645" watchObservedRunningTime="2026-07-15 10:08:06.234868371 +0000 UTC m=+28.820535702" Jul 15 10:08:06.982706 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:06.982668 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:08:06.983017 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:06.982812 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:08:06.983017 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:06.982683 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:08:06.984133 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:06.984084 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:08:06.997637 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:06.997525 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zvvh9"] Jul 15 10:08:06.998421 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:06.998393 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vhn9t"] Jul 15 10:08:06.998545 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:06.998513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:08:06.998658 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:06.998632 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:08:06.999196 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:06.999174 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jbtcn"] Jul 15 10:08:07.210667 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:07.210511 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:08:07.211030 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:07.210521 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:08:07.211075 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:07.211040 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:08:07.211166 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:07.211146 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:08:08.214377 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:08.214347 2580 generic.go:356] "Generic (PLEG): container finished" podID="738da552-87c0-4b57-9a12-3de99011fb3c" containerID="55d55d3429db543e009c1b0110496f721fcbdcc6fa73a4e18d3579d4312ae7ec" exitCode=0 Jul 15 10:08:08.214857 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:08.214432 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zn" event={"ID":"738da552-87c0-4b57-9a12-3de99011fb3c","Type":"ContainerDied","Data":"55d55d3429db543e009c1b0110496f721fcbdcc6fa73a4e18d3579d4312ae7ec"} Jul 15 10:08:08.982905 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:08.982864 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:08:08.983086 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:08.982907 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:08:08.983086 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:08.982864 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:08:08.983086 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:08.983021 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:08:08.983184 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:08.983083 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:08:08.983184 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:08.983160 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:08:10.220562 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:10.220530 2580 generic.go:356] "Generic (PLEG): container finished" podID="738da552-87c0-4b57-9a12-3de99011fb3c" containerID="e7abade2a3aac2b3add8949e6b6e21a2bd023bda389530d3ea46e6882b7e66b1" exitCode=0 Jul 15 10:08:10.221305 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:10.220591 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zn" event={"ID":"738da552-87c0-4b57-9a12-3de99011fb3c","Type":"ContainerDied","Data":"e7abade2a3aac2b3add8949e6b6e21a2bd023bda389530d3ea46e6882b7e66b1"} Jul 15 10:08:10.982775 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:10.982734 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:08:10.982775 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:10.982759 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:08:10.983046 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:10.982871 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhn9t" podUID="81869c04-f7bf-4cc7-81e2-c7279e070c38" Jul 15 10:08:10.983046 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:10.982945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:08:10.983160 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:10.983075 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jbtcn" podUID="318fb46e-f43b-48f1-8fc3-07f871da0b1e" Jul 15 10:08:10.983295 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:10.983186 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvvh9" podUID="012026aa-ec92-4600-930b-1bf89b1f1653" Jul 15 10:08:11.541407 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:11.541369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs\") pod \"network-metrics-daemon-jbtcn\" (UID: \"318fb46e-f43b-48f1-8fc3-07f871da0b1e\") " pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:08:11.541830 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:11.541498 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:08:11.541830 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:11.541561 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs podName:318fb46e-f43b-48f1-8fc3-07f871da0b1e nodeName:}" failed. No retries permitted until 2026-07-15 10:08:43.541544255 +0000 UTC m=+66.127211568 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs") pod "network-metrics-daemon-jbtcn" (UID: "318fb46e-f43b-48f1-8fc3-07f871da0b1e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:08:11.642075 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:11.642037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:08:11.642075 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:11.642089 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff2rf\" (UniqueName: \"kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf\") pod \"network-check-target-zvvh9\" (UID: \"012026aa-ec92-4600-930b-1bf89b1f1653\") " pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:08:11.642320 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:11.642217 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:08:11.642320 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:11.642307 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret podName:81869c04-f7bf-4cc7-81e2-c7279e070c38 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:43.642275763 +0000 UTC m=+66.227943091 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret") pod "global-pull-secret-syncer-vhn9t" (UID: "81869c04-f7bf-4cc7-81e2-c7279e070c38") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:08:11.642320 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:11.642224 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:08:11.642474 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:11.642336 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:08:11.642474 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:11.642350 2580 projected.go:196] Error preparing data for projected volume kube-api-access-ff2rf for pod openshift-network-diagnostics/network-check-target-zvvh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:08:11.642474 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:11.642394 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf podName:012026aa-ec92-4600-930b-1bf89b1f1653 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:43.642382652 +0000 UTC m=+66.228049974 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ff2rf" (UniqueName: "kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf") pod "network-check-target-zvvh9" (UID: "012026aa-ec92-4600-930b-1bf89b1f1653") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:08:12.769384 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.769171 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeReady" Jul 15 10:08:12.769786 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.769490 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 10:08:12.809691 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.809657 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-747775774-88h9s"] Jul 15 10:08:12.813954 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.813912 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:12.817265 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.817117 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 10:08:12.817265 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.817142 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 10:08:12.817265 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.817241 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ltftg\"" Jul 15 10:08:12.817481 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.817418 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 10:08:12.822958 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.822232 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nlh65"] Jul 15 10:08:12.823730 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.823711 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 10:08:12.825062 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.825044 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:12.827276 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.827259 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 10:08:12.827551 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.827533 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8qhqb\"" Jul 15 10:08:12.827634 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.827533 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 10:08:12.832158 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.832122 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-747775774-88h9s"] Jul 15 10:08:12.832869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.832851 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dpj55"] Jul 15 10:08:12.835446 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.835429 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dpj55" Jul 15 10:08:12.837285 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.837257 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nlh65"] Jul 15 10:08:12.838866 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.838847 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hlbgk\"" Jul 15 10:08:12.838978 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.838849 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 10:08:12.839107 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.839089 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 10:08:12.839176 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.839140 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 10:08:12.848639 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.848612 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dpj55"] Jul 15 10:08:12.953482 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.953445 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58qj9\" (UniqueName: \"kubernetes.io/projected/119c6341-b963-43a9-8b75-3aef3cb786e0-kube-api-access-58qj9\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:12.953716 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.953563 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5642ee70-4b44-4283-9ec0-370461185ed9-trusted-ca\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:12.953716 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.953593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94lz8\" (UniqueName: \"kubernetes.io/projected/4dfcebda-b161-49e1-900a-4b8ce5c8628a-kube-api-access-94lz8\") pod \"ingress-canary-dpj55\" (UID: \"4dfcebda-b161-49e1-900a-4b8ce5c8628a\") " pod="openshift-ingress-canary/ingress-canary-dpj55" Jul 15 10:08:12.953716 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.953628 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5642ee70-4b44-4283-9ec0-370461185ed9-image-registry-private-configuration\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:12.953716 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.953652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5642ee70-4b44-4283-9ec0-370461185ed9-installation-pull-secrets\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:12.953716 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.953682 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dfcebda-b161-49e1-900a-4b8ce5c8628a-cert\") pod \"ingress-canary-dpj55\" (UID: \"4dfcebda-b161-49e1-900a-4b8ce5c8628a\") " pod="openshift-ingress-canary/ingress-canary-dpj55" Jul 15 10:08:12.953992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.953783 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/119c6341-b963-43a9-8b75-3aef3cb786e0-config-volume\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:12.953992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.953842 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/119c6341-b963-43a9-8b75-3aef3cb786e0-tmp-dir\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:12.953992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.953862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:12.953992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.953890 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:12.953992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.953912 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5642ee70-4b44-4283-9ec0-370461185ed9-ca-trust-extracted\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:12.953992 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.953957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spw7j\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-kube-api-access-spw7j\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:12.954231 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.954002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5642ee70-4b44-4283-9ec0-370461185ed9-registry-certificates\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:12.954231 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.954021 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-bound-sa-token\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:12.982575 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.982542 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:08:12.982739 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.982592 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:08:12.982739 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.982575 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:08:12.985672 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.985641 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 10:08:12.985797 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.985653 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vvbmv\"" Jul 15 10:08:12.986002 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.985984 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 10:08:12.986243 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.986211 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 10:08:12.986364 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.986315 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 10:08:12.986552 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:12.986532 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-swc7s\"" Jul 15 10:08:13.055327 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055237 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5642ee70-4b44-4283-9ec0-370461185ed9-registry-certificates\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.055327 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-bound-sa-token\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.055327 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58qj9\" (UniqueName: \"kubernetes.io/projected/119c6341-b963-43a9-8b75-3aef3cb786e0-kube-api-access-58qj9\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:13.055586 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5642ee70-4b44-4283-9ec0-370461185ed9-trusted-ca\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.055586 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94lz8\" (UniqueName: \"kubernetes.io/projected/4dfcebda-b161-49e1-900a-4b8ce5c8628a-kube-api-access-94lz8\") pod \"ingress-canary-dpj55\" (UID: \"4dfcebda-b161-49e1-900a-4b8ce5c8628a\") " pod="openshift-ingress-canary/ingress-canary-dpj55" Jul 15 10:08:13.055586 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5642ee70-4b44-4283-9ec0-370461185ed9-image-registry-private-configuration\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.055736 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5642ee70-4b44-4283-9ec0-370461185ed9-installation-pull-secrets\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.055736 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055653 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dfcebda-b161-49e1-900a-4b8ce5c8628a-cert\") pod \"ingress-canary-dpj55\" (UID: \"4dfcebda-b161-49e1-900a-4b8ce5c8628a\") " pod="openshift-ingress-canary/ingress-canary-dpj55" Jul 15 10:08:13.055736 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/119c6341-b963-43a9-8b75-3aef3cb786e0-config-volume\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:13.055736 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/119c6341-b963-43a9-8b75-3aef3cb786e0-tmp-dir\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:13.055918 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055737 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.055918 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:13.055918 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055806 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5642ee70-4b44-4283-9ec0-370461185ed9-ca-trust-extracted\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.055918 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.055836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spw7j\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-kube-api-access-spw7j\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.056679 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.056648 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/119c6341-b963-43a9-8b75-3aef3cb786e0-config-volume\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:13.056809 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:13.056767 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 10:08:13.056809 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:13.056793 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747775774-88h9s: secret "image-registry-tls" not found Jul 15 10:08:13.056944 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:13.056868 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls podName:5642ee70-4b44-4283-9ec0-370461185ed9 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:13.556840457 +0000 UTC m=+36.142507782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls") pod "image-registry-747775774-88h9s" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9") : secret "image-registry-tls" not found Jul 15 10:08:13.057049 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.057026 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5642ee70-4b44-4283-9ec0-370461185ed9-trusted-ca\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.057240 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.057218 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5642ee70-4b44-4283-9ec0-370461185ed9-registry-certificates\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.057330 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.057295 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5642ee70-4b44-4283-9ec0-370461185ed9-ca-trust-extracted\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.059953 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.059112 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/119c6341-b963-43a9-8b75-3aef3cb786e0-tmp-dir\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:13.059953 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:13.059224 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 10:08:13.059953 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:13.059298 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls podName:119c6341-b963-43a9-8b75-3aef3cb786e0 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:13.559277758 +0000 UTC m=+36.144945087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls") pod "dns-default-nlh65" (UID: "119c6341-b963-43a9-8b75-3aef3cb786e0") : secret "dns-default-metrics-tls" not found Jul 15 10:08:13.061832 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.061810 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dfcebda-b161-49e1-900a-4b8ce5c8628a-cert\") pod \"ingress-canary-dpj55\" (UID: \"4dfcebda-b161-49e1-900a-4b8ce5c8628a\") " pod="openshift-ingress-canary/ingress-canary-dpj55" Jul 15 10:08:13.061832 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.061821 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5642ee70-4b44-4283-9ec0-370461185ed9-image-registry-private-configuration\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.062013 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.061910 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5642ee70-4b44-4283-9ec0-370461185ed9-installation-pull-secrets\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.064919 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.064894 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94lz8\" (UniqueName: \"kubernetes.io/projected/4dfcebda-b161-49e1-900a-4b8ce5c8628a-kube-api-access-94lz8\") pod \"ingress-canary-dpj55\" (UID: \"4dfcebda-b161-49e1-900a-4b8ce5c8628a\") " pod="openshift-ingress-canary/ingress-canary-dpj55" Jul 15 10:08:13.066270 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.066252 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-bound-sa-token\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.066498 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.066475 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58qj9\" (UniqueName: \"kubernetes.io/projected/119c6341-b963-43a9-8b75-3aef3cb786e0-kube-api-access-58qj9\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:13.068972 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.068940 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spw7j\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-kube-api-access-spw7j\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.146102 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.146068 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dpj55" Jul 15 10:08:13.561413 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.561373 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:13.561604 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:13.561436 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:13.561604 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:13.561532 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 10:08:13.561604 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:13.561548 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747775774-88h9s: secret "image-registry-tls" not found Jul 15 10:08:13.561604 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:13.561563 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 10:08:13.561604 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:13.561608 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls podName:5642ee70-4b44-4283-9ec0-370461185ed9 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:14.561587867 +0000 UTC m=+37.147255197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls") pod "image-registry-747775774-88h9s" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9") : secret "image-registry-tls" not found Jul 15 10:08:13.561869 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:13.561637 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls podName:119c6341-b963-43a9-8b75-3aef3cb786e0 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:14.561617864 +0000 UTC m=+37.147285179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls") pod "dns-default-nlh65" (UID: "119c6341-b963-43a9-8b75-3aef3cb786e0") : secret "dns-default-metrics-tls" not found Jul 15 10:08:14.198452 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:14.198421 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dpj55"] Jul 15 10:08:14.201976 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:08:14.201946 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dfcebda_b161_49e1_900a_4b8ce5c8628a.slice/crio-db7f313c958028313d424d79527ce2a0ccfdf93890a018e4de3e64a1f99c0c51 WatchSource:0}: Error finding container db7f313c958028313d424d79527ce2a0ccfdf93890a018e4de3e64a1f99c0c51: Status 404 returned error can't find the container with id db7f313c958028313d424d79527ce2a0ccfdf93890a018e4de3e64a1f99c0c51 Jul 15 10:08:14.229900 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:14.229864 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dpj55" event={"ID":"4dfcebda-b161-49e1-900a-4b8ce5c8628a","Type":"ContainerStarted","Data":"db7f313c958028313d424d79527ce2a0ccfdf93890a018e4de3e64a1f99c0c51"} Jul 15 10:08:14.232655 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:14.232619 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zn" event={"ID":"738da552-87c0-4b57-9a12-3de99011fb3c","Type":"ContainerStarted","Data":"c59e9144654beaf83779ffef579cf604f80a17e4da14608b9a3cca0733d4b743"} Jul 15 10:08:14.570802 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:14.570753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:14.570974 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:14.570892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:14.570974 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:14.570948 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 10:08:14.571077 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:14.571011 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 10:08:14.571077 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:14.571024 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747775774-88h9s: secret "image-registry-tls" not found Jul 15 10:08:14.571077 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:14.571032 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls podName:119c6341-b963-43a9-8b75-3aef3cb786e0 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:16.571011675 +0000 UTC m=+39.156679007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls") pod "dns-default-nlh65" (UID: "119c6341-b963-43a9-8b75-3aef3cb786e0") : secret "dns-default-metrics-tls" not found Jul 15 10:08:14.571077 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:14.571069 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls podName:5642ee70-4b44-4283-9ec0-370461185ed9 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:16.571054311 +0000 UTC m=+39.156721636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls") pod "image-registry-747775774-88h9s" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9") : secret "image-registry-tls" not found Jul 15 10:08:15.241025 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:15.240972 2580 generic.go:356] "Generic (PLEG): container finished" podID="738da552-87c0-4b57-9a12-3de99011fb3c" containerID="c59e9144654beaf83779ffef579cf604f80a17e4da14608b9a3cca0733d4b743" exitCode=0 Jul 15 10:08:15.241025 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:15.241020 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zn" event={"ID":"738da552-87c0-4b57-9a12-3de99011fb3c","Type":"ContainerDied","Data":"c59e9144654beaf83779ffef579cf604f80a17e4da14608b9a3cca0733d4b743"} Jul 15 10:08:16.245667 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:16.245485 2580 generic.go:356] "Generic (PLEG): container finished" podID="738da552-87c0-4b57-9a12-3de99011fb3c" containerID="420f3aef4f6f361cfc31f0c2dbbd448fe2d73c316c66fdc0c8b9eb052a14cd49" exitCode=0 Jul 15 10:08:16.246046 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:16.245561 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zn" event={"ID":"738da552-87c0-4b57-9a12-3de99011fb3c","Type":"ContainerDied","Data":"420f3aef4f6f361cfc31f0c2dbbd448fe2d73c316c66fdc0c8b9eb052a14cd49"} Jul 15 10:08:16.588150 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:16.588097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:16.588332 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:16.588160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:16.588332 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:16.588246 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 10:08:16.588332 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:16.588267 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747775774-88h9s: secret "image-registry-tls" not found Jul 15 10:08:16.588453 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:16.588337 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls podName:5642ee70-4b44-4283-9ec0-370461185ed9 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:20.588317126 +0000 UTC m=+43.173984453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls") pod "image-registry-747775774-88h9s" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9") : secret "image-registry-tls" not found Jul 15 10:08:16.588453 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:16.588356 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 10:08:16.588453 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:16.588407 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls podName:119c6341-b963-43a9-8b75-3aef3cb786e0 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:20.58838975 +0000 UTC m=+43.174057062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls") pod "dns-default-nlh65" (UID: "119c6341-b963-43a9-8b75-3aef3cb786e0") : secret "dns-default-metrics-tls" not found Jul 15 10:08:17.251051 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:17.251017 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5l4zn" event={"ID":"738da552-87c0-4b57-9a12-3de99011fb3c","Type":"ContainerStarted","Data":"494d11cf6ca2d0fd48f60f43cd9d56ff08a7e2a3f0ab6f58fce8973c23d2bea5"} Jul 15 10:08:17.252337 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:17.252312 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dpj55" event={"ID":"4dfcebda-b161-49e1-900a-4b8ce5c8628a","Type":"ContainerStarted","Data":"925c6ff6c8dcb3dc7e56b1e3740b70dbdd27c201a40e4bcea6c2d55cc1065754"} Jul 15 10:08:17.278617 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:17.278569 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5l4zn" podStartSLOduration=8.869971532 podStartE2EDuration="39.278552873s" totalImagesPullingTime="30.408581341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:07:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:17.277078994 +0000 UTC m=+39.862746324" watchObservedRunningTime="2026-07-15 10:08:17.278552873 +0000 UTC m=+39.864220205" Jul 15 10:08:17.293503 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:17.293456 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dpj55" podStartSLOduration=3.072878762 podStartE2EDuration="5.293444054s" totalImagesPullingTime="2.220565292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:17.293057389 +0000 UTC m=+39.878724722" watchObservedRunningTime="2026-07-15 10:08:17.293444054 +0000 UTC m=+39.879111385" Jul 15 10:08:20.265431 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.265397 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cft4x"] Jul 15 10:08:20.297158 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.297133 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cft4x"] Jul 15 10:08:20.297320 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.297272 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.299702 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.299683 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 10:08:20.299831 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.299684 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 10:08:20.299831 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.299786 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l56fl\"" Jul 15 10:08:20.299966 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.299912 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 10:08:20.300679 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.300656 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 10:08:20.416181 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.416151 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eed75aef-e275-48df-afe1-cafede0162a7-crio-socket\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.416181 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.416185 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.416370 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.416215 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r5d5\" (UniqueName: \"kubernetes.io/projected/eed75aef-e275-48df-afe1-cafede0162a7-kube-api-access-4r5d5\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.416370 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.416241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eed75aef-e275-48df-afe1-cafede0162a7-data-volume\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.416370 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.416322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.516997 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.516868 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.516997 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.516952 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r5d5\" (UniqueName: \"kubernetes.io/projected/eed75aef-e275-48df-afe1-cafede0162a7-kube-api-access-4r5d5\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.517192 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.516996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eed75aef-e275-48df-afe1-cafede0162a7-data-volume\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.517192 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:20.517001 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 10:08:20.517192 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:20.517071 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm podName:eed75aef-e275-48df-afe1-cafede0162a7 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:21.017054764 +0000 UTC m=+43.602722076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cft4x" (UID: "eed75aef-e275-48df-afe1-cafede0162a7") : configmap "kube-rbac-proxy" not found Jul 15 10:08:20.517192 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.517088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.517192 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.517136 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eed75aef-e275-48df-afe1-cafede0162a7-crio-socket\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.517435 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:20.517208 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 10:08:20.517435 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:20.517251 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls podName:eed75aef-e275-48df-afe1-cafede0162a7 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:21.017238118 +0000 UTC m=+43.602905441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cft4x" (UID: "eed75aef-e275-48df-afe1-cafede0162a7") : secret "insights-runtime-extractor-tls" not found Jul 15 10:08:20.517435 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.517329 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eed75aef-e275-48df-afe1-cafede0162a7-crio-socket\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.517435 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.517387 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eed75aef-e275-48df-afe1-cafede0162a7-data-volume\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.530991 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.530969 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r5d5\" (UniqueName: \"kubernetes.io/projected/eed75aef-e275-48df-afe1-cafede0162a7-kube-api-access-4r5d5\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:20.618223 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.618185 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:20.618351 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:20.618233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:20.618351 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:20.618329 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 10:08:20.618439 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:20.618334 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 10:08:20.618439 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:20.618366 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747775774-88h9s: secret "image-registry-tls" not found Jul 15 10:08:20.618439 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:20.618403 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls podName:119c6341-b963-43a9-8b75-3aef3cb786e0 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:28.618386327 +0000 UTC m=+51.204053637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls") pod "dns-default-nlh65" (UID: "119c6341-b963-43a9-8b75-3aef3cb786e0") : secret "dns-default-metrics-tls" not found Jul 15 10:08:20.618439 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:20.618417 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls podName:5642ee70-4b44-4283-9ec0-370461185ed9 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:28.618411637 +0000 UTC m=+51.204078946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls") pod "image-registry-747775774-88h9s" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9") : secret "image-registry-tls" not found Jul 15 10:08:21.020842 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:21.020810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:21.021020 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:21.020863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:21.021020 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:21.020990 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 10:08:21.021020 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:21.020997 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 10:08:21.021122 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:21.021060 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls podName:eed75aef-e275-48df-afe1-cafede0162a7 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:22.021038173 +0000 UTC m=+44.606705499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cft4x" (UID: "eed75aef-e275-48df-afe1-cafede0162a7") : secret "insights-runtime-extractor-tls" not found Jul 15 10:08:21.021122 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:21.021074 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm podName:eed75aef-e275-48df-afe1-cafede0162a7 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:22.021067455 +0000 UTC m=+44.606734764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cft4x" (UID: "eed75aef-e275-48df-afe1-cafede0162a7") : configmap "kube-rbac-proxy" not found Jul 15 10:08:22.029649 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.029620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:22.030093 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.029703 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:22.030093 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:22.029748 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 10:08:22.030093 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:22.029809 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm podName:eed75aef-e275-48df-afe1-cafede0162a7 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:24.029793641 +0000 UTC m=+46.615460950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cft4x" (UID: "eed75aef-e275-48df-afe1-cafede0162a7") : configmap "kube-rbac-proxy" not found Jul 15 10:08:22.030093 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:22.029837 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 10:08:22.030093 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:22.029896 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls podName:eed75aef-e275-48df-afe1-cafede0162a7 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:24.02987794 +0000 UTC m=+46.615545268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cft4x" (UID: "eed75aef-e275-48df-afe1-cafede0162a7") : secret "insights-runtime-extractor-tls" not found Jul 15 10:08:22.038709 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.038686 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lxhkh_2bd6de8e-5daf-4e9f-b0e7-f149908e966b/dns-node-resolver/0.log" Jul 15 10:08:22.329817 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.329750 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mznzr"] Jul 15 10:08:22.345237 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.345211 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mznzr"] Jul 15 10:08:22.345361 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.345292 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" Jul 15 10:08:22.348659 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.348630 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 15 10:08:22.349872 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.349854 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 15 10:08:22.350009 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.349900 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 15 10:08:22.350009 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.349854 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 15 10:08:22.350009 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.349999 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pjddf\"" Jul 15 10:08:22.433266 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.433240 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a56ef493-a4d3-4701-9e88-dd6fa01c957c-signing-key\") pod \"service-ca-79f68b9f4f-mznzr\" (UID: \"a56ef493-a4d3-4701-9e88-dd6fa01c957c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" Jul 15 10:08:22.433401 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.433281 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2rxx\" (UniqueName: \"kubernetes.io/projected/a56ef493-a4d3-4701-9e88-dd6fa01c957c-kube-api-access-s2rxx\") pod \"service-ca-79f68b9f4f-mznzr\" (UID: \"a56ef493-a4d3-4701-9e88-dd6fa01c957c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" Jul 15 10:08:22.433401 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.433363 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a56ef493-a4d3-4701-9e88-dd6fa01c957c-signing-cabundle\") pod \"service-ca-79f68b9f4f-mznzr\" (UID: \"a56ef493-a4d3-4701-9e88-dd6fa01c957c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" Jul 15 10:08:22.534700 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.534666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2rxx\" (UniqueName: \"kubernetes.io/projected/a56ef493-a4d3-4701-9e88-dd6fa01c957c-kube-api-access-s2rxx\") pod \"service-ca-79f68b9f4f-mznzr\" (UID: \"a56ef493-a4d3-4701-9e88-dd6fa01c957c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" Jul 15 10:08:22.534798 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.534755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a56ef493-a4d3-4701-9e88-dd6fa01c957c-signing-cabundle\") pod \"service-ca-79f68b9f4f-mznzr\" (UID: \"a56ef493-a4d3-4701-9e88-dd6fa01c957c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" Jul 15 10:08:22.534848 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.534835 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a56ef493-a4d3-4701-9e88-dd6fa01c957c-signing-key\") pod \"service-ca-79f68b9f4f-mznzr\" (UID: \"a56ef493-a4d3-4701-9e88-dd6fa01c957c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" Jul 15 10:08:22.535473 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.535444 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a56ef493-a4d3-4701-9e88-dd6fa01c957c-signing-cabundle\") pod \"service-ca-79f68b9f4f-mznzr\" (UID: \"a56ef493-a4d3-4701-9e88-dd6fa01c957c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" Jul 15 10:08:22.537260 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.537239 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a56ef493-a4d3-4701-9e88-dd6fa01c957c-signing-key\") pod \"service-ca-79f68b9f4f-mznzr\" (UID: \"a56ef493-a4d3-4701-9e88-dd6fa01c957c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" Jul 15 10:08:22.543717 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.543693 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2rxx\" (UniqueName: \"kubernetes.io/projected/a56ef493-a4d3-4701-9e88-dd6fa01c957c-kube-api-access-s2rxx\") pod \"service-ca-79f68b9f4f-mznzr\" (UID: \"a56ef493-a4d3-4701-9e88-dd6fa01c957c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" Jul 15 10:08:22.654173 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.654105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" Jul 15 10:08:22.783920 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:22.783891 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mznzr"] Jul 15 10:08:22.786573 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:08:22.786548 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56ef493_a4d3_4701_9e88_dd6fa01c957c.slice/crio-85b567ad871de31c61d34bd4b3312184ecceae0cee88b39604003e7d9507c6da WatchSource:0}: Error finding container 85b567ad871de31c61d34bd4b3312184ecceae0cee88b39604003e7d9507c6da: Status 404 returned error can't find the container with id 85b567ad871de31c61d34bd4b3312184ecceae0cee88b39604003e7d9507c6da Jul 15 10:08:23.266546 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:23.266510 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" event={"ID":"a56ef493-a4d3-4701-9e88-dd6fa01c957c","Type":"ContainerStarted","Data":"85b567ad871de31c61d34bd4b3312184ecceae0cee88b39604003e7d9507c6da"} Jul 15 10:08:23.439838 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:23.439812 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zdcrg_756700bc-c6f9-4a06-8fc2-aae762d968c3/node-ca/0.log" Jul 15 10:08:24.039474 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:24.039429 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dpj55_4dfcebda-b161-49e1-900a-4b8ce5c8628a/serve-healthcheck-canary/0.log" Jul 15 10:08:24.047685 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:24.047658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:24.047847 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:24.047706 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:24.047847 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:24.047826 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 10:08:24.047966 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:24.047896 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls podName:eed75aef-e275-48df-afe1-cafede0162a7 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:28.047880801 +0000 UTC m=+50.633548119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cft4x" (UID: "eed75aef-e275-48df-afe1-cafede0162a7") : secret "insights-runtime-extractor-tls" not found Jul 15 10:08:24.047966 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:24.047830 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 10:08:24.048072 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:24.047974 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm podName:eed75aef-e275-48df-afe1-cafede0162a7 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:28.047963221 +0000 UTC m=+50.633630531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cft4x" (UID: "eed75aef-e275-48df-afe1-cafede0162a7") : configmap "kube-rbac-proxy" not found Jul 15 10:08:26.274607 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:26.274573 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" event={"ID":"a56ef493-a4d3-4701-9e88-dd6fa01c957c","Type":"ContainerStarted","Data":"d5cf5eedeb63438c82ad44793d5a2480ab19eb8fcc2a6aa03d5b39a18205749a"} Jul 15 10:08:26.291232 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:26.291181 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-mznzr" podStartSLOduration=1.432497368 podStartE2EDuration="4.291166483s" totalImagesPullingTime="2.858669115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:08:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:26.291062369 +0000 UTC m=+48.876729701" watchObservedRunningTime="2026-07-15 10:08:26.291166483 +0000 UTC m=+48.876833814" Jul 15 10:08:28.082479 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:28.082434 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:28.082865 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:28.082491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:28.082865 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:28.082613 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 10:08:28.082865 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:28.082698 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls podName:eed75aef-e275-48df-afe1-cafede0162a7 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:36.082677266 +0000 UTC m=+58.668344590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cft4x" (UID: "eed75aef-e275-48df-afe1-cafede0162a7") : secret "insights-runtime-extractor-tls" not found Jul 15 10:08:28.083013 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:28.082996 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eed75aef-e275-48df-afe1-cafede0162a7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:28.687542 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:28.687511 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:28.687718 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:28.687555 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:28.687718 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:28.687665 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 10:08:28.687718 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:28.687680 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 10:08:28.687718 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:28.687684 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747775774-88h9s: secret "image-registry-tls" not found Jul 15 10:08:28.687843 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:28.687729 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls podName:119c6341-b963-43a9-8b75-3aef3cb786e0 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:44.687715743 +0000 UTC m=+67.273383052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls") pod "dns-default-nlh65" (UID: "119c6341-b963-43a9-8b75-3aef3cb786e0") : secret "dns-default-metrics-tls" not found Jul 15 10:08:28.687843 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:08:28.687741 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls podName:5642ee70-4b44-4283-9ec0-370461185ed9 nodeName:}" failed. No retries permitted until 2026-07-15 10:08:44.687735484 +0000 UTC m=+67.273402793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls") pod "image-registry-747775774-88h9s" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9") : secret "image-registry-tls" not found Jul 15 10:08:36.144770 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:36.144728 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:36.147017 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:36.146998 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eed75aef-e275-48df-afe1-cafede0162a7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cft4x\" (UID: \"eed75aef-e275-48df-afe1-cafede0162a7\") " pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:36.207026 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:36.206985 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cft4x" Jul 15 10:08:36.334519 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:36.334479 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cft4x"] Jul 15 10:08:36.337693 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:08:36.337622 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed75aef_e275_48df_afe1_cafede0162a7.slice/crio-ca5bff2bbe30225f1a9b78b7c9614bcb503cc21464492672d66af256f91f73af WatchSource:0}: Error finding container ca5bff2bbe30225f1a9b78b7c9614bcb503cc21464492672d66af256f91f73af: Status 404 returned error can't find the container with id ca5bff2bbe30225f1a9b78b7c9614bcb503cc21464492672d66af256f91f73af Jul 15 10:08:37.302262 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:37.302213 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cft4x" event={"ID":"eed75aef-e275-48df-afe1-cafede0162a7","Type":"ContainerStarted","Data":"ca5bff2bbe30225f1a9b78b7c9614bcb503cc21464492672d66af256f91f73af"} Jul 15 10:08:38.230363 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:38.230327 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bkhzv" Jul 15 10:08:42.317226 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:42.317173 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cft4x" event={"ID":"eed75aef-e275-48df-afe1-cafede0162a7","Type":"ContainerStarted","Data":"b82d96176b6781f773fafabce1d121c21754cff952244ee889f1b637773cd41a"} Jul 15 10:08:43.608387 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.608346 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs\") pod \"network-metrics-daemon-jbtcn\" (UID: \"318fb46e-f43b-48f1-8fc3-07f871da0b1e\") " pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:08:43.611686 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.611658 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 10:08:43.621392 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.621369 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/318fb46e-f43b-48f1-8fc3-07f871da0b1e-metrics-certs\") pod \"network-metrics-daemon-jbtcn\" (UID: \"318fb46e-f43b-48f1-8fc3-07f871da0b1e\") " pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:08:43.709752 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.709717 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:08:43.709752 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.709763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff2rf\" (UniqueName: \"kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf\") pod \"network-check-target-zvvh9\" (UID: \"012026aa-ec92-4600-930b-1bf89b1f1653\") " pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:08:43.713432 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.713406 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 10:08:43.713983 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.713960 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 10:08:43.723173 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.723138 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81869c04-f7bf-4cc7-81e2-c7279e070c38-original-pull-secret\") pod \"global-pull-secret-syncer-vhn9t\" (UID: \"81869c04-f7bf-4cc7-81e2-c7279e070c38\") " pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:08:43.723857 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.723835 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 10:08:43.734321 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.734136 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff2rf\" (UniqueName: \"kubernetes.io/projected/012026aa-ec92-4600-930b-1bf89b1f1653-kube-api-access-ff2rf\") pod \"network-check-target-zvvh9\" (UID: \"012026aa-ec92-4600-930b-1bf89b1f1653\") " pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:08:43.893250 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.893162 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhn9t" Jul 15 10:08:43.903280 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.903251 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-swc7s\"" Jul 15 10:08:43.909459 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.909444 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vvbmv\"" Jul 15 10:08:43.910391 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.910376 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:08:43.916411 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:43.916384 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jbtcn" Jul 15 10:08:44.717569 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:44.717546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:44.718132 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:44.717624 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:44.720061 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:44.720040 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls\") pod \"image-registry-747775774-88h9s\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:44.720455 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:44.720434 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/119c6341-b963-43a9-8b75-3aef3cb786e0-metrics-tls\") pod \"dns-default-nlh65\" (UID: \"119c6341-b963-43a9-8b75-3aef3cb786e0\") " pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:44.734854 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:44.734829 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jbtcn"] Jul 15 10:08:44.737909 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:08:44.737885 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod318fb46e_f43b_48f1_8fc3_07f871da0b1e.slice/crio-cc451951585a4584515475080d4f8acf180e7d0a6badfc76c2cb48152475c561 WatchSource:0}: Error finding container cc451951585a4584515475080d4f8acf180e7d0a6badfc76c2cb48152475c561: Status 404 returned error can't find the container with id cc451951585a4584515475080d4f8acf180e7d0a6badfc76c2cb48152475c561 Jul 15 10:08:44.928331 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:44.928253 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ltftg\"" Jul 15 10:08:44.936326 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:44.936299 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:44.937373 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:44.937356 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8qhqb\"" Jul 15 10:08:44.944489 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:44.944464 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vhn9t"] Jul 15 10:08:44.945536 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:44.945519 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:44.947533 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:08:44.947504 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81869c04_f7bf_4cc7_81e2_c7279e070c38.slice/crio-b0cf05786cbf1e5cb6d1ebd47b1c3583979822e5ce0deacb2deff9709fd91251 WatchSource:0}: Error finding container b0cf05786cbf1e5cb6d1ebd47b1c3583979822e5ce0deacb2deff9709fd91251: Status 404 returned error can't find the container with id b0cf05786cbf1e5cb6d1ebd47b1c3583979822e5ce0deacb2deff9709fd91251 Jul 15 10:08:44.948211 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:44.948096 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zvvh9"] Jul 15 10:08:44.951502 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:08:44.951481 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012026aa_ec92_4600_930b_1bf89b1f1653.slice/crio-66e6569509020cbc797d62b375b501cf743e153d18b73515c80f56746ac794da WatchSource:0}: Error finding container 66e6569509020cbc797d62b375b501cf743e153d18b73515c80f56746ac794da: Status 404 returned error can't find the container with id 66e6569509020cbc797d62b375b501cf743e153d18b73515c80f56746ac794da Jul 15 10:08:45.109211 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:45.109178 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-747775774-88h9s"] Jul 15 10:08:45.113944 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:08:45.113902 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5642ee70_4b44_4283_9ec0_370461185ed9.slice/crio-16a4809737d5e2f9b85ede560288a93a31920e9e57453dd4cd4c169b93fbb23e WatchSource:0}: Error finding container 16a4809737d5e2f9b85ede560288a93a31920e9e57453dd4cd4c169b93fbb23e: Status 404 returned error can't find the container with id 16a4809737d5e2f9b85ede560288a93a31920e9e57453dd4cd4c169b93fbb23e Jul 15 10:08:45.132672 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:45.132646 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nlh65"] Jul 15 10:08:45.136243 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:08:45.136223 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119c6341_b963_43a9_8b75_3aef3cb786e0.slice/crio-eb48bf88cd9d74d7b68682b965d55427e3de6ff16420e8174f8bbea85dcb8ba0 WatchSource:0}: Error finding container eb48bf88cd9d74d7b68682b965d55427e3de6ff16420e8174f8bbea85dcb8ba0: Status 404 returned error can't find the container with id eb48bf88cd9d74d7b68682b965d55427e3de6ff16420e8174f8bbea85dcb8ba0 Jul 15 10:08:45.327724 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:45.327685 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jbtcn" event={"ID":"318fb46e-f43b-48f1-8fc3-07f871da0b1e","Type":"ContainerStarted","Data":"cc451951585a4584515475080d4f8acf180e7d0a6badfc76c2cb48152475c561"} Jul 15 10:08:45.329265 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:45.329228 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-747775774-88h9s" event={"ID":"5642ee70-4b44-4283-9ec0-370461185ed9","Type":"ContainerStarted","Data":"54e4a725da09e4e05a793107a10719e57d6f46e1517e56d8b9d393a892823949"} Jul 15 10:08:45.329414 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:45.329283 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-747775774-88h9s" event={"ID":"5642ee70-4b44-4283-9ec0-370461185ed9","Type":"ContainerStarted","Data":"16a4809737d5e2f9b85ede560288a93a31920e9e57453dd4cd4c169b93fbb23e"} Jul 15 10:08:45.329414 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:45.329337 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:08:45.330620 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:45.330591 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zvvh9" event={"ID":"012026aa-ec92-4600-930b-1bf89b1f1653","Type":"ContainerStarted","Data":"66e6569509020cbc797d62b375b501cf743e153d18b73515c80f56746ac794da"} Jul 15 10:08:45.332690 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:45.332659 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cft4x" event={"ID":"eed75aef-e275-48df-afe1-cafede0162a7","Type":"ContainerStarted","Data":"d39eda66b28a7fabb04debbe7d0db2f5861911a0a50281d40087fe089dbe2d3d"} Jul 15 10:08:45.333975 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:45.333953 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nlh65" event={"ID":"119c6341-b963-43a9-8b75-3aef3cb786e0","Type":"ContainerStarted","Data":"eb48bf88cd9d74d7b68682b965d55427e3de6ff16420e8174f8bbea85dcb8ba0"} Jul 15 10:08:45.335113 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:45.335088 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vhn9t" event={"ID":"81869c04-f7bf-4cc7-81e2-c7279e070c38","Type":"ContainerStarted","Data":"b0cf05786cbf1e5cb6d1ebd47b1c3583979822e5ce0deacb2deff9709fd91251"} Jul 15 10:08:45.356670 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:45.356628 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-747775774-88h9s" podStartSLOduration=44.356614672 podStartE2EDuration="44.356614672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:08:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:45.355882647 +0000 UTC m=+67.941549979" watchObservedRunningTime="2026-07-15 10:08:45.356614672 +0000 UTC m=+67.942282029" Jul 15 10:08:47.594562 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.594530 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz"] Jul 15 10:08:47.619816 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.619787 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd"] Jul 15 10:08:47.620003 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.619945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" Jul 15 10:08:47.630797 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.630772 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 10:08:47.630797 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.630786 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 10:08:47.631831 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.631813 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 15 10:08:47.631831 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.631824 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 10:08:47.634082 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.634066 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd" Jul 15 10:08:47.662319 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.662292 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8s4w2\"" Jul 15 10:08:47.662878 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.662856 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 15 10:08:47.663218 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.663200 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz"] Jul 15 10:08:47.682270 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.682236 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd"] Jul 15 10:08:47.683227 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.683205 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-747775774-88h9s"] Jul 15 10:08:47.744058 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.744033 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4996061a-514e-41e0-b27d-6eda1b62e260-klusterlet-config\") pod \"klusterlet-addon-workmgr-64548d578d-xtksz\" (UID: \"4996061a-514e-41e0-b27d-6eda1b62e260\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" Jul 15 10:08:47.744204 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.744065 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1c2242c-727e-42d6-a580-9d8b4e501c90-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd\" (UID: \"c1c2242c-727e-42d6-a580-9d8b4e501c90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd" Jul 15 10:08:47.744204 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.744096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgwbf\" (UniqueName: \"kubernetes.io/projected/4996061a-514e-41e0-b27d-6eda1b62e260-kube-api-access-kgwbf\") pod \"klusterlet-addon-workmgr-64548d578d-xtksz\" (UID: \"4996061a-514e-41e0-b27d-6eda1b62e260\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" Jul 15 10:08:47.744204 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.744167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxcsx\" (UniqueName: \"kubernetes.io/projected/c1c2242c-727e-42d6-a580-9d8b4e501c90-kube-api-access-hxcsx\") pod \"managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd\" (UID: \"c1c2242c-727e-42d6-a580-9d8b4e501c90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd" Jul 15 10:08:47.744374 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.744229 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4996061a-514e-41e0-b27d-6eda1b62e260-tmp\") pod \"klusterlet-addon-workmgr-64548d578d-xtksz\" (UID: \"4996061a-514e-41e0-b27d-6eda1b62e260\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" Jul 15 10:08:47.778225 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.778199 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67c9cbc66-2cntd"] Jul 15 10:08:47.797655 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.797620 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.808018 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.807957 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67c9cbc66-2cntd"] Jul 15 10:08:47.845542 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845468 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-bound-sa-token\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.845542 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845517 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-registry-tls\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.845742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4996061a-514e-41e0-b27d-6eda1b62e260-tmp\") pod \"klusterlet-addon-workmgr-64548d578d-xtksz\" (UID: \"4996061a-514e-41e0-b27d-6eda1b62e260\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" Jul 15 10:08:47.845742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-trusted-ca\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.845742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845604 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-image-registry-private-configuration\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.845742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845641 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-installation-pull-secrets\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.845742 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845674 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-ca-trust-extracted\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.846034 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4996061a-514e-41e0-b27d-6eda1b62e260-klusterlet-config\") pod \"klusterlet-addon-workmgr-64548d578d-xtksz\" (UID: \"4996061a-514e-41e0-b27d-6eda1b62e260\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" Jul 15 10:08:47.846034 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1c2242c-727e-42d6-a580-9d8b4e501c90-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd\" (UID: \"c1c2242c-727e-42d6-a580-9d8b4e501c90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd" Jul 15 10:08:47.846034 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g98x8\" (UniqueName: \"kubernetes.io/projected/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-kube-api-access-g98x8\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.846034 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845864 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgwbf\" (UniqueName: \"kubernetes.io/projected/4996061a-514e-41e0-b27d-6eda1b62e260-kube-api-access-kgwbf\") pod \"klusterlet-addon-workmgr-64548d578d-xtksz\" (UID: \"4996061a-514e-41e0-b27d-6eda1b62e260\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" Jul 15 10:08:47.846034 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845884 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-registry-certificates\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.846034 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845903 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4996061a-514e-41e0-b27d-6eda1b62e260-tmp\") pod \"klusterlet-addon-workmgr-64548d578d-xtksz\" (UID: \"4996061a-514e-41e0-b27d-6eda1b62e260\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" Jul 15 10:08:47.846034 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.845910 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxcsx\" (UniqueName: \"kubernetes.io/projected/c1c2242c-727e-42d6-a580-9d8b4e501c90-kube-api-access-hxcsx\") pod \"managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd\" (UID: \"c1c2242c-727e-42d6-a580-9d8b4e501c90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd" Jul 15 10:08:47.849252 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.848780 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4996061a-514e-41e0-b27d-6eda1b62e260-klusterlet-config\") pod \"klusterlet-addon-workmgr-64548d578d-xtksz\" (UID: \"4996061a-514e-41e0-b27d-6eda1b62e260\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" Jul 15 10:08:47.849360 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.849343 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1c2242c-727e-42d6-a580-9d8b4e501c90-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd\" (UID: \"c1c2242c-727e-42d6-a580-9d8b4e501c90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd" Jul 15 10:08:47.871383 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.871356 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxcsx\" (UniqueName: \"kubernetes.io/projected/c1c2242c-727e-42d6-a580-9d8b4e501c90-kube-api-access-hxcsx\") pod \"managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd\" (UID: \"c1c2242c-727e-42d6-a580-9d8b4e501c90\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd" Jul 15 10:08:47.873575 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.873552 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgwbf\" (UniqueName: \"kubernetes.io/projected/4996061a-514e-41e0-b27d-6eda1b62e260-kube-api-access-kgwbf\") pod \"klusterlet-addon-workmgr-64548d578d-xtksz\" (UID: \"4996061a-514e-41e0-b27d-6eda1b62e260\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" Jul 15 10:08:47.931133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.931077 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" Jul 15 10:08:47.946752 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.946728 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g98x8\" (UniqueName: \"kubernetes.io/projected/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-kube-api-access-g98x8\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.946894 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.946766 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-registry-certificates\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.946894 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.946802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-bound-sa-token\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.946894 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.946837 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-registry-tls\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.946894 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.946872 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-trusted-ca\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.947128 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.946899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-image-registry-private-configuration\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.947128 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.946965 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-installation-pull-secrets\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.947128 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.947002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-ca-trust-extracted\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.947963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.947488 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-ca-trust-extracted\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.947963 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.947898 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-registry-certificates\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.948130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.947975 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-trusted-ca\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.949748 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.949726 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd" Jul 15 10:08:47.951027 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.950972 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-image-registry-private-configuration\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.951027 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.950990 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-registry-tls\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.951369 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.951345 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-installation-pull-secrets\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.970549 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.970526 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g98x8\" (UniqueName: \"kubernetes.io/projected/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-kube-api-access-g98x8\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:47.972192 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:47.972169 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72db0911-fa1d-4b1d-bfe5-bea60edf72e6-bound-sa-token\") pod \"image-registry-67c9cbc66-2cntd\" (UID: \"72db0911-fa1d-4b1d-bfe5-bea60edf72e6\") " pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:48.108729 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:48.108639 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:50.043076 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.043045 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cfc6c77c4-lksvt"] Jul 15 10:08:50.046201 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.046182 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.049663 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.049637 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 10:08:50.049790 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.049771 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 10:08:50.049951 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.049916 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 10:08:50.050090 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.050032 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 10:08:50.051114 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.051091 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 10:08:50.051212 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.051154 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k5jsr\"" Jul 15 10:08:50.051284 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.051216 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 10:08:50.051284 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.051220 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 10:08:50.062056 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.062036 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cfc6c77c4-lksvt"] Jul 15 10:08:50.165491 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.165450 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64tfx\" (UniqueName: \"kubernetes.io/projected/a47aa0ce-18dc-461e-b521-4783411438c1-kube-api-access-64tfx\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.165664 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.165512 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a47aa0ce-18dc-461e-b521-4783411438c1-console-serving-cert\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.165664 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.165575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-console-config\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.165664 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.165629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-service-ca\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.165664 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.165662 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a47aa0ce-18dc-461e-b521-4783411438c1-console-oauth-config\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.165849 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.165704 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-oauth-serving-cert\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.266897 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.266822 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64tfx\" (UniqueName: \"kubernetes.io/projected/a47aa0ce-18dc-461e-b521-4783411438c1-kube-api-access-64tfx\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.266897 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.266894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a47aa0ce-18dc-461e-b521-4783411438c1-console-serving-cert\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.267157 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.266941 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-console-config\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.267157 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.266977 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-service-ca\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.267157 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.267015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a47aa0ce-18dc-461e-b521-4783411438c1-console-oauth-config\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.267157 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.267036 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-oauth-serving-cert\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.267875 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.267842 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-console-config\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.267875 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.267862 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-oauth-serving-cert\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.268153 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.268106 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-service-ca\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.270314 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.270285 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a47aa0ce-18dc-461e-b521-4783411438c1-console-oauth-config\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.270415 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.270347 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a47aa0ce-18dc-461e-b521-4783411438c1-console-serving-cert\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.277863 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.277837 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64tfx\" (UniqueName: \"kubernetes.io/projected/a47aa0ce-18dc-461e-b521-4783411438c1-kube-api-access-64tfx\") pod \"console-7cfc6c77c4-lksvt\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:50.356886 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:50.356809 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:08:52.124448 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.124420 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd"] Jul 15 10:08:52.131441 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:08:52.131391 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1c2242c_727e_42d6_a580_9d8b4e501c90.slice/crio-7dd0f1aed635c0d62bfe165e45b3699a36c86828afd02a5f7ae1e71455054685 WatchSource:0}: Error finding container 7dd0f1aed635c0d62bfe165e45b3699a36c86828afd02a5f7ae1e71455054685: Status 404 returned error can't find the container with id 7dd0f1aed635c0d62bfe165e45b3699a36c86828afd02a5f7ae1e71455054685 Jul 15 10:08:52.141080 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.140538 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cfc6c77c4-lksvt"] Jul 15 10:08:52.147794 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:08:52.147761 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47aa0ce_18dc_461e_b521_4783411438c1.slice/crio-a95e7c1723cbf04ceeddba569f5a44e255138d30e60e7f542170e5f111c725f5 WatchSource:0}: Error finding container a95e7c1723cbf04ceeddba569f5a44e255138d30e60e7f542170e5f111c725f5: Status 404 returned error can't find the container with id a95e7c1723cbf04ceeddba569f5a44e255138d30e60e7f542170e5f111c725f5 Jul 15 10:08:52.157845 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.157779 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz"] Jul 15 10:08:52.193283 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.192233 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67c9cbc66-2cntd"] Jul 15 10:08:52.197893 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:08:52.197861 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72db0911_fa1d_4b1d_bfe5_bea60edf72e6.slice/crio-7817d019e1fc0dd4c35efcc3f62d6019f7ba2af3e7e69b689465e4162aa9b098 WatchSource:0}: Error finding container 7817d019e1fc0dd4c35efcc3f62d6019f7ba2af3e7e69b689465e4162aa9b098: Status 404 returned error can't find the container with id 7817d019e1fc0dd4c35efcc3f62d6019f7ba2af3e7e69b689465e4162aa9b098 Jul 15 10:08:52.362787 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.362755 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zvvh9" event={"ID":"012026aa-ec92-4600-930b-1bf89b1f1653","Type":"ContainerStarted","Data":"4477c5835c1df103ca8b3c6aa54eeeec5863c5f60819181398c0eca237c1e00f"} Jul 15 10:08:52.362993 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.362872 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:08:52.364911 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.364890 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cft4x" event={"ID":"eed75aef-e275-48df-afe1-cafede0162a7","Type":"ContainerStarted","Data":"531f6cc28664fe1e1d993b15af54f588a6dabd8ad327164240ef838cc7437721"} Jul 15 10:08:52.368986 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.368964 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nlh65" event={"ID":"119c6341-b963-43a9-8b75-3aef3cb786e0","Type":"ContainerStarted","Data":"85cd6d8501392cf3fd17d62ef3f89e24882b267adca2bafab4f6c7046066ee24"} Jul 15 10:08:52.369094 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.369010 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nlh65" event={"ID":"119c6341-b963-43a9-8b75-3aef3cb786e0","Type":"ContainerStarted","Data":"a0a7ca4487ad4dec40c7574d027c4a1114e62fbdfc281bf18e206559d551cf0e"} Jul 15 10:08:52.369094 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.369076 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nlh65" Jul 15 10:08:52.370656 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.370630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vhn9t" event={"ID":"81869c04-f7bf-4cc7-81e2-c7279e070c38","Type":"ContainerStarted","Data":"f9e2120588d53a0255241a03c5bfcf08682cacb7c3e7e487fb99e5a70cdb4faa"} Jul 15 10:08:52.371745 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.371728 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd" event={"ID":"c1c2242c-727e-42d6-a580-9d8b4e501c90","Type":"ContainerStarted","Data":"7dd0f1aed635c0d62bfe165e45b3699a36c86828afd02a5f7ae1e71455054685"} Jul 15 10:08:52.372921 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.372897 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfc6c77c4-lksvt" event={"ID":"a47aa0ce-18dc-461e-b521-4783411438c1","Type":"ContainerStarted","Data":"a95e7c1723cbf04ceeddba569f5a44e255138d30e60e7f542170e5f111c725f5"} Jul 15 10:08:52.374619 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.374594 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jbtcn" event={"ID":"318fb46e-f43b-48f1-8fc3-07f871da0b1e","Type":"ContainerStarted","Data":"7cabbe1bb204dc5a0d2173888a797da803c44a26c7ae25a7f3c3552ad1d394f9"} Jul 15 10:08:52.374706 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.374636 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jbtcn" event={"ID":"318fb46e-f43b-48f1-8fc3-07f871da0b1e","Type":"ContainerStarted","Data":"b205ca6cac25430eee6b55190d2d6705dde8df9fb8b1986efbcc0698963b3daf"} Jul 15 10:08:52.375604 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.375585 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" event={"ID":"4996061a-514e-41e0-b27d-6eda1b62e260","Type":"ContainerStarted","Data":"ed5c0fc12e64d5d7eddb4913a46ae8d1c58d28621cf9513b8bda559378f191c8"} Jul 15 10:08:52.376997 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.376979 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" event={"ID":"72db0911-fa1d-4b1d-bfe5-bea60edf72e6","Type":"ContainerStarted","Data":"4314e2c9441860f39508aec280cb55a205a1206354781c63f5972f1131342a08"} Jul 15 10:08:52.377108 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.377016 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" event={"ID":"72db0911-fa1d-4b1d-bfe5-bea60edf72e6","Type":"ContainerStarted","Data":"7817d019e1fc0dd4c35efcc3f62d6019f7ba2af3e7e69b689465e4162aa9b098"} Jul 15 10:08:52.377108 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.377053 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:08:52.381446 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.381408 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zvvh9" podStartSLOduration=67.44417966 podStartE2EDuration="1m14.381396335s" totalImagesPullingTime="6.937216675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:52.381068574 +0000 UTC m=+74.966735924" watchObservedRunningTime="2026-07-15 10:08:52.381396335 +0000 UTC m=+74.967063666" Jul 15 10:08:52.399688 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.399619 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cft4x" podStartSLOduration=16.998397948 podStartE2EDuration="32.399604903s" totalImagesPullingTime="15.401206955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:08:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:52.398727886 +0000 UTC m=+74.984395214" watchObservedRunningTime="2026-07-15 10:08:52.399604903 +0000 UTC m=+74.985272233" Jul 15 10:08:52.419798 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.419750 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" podStartSLOduration=5.4197314930000005 podStartE2EDuration="5.419731493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:52.41867878 +0000 UTC m=+75.004346142" watchObservedRunningTime="2026-07-15 10:08:52.419731493 +0000 UTC m=+75.005398826" Jul 15 10:08:52.438092 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.438050 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nlh65" podStartSLOduration=33.688113309 podStartE2EDuration="40.438037037s" totalImagesPullingTime="6.749923728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:52.436953335 +0000 UTC m=+75.022620666" watchObservedRunningTime="2026-07-15 10:08:52.438037037 +0000 UTC m=+75.023704371" Jul 15 10:08:52.455125 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.455084 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jbtcn" podStartSLOduration=67.302016654 podStartE2EDuration="1m14.455070024s" totalImagesPullingTime="7.15305337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:52.454073833 +0000 UTC m=+75.039741163" watchObservedRunningTime="2026-07-15 10:08:52.455070024 +0000 UTC m=+75.040737333" Jul 15 10:08:52.471339 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:52.471295 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vhn9t" podStartSLOduration=67.466408802 podStartE2EDuration="1m14.471282832s" totalImagesPullingTime="7.00487403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:52.470113478 +0000 UTC m=+75.055780809" watchObservedRunningTime="2026-07-15 10:08:52.471282832 +0000 UTC m=+75.056950202" Jul 15 10:08:58.401764 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.401723 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfc6c77c4-lksvt" event={"ID":"a47aa0ce-18dc-461e-b521-4783411438c1","Type":"ContainerStarted","Data":"4c04a7592ef78a990fff5e44cb25fa061c3742d968827264df50e48fc0bfc0eb"} Jul 15 10:08:58.403308 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.403282 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" event={"ID":"4996061a-514e-41e0-b27d-6eda1b62e260","Type":"ContainerStarted","Data":"d93bfc0394360befaf7fa87509c36e1fb0ecbbaad17d3092dac5fa310d47b981"} Jul 15 10:08:58.403443 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.403325 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" Jul 15 10:08:58.404775 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.404737 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd" event={"ID":"c1c2242c-727e-42d6-a580-9d8b4e501c90","Type":"ContainerStarted","Data":"c3862e1f8b2ffae1b800dec3b54e763fa9a4b641a9cd3525aed53416df6890eb"} Jul 15 10:08:58.405415 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.405395 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" Jul 15 10:08:58.419914 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.419693 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cfc6c77c4-lksvt" podStartSLOduration=3.147960389 podStartE2EDuration="8.419679326s" totalImagesPullingTime="5.271718937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:58.419638173 +0000 UTC m=+81.005305495" watchObservedRunningTime="2026-07-15 10:08:58.419679326 +0000 UTC m=+81.005346648" Jul 15 10:08:58.436054 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.436007 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64548d578d-xtksz" podStartSLOduration=6.185990198 podStartE2EDuration="11.435992228s" totalImagesPullingTime="5.25000203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:58.43559091 +0000 UTC m=+81.021258241" watchObservedRunningTime="2026-07-15 10:08:58.435992228 +0000 UTC m=+81.021659558" Jul 15 10:08:58.455041 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.454998 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bbc57dc8-5bdsd" podStartSLOduration=6.212340722 podStartE2EDuration="11.454983019s" totalImagesPullingTime="5.242642297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:58.454107461 +0000 UTC m=+81.039774792" watchObservedRunningTime="2026-07-15 10:08:58.454983019 +0000 UTC m=+81.040650350" Jul 15 10:08:58.812768 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.812740 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c6967d4db-phzdh"] Jul 15 10:08:58.816350 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.816335 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:58.823684 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.823666 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 10:08:58.827406 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.827383 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6967d4db-phzdh"] Jul 15 10:08:58.952370 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.952334 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-serving-cert\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:58.952370 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.952376 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-config\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:58.952583 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.952402 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-trusted-ca-bundle\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:58.952583 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.952439 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-service-ca\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:58.952583 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.952462 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-oauth-config\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:58.952583 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.952519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6cnv\" (UniqueName: \"kubernetes.io/projected/d8387dd8-12d7-4053-9d35-6fad5d752bdb-kube-api-access-f6cnv\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:58.952583 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:58.952538 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-oauth-serving-cert\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.053728 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.053684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cnv\" (UniqueName: \"kubernetes.io/projected/d8387dd8-12d7-4053-9d35-6fad5d752bdb-kube-api-access-f6cnv\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.053859 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.053738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-oauth-serving-cert\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.053859 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.053779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-serving-cert\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.053859 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.053806 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-config\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.053859 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.053821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-trusted-ca-bundle\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.053859 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.053841 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-service-ca\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.054114 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.053861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-oauth-config\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.054584 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.054558 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-oauth-serving-cert\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.054689 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.054558 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-config\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.054741 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.054706 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-service-ca\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.054778 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.054737 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-trusted-ca-bundle\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.056271 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.056249 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-oauth-config\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.056392 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.056373 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-serving-cert\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.063337 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.063284 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6cnv\" (UniqueName: \"kubernetes.io/projected/d8387dd8-12d7-4053-9d35-6fad5d752bdb-kube-api-access-f6cnv\") pod \"console-c6967d4db-phzdh\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.125340 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.125302 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:08:59.251649 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.251616 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6967d4db-phzdh"] Jul 15 10:08:59.255572 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:08:59.255541 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8387dd8_12d7_4053_9d35_6fad5d752bdb.slice/crio-8912ef696dc7314c1fa29c1a6bed30c9f08c9e8cb1ac2266e1d53f1b090a8f24 WatchSource:0}: Error finding container 8912ef696dc7314c1fa29c1a6bed30c9f08c9e8cb1ac2266e1d53f1b090a8f24: Status 404 returned error can't find the container with id 8912ef696dc7314c1fa29c1a6bed30c9f08c9e8cb1ac2266e1d53f1b090a8f24 Jul 15 10:08:59.410324 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.410234 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6967d4db-phzdh" event={"ID":"d8387dd8-12d7-4053-9d35-6fad5d752bdb","Type":"ContainerStarted","Data":"b4fb8be0d576c5c786a76ec783f21aa0ac86d82df82e7a330f54ce68882ade7d"} Jul 15 10:08:59.410324 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.410280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6967d4db-phzdh" event={"ID":"d8387dd8-12d7-4053-9d35-6fad5d752bdb","Type":"ContainerStarted","Data":"8912ef696dc7314c1fa29c1a6bed30c9f08c9e8cb1ac2266e1d53f1b090a8f24"} Jul 15 10:08:59.428215 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:08:59.428142 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c6967d4db-phzdh" podStartSLOduration=1.428126057 podStartE2EDuration="1.428126057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:08:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:08:59.427242561 +0000 UTC m=+82.012909892" watchObservedRunningTime="2026-07-15 10:08:59.428126057 +0000 UTC m=+82.013793387" Jul 15 10:09:00.357827 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:00.357791 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:09:00.358015 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:00.357857 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:09:00.362410 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:00.362389 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:09:00.416827 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:00.416804 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:09:02.385583 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:02.385554 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nlh65" Jul 15 10:09:03.571368 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.571331 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pj2qn"] Jul 15 10:09:03.576350 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.576327 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.578941 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.578901 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nzmx6\"" Jul 15 10:09:03.579058 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.579029 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 10:09:03.579279 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.579259 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 10:09:03.579863 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.579841 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 10:09:03.579988 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.579903 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 10:09:03.579988 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.579951 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 10:09:03.580098 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.579953 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 10:09:03.689624 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.689586 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-wtmp\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.689867 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.689629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ceba64ce-55bb-4176-9f94-7f1e47962740-metrics-client-ca\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.689867 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.689655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qgcd\" (UniqueName: \"kubernetes.io/projected/ceba64ce-55bb-4176-9f94-7f1e47962740-kube-api-access-5qgcd\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.689867 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.689787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.689867 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.689836 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ceba64ce-55bb-4176-9f94-7f1e47962740-sys\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.690120 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.689901 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-tls\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.690120 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.689971 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ceba64ce-55bb-4176-9f94-7f1e47962740-root\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.690120 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.690010 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-textfile\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.690120 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.690064 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-accelerators-collector-config\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.790719 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.790683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-textfile\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.790886 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.790741 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-accelerators-collector-config\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.790886 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.790779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-wtmp\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.790886 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.790815 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ceba64ce-55bb-4176-9f94-7f1e47962740-metrics-client-ca\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.790886 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.790847 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qgcd\" (UniqueName: \"kubernetes.io/projected/ceba64ce-55bb-4176-9f94-7f1e47962740-kube-api-access-5qgcd\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.790886 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.790883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.791145 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.790920 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ceba64ce-55bb-4176-9f94-7f1e47962740-sys\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.791145 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.790965 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-tls\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.791145 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.790992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ceba64ce-55bb-4176-9f94-7f1e47962740-root\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.791145 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.791061 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ceba64ce-55bb-4176-9f94-7f1e47962740-root\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.791145 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.791074 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-textfile\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.791376 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.791210 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-wtmp\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.791376 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.791250 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ceba64ce-55bb-4176-9f94-7f1e47962740-sys\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.791951 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.791907 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ceba64ce-55bb-4176-9f94-7f1e47962740-metrics-client-ca\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.792057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.791979 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-accelerators-collector-config\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.794379 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.794357 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-tls\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.794688 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.794668 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ceba64ce-55bb-4176-9f94-7f1e47962740-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.799952 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.799882 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qgcd\" (UniqueName: \"kubernetes.io/projected/ceba64ce-55bb-4176-9f94-7f1e47962740-kube-api-access-5qgcd\") pod \"node-exporter-pj2qn\" (UID: \"ceba64ce-55bb-4176-9f94-7f1e47962740\") " pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.887732 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:03.887628 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pj2qn" Jul 15 10:09:03.898660 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:09:03.898632 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceba64ce_55bb_4176_9f94_7f1e47962740.slice/crio-b22d2447fc26c15094cc4b0b9702c8ae5d4ee70830fa1306f960924705b2be0d WatchSource:0}: Error finding container b22d2447fc26c15094cc4b0b9702c8ae5d4ee70830fa1306f960924705b2be0d: Status 404 returned error can't find the container with id b22d2447fc26c15094cc4b0b9702c8ae5d4ee70830fa1306f960924705b2be0d Jul 15 10:09:04.427958 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:04.427909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj2qn" event={"ID":"ceba64ce-55bb-4176-9f94-7f1e47962740","Type":"ContainerStarted","Data":"b22d2447fc26c15094cc4b0b9702c8ae5d4ee70830fa1306f960924705b2be0d"} Jul 15 10:09:05.432534 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:05.432450 2580 generic.go:356] "Generic (PLEG): container finished" podID="ceba64ce-55bb-4176-9f94-7f1e47962740" containerID="31d5131ec854f97209975403f8eac314a24fafebbe8ee810abc258874251da14" exitCode=0 Jul 15 10:09:05.432534 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:05.432488 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj2qn" event={"ID":"ceba64ce-55bb-4176-9f94-7f1e47962740","Type":"ContainerDied","Data":"31d5131ec854f97209975403f8eac314a24fafebbe8ee810abc258874251da14"} Jul 15 10:09:06.437868 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:06.437833 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj2qn" event={"ID":"ceba64ce-55bb-4176-9f94-7f1e47962740","Type":"ContainerStarted","Data":"b3d080d38dee4d1d60b1478c9bec234edb5b15b1b85d346f7404c53fe6c14b47"} Jul 15 10:09:06.438310 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:06.437891 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj2qn" event={"ID":"ceba64ce-55bb-4176-9f94-7f1e47962740","Type":"ContainerStarted","Data":"46f2b40ea80d4ad4e8c6559a3c2cadb7480e3580863791209f61d5f4d728dad9"} Jul 15 10:09:06.460321 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:06.460271 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pj2qn" podStartSLOduration=2.264182124 podStartE2EDuration="3.460254368s" totalImagesPullingTime="1.134737202s" totalInitContainerRuntime="61.335042ms" isStatefulPod=true podCreationTimestamp="2026-07-15 10:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:09:06.458567509 +0000 UTC m=+89.044234849" watchObservedRunningTime="2026-07-15 10:09:06.460254368 +0000 UTC m=+89.045921754" Jul 15 10:09:07.689613 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:07.689582 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:09:09.024842 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:09.024807 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6967d4db-phzdh"] Jul 15 10:09:09.125578 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:09.125544 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:09:12.713217 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:12.713173 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-747775774-88h9s" podUID="5642ee70-4b44-4283-9ec0-370461185ed9" containerName="registry" containerID="cri-o://54e4a725da09e4e05a793107a10719e57d6f46e1517e56d8b9d393a892823949" gracePeriod=30 Jul 15 10:09:12.949915 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:12.949893 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:09:13.067189 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.067153 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5642ee70-4b44-4283-9ec0-370461185ed9-installation-pull-secrets\") pod \"5642ee70-4b44-4283-9ec0-370461185ed9\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " Jul 15 10:09:13.067372 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.067198 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5642ee70-4b44-4283-9ec0-370461185ed9-ca-trust-extracted\") pod \"5642ee70-4b44-4283-9ec0-370461185ed9\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " Jul 15 10:09:13.067372 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.067238 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-bound-sa-token\") pod \"5642ee70-4b44-4283-9ec0-370461185ed9\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " Jul 15 10:09:13.067372 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.067263 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls\") pod \"5642ee70-4b44-4283-9ec0-370461185ed9\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " Jul 15 10:09:13.067372 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.067279 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5642ee70-4b44-4283-9ec0-370461185ed9-registry-certificates\") pod \"5642ee70-4b44-4283-9ec0-370461185ed9\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " Jul 15 10:09:13.067372 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.067328 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5642ee70-4b44-4283-9ec0-370461185ed9-image-registry-private-configuration\") pod \"5642ee70-4b44-4283-9ec0-370461185ed9\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " Jul 15 10:09:13.067628 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.067376 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spw7j\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-kube-api-access-spw7j\") pod \"5642ee70-4b44-4283-9ec0-370461185ed9\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " Jul 15 10:09:13.067628 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.067428 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5642ee70-4b44-4283-9ec0-370461185ed9-trusted-ca\") pod \"5642ee70-4b44-4283-9ec0-370461185ed9\" (UID: \"5642ee70-4b44-4283-9ec0-370461185ed9\") " Jul 15 10:09:13.067847 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.067788 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5642ee70-4b44-4283-9ec0-370461185ed9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5642ee70-4b44-4283-9ec0-370461185ed9" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:09:13.068054 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.067999 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5642ee70-4b44-4283-9ec0-370461185ed9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5642ee70-4b44-4283-9ec0-370461185ed9" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:09:13.069849 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.069802 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5642ee70-4b44-4283-9ec0-370461185ed9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5642ee70-4b44-4283-9ec0-370461185ed9" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:09:13.069969 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.069864 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5642ee70-4b44-4283-9ec0-370461185ed9" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:09:13.070045 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.069993 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5642ee70-4b44-4283-9ec0-370461185ed9" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:09:13.070103 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.070079 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-kube-api-access-spw7j" (OuterVolumeSpecName: "kube-api-access-spw7j") pod "5642ee70-4b44-4283-9ec0-370461185ed9" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9"). InnerVolumeSpecName "kube-api-access-spw7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:09:13.070103 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.070092 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5642ee70-4b44-4283-9ec0-370461185ed9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5642ee70-4b44-4283-9ec0-370461185ed9" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:09:13.076004 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.075978 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5642ee70-4b44-4283-9ec0-370461185ed9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5642ee70-4b44-4283-9ec0-370461185ed9" (UID: "5642ee70-4b44-4283-9ec0-370461185ed9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 10:09:13.168677 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.168642 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5642ee70-4b44-4283-9ec0-370461185ed9-ca-trust-extracted\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:13.168677 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.168672 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-bound-sa-token\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:13.168677 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.168682 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-registry-tls\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:13.168890 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.168689 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5642ee70-4b44-4283-9ec0-370461185ed9-registry-certificates\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:13.168890 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.168699 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5642ee70-4b44-4283-9ec0-370461185ed9-image-registry-private-configuration\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:13.168890 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.168707 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spw7j\" (UniqueName: \"kubernetes.io/projected/5642ee70-4b44-4283-9ec0-370461185ed9-kube-api-access-spw7j\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:13.168890 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.168715 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5642ee70-4b44-4283-9ec0-370461185ed9-trusted-ca\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:13.168890 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.168723 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5642ee70-4b44-4283-9ec0-370461185ed9-installation-pull-secrets\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:13.386720 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.386643 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67c9cbc66-2cntd" Jul 15 10:09:13.462898 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.462869 2580 generic.go:356] "Generic (PLEG): container finished" podID="5642ee70-4b44-4283-9ec0-370461185ed9" containerID="54e4a725da09e4e05a793107a10719e57d6f46e1517e56d8b9d393a892823949" exitCode=0 Jul 15 10:09:13.463067 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.462943 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747775774-88h9s" Jul 15 10:09:13.463067 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.462963 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-747775774-88h9s" event={"ID":"5642ee70-4b44-4283-9ec0-370461185ed9","Type":"ContainerDied","Data":"54e4a725da09e4e05a793107a10719e57d6f46e1517e56d8b9d393a892823949"} Jul 15 10:09:13.463067 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.463009 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-747775774-88h9s" event={"ID":"5642ee70-4b44-4283-9ec0-370461185ed9","Type":"ContainerDied","Data":"16a4809737d5e2f9b85ede560288a93a31920e9e57453dd4cd4c169b93fbb23e"} Jul 15 10:09:13.463067 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.463027 2580 scope.go:117] "RemoveContainer" containerID="54e4a725da09e4e05a793107a10719e57d6f46e1517e56d8b9d393a892823949" Jul 15 10:09:13.471466 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.471449 2580 scope.go:117] "RemoveContainer" containerID="54e4a725da09e4e05a793107a10719e57d6f46e1517e56d8b9d393a892823949" Jul 15 10:09:13.471727 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:09:13.471710 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54e4a725da09e4e05a793107a10719e57d6f46e1517e56d8b9d393a892823949\": container with ID starting with 54e4a725da09e4e05a793107a10719e57d6f46e1517e56d8b9d393a892823949 not found: ID does not exist" containerID="54e4a725da09e4e05a793107a10719e57d6f46e1517e56d8b9d393a892823949" Jul 15 10:09:13.471775 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.471733 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e4a725da09e4e05a793107a10719e57d6f46e1517e56d8b9d393a892823949"} err="failed to get container status \"54e4a725da09e4e05a793107a10719e57d6f46e1517e56d8b9d393a892823949\": rpc error: code = NotFound desc = could not find container \"54e4a725da09e4e05a793107a10719e57d6f46e1517e56d8b9d393a892823949\": container with ID starting with 54e4a725da09e4e05a793107a10719e57d6f46e1517e56d8b9d393a892823949 not found: ID does not exist" Jul 15 10:09:13.485230 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.485203 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-747775774-88h9s"] Jul 15 10:09:13.491359 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.491340 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-747775774-88h9s"] Jul 15 10:09:13.986920 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:13.986883 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5642ee70-4b44-4283-9ec0-370461185ed9" path="/var/lib/kubelet/pods/5642ee70-4b44-4283-9ec0-370461185ed9/volumes" Jul 15 10:09:20.365024 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:20.364992 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cfc6c77c4-lksvt"] Jul 15 10:09:23.385001 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:23.384964 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zvvh9" Jul 15 10:09:34.044777 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.044720 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c6967d4db-phzdh" podUID="d8387dd8-12d7-4053-9d35-6fad5d752bdb" containerName="console" containerID="cri-o://b4fb8be0d576c5c786a76ec783f21aa0ac86d82df82e7a330f54ce68882ade7d" gracePeriod=15 Jul 15 10:09:34.284544 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.284521 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:09:34.300734 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.300677 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-serving-cert\") pod \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " Jul 15 10:09:34.300734 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.300714 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-config\") pod \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " Jul 15 10:09:34.300734 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.300729 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-trusted-ca-bundle\") pod \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " Jul 15 10:09:34.300900 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.300750 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-oauth-config\") pod \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " Jul 15 10:09:34.300900 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.300801 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-oauth-serving-cert\") pod \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " Jul 15 10:09:34.300900 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.300828 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6cnv\" (UniqueName: \"kubernetes.io/projected/d8387dd8-12d7-4053-9d35-6fad5d752bdb-kube-api-access-f6cnv\") pod \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " Jul 15 10:09:34.300900 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.300863 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-service-ca\") pod \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\" (UID: \"d8387dd8-12d7-4053-9d35-6fad5d752bdb\") " Jul 15 10:09:34.301132 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.301103 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-config" (OuterVolumeSpecName: "console-config") pod "d8387dd8-12d7-4053-9d35-6fad5d752bdb" (UID: "d8387dd8-12d7-4053-9d35-6fad5d752bdb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:09:34.301291 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.301230 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d8387dd8-12d7-4053-9d35-6fad5d752bdb" (UID: "d8387dd8-12d7-4053-9d35-6fad5d752bdb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:09:34.301291 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.301259 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d8387dd8-12d7-4053-9d35-6fad5d752bdb" (UID: "d8387dd8-12d7-4053-9d35-6fad5d752bdb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:09:34.301473 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.301328 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-service-ca" (OuterVolumeSpecName: "service-ca") pod "d8387dd8-12d7-4053-9d35-6fad5d752bdb" (UID: "d8387dd8-12d7-4053-9d35-6fad5d752bdb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:09:34.303054 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.303032 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d8387dd8-12d7-4053-9d35-6fad5d752bdb" (UID: "d8387dd8-12d7-4053-9d35-6fad5d752bdb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:09:34.303054 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.303024 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8387dd8-12d7-4053-9d35-6fad5d752bdb-kube-api-access-f6cnv" (OuterVolumeSpecName: "kube-api-access-f6cnv") pod "d8387dd8-12d7-4053-9d35-6fad5d752bdb" (UID: "d8387dd8-12d7-4053-9d35-6fad5d752bdb"). InnerVolumeSpecName "kube-api-access-f6cnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:09:34.303188 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.303172 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d8387dd8-12d7-4053-9d35-6fad5d752bdb" (UID: "d8387dd8-12d7-4053-9d35-6fad5d752bdb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:09:34.401968 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.401901 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-serving-cert\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:34.401968 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.401962 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-config\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:34.401968 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.401973 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-trusted-ca-bundle\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:34.401968 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.401981 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8387dd8-12d7-4053-9d35-6fad5d752bdb-console-oauth-config\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:34.401968 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.401989 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-oauth-serving-cert\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:34.402260 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.401997 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6cnv\" (UniqueName: \"kubernetes.io/projected/d8387dd8-12d7-4053-9d35-6fad5d752bdb-kube-api-access-f6cnv\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:34.402260 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.402007 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8387dd8-12d7-4053-9d35-6fad5d752bdb-service-ca\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:34.539303 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.539274 2580 generic.go:356] "Generic (PLEG): container finished" podID="d8387dd8-12d7-4053-9d35-6fad5d752bdb" containerID="b4fb8be0d576c5c786a76ec783f21aa0ac86d82df82e7a330f54ce68882ade7d" exitCode=0 Jul 15 10:09:34.539458 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.539321 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6967d4db-phzdh" Jul 15 10:09:34.539458 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.539361 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6967d4db-phzdh" event={"ID":"d8387dd8-12d7-4053-9d35-6fad5d752bdb","Type":"ContainerDied","Data":"b4fb8be0d576c5c786a76ec783f21aa0ac86d82df82e7a330f54ce68882ade7d"} Jul 15 10:09:34.539458 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.539415 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6967d4db-phzdh" event={"ID":"d8387dd8-12d7-4053-9d35-6fad5d752bdb","Type":"ContainerDied","Data":"8912ef696dc7314c1fa29c1a6bed30c9f08c9e8cb1ac2266e1d53f1b090a8f24"} Jul 15 10:09:34.539458 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.539435 2580 scope.go:117] "RemoveContainer" containerID="b4fb8be0d576c5c786a76ec783f21aa0ac86d82df82e7a330f54ce68882ade7d" Jul 15 10:09:34.548079 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.548063 2580 scope.go:117] "RemoveContainer" containerID="b4fb8be0d576c5c786a76ec783f21aa0ac86d82df82e7a330f54ce68882ade7d" Jul 15 10:09:34.548332 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:09:34.548312 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4fb8be0d576c5c786a76ec783f21aa0ac86d82df82e7a330f54ce68882ade7d\": container with ID starting with b4fb8be0d576c5c786a76ec783f21aa0ac86d82df82e7a330f54ce68882ade7d not found: ID does not exist" containerID="b4fb8be0d576c5c786a76ec783f21aa0ac86d82df82e7a330f54ce68882ade7d" Jul 15 10:09:34.548387 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.548341 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fb8be0d576c5c786a76ec783f21aa0ac86d82df82e7a330f54ce68882ade7d"} err="failed to get container status \"b4fb8be0d576c5c786a76ec783f21aa0ac86d82df82e7a330f54ce68882ade7d\": rpc error: code = NotFound desc = could not find container \"b4fb8be0d576c5c786a76ec783f21aa0ac86d82df82e7a330f54ce68882ade7d\": container with ID starting with b4fb8be0d576c5c786a76ec783f21aa0ac86d82df82e7a330f54ce68882ade7d not found: ID does not exist" Jul 15 10:09:34.568347 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.568277 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6967d4db-phzdh"] Jul 15 10:09:34.571087 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:34.571067 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c6967d4db-phzdh"] Jul 15 10:09:35.986975 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:35.986918 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8387dd8-12d7-4053-9d35-6fad5d752bdb" path="/var/lib/kubelet/pods/d8387dd8-12d7-4053-9d35-6fad5d752bdb/volumes" Jul 15 10:09:45.384562 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.384494 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cfc6c77c4-lksvt" podUID="a47aa0ce-18dc-461e-b521-4783411438c1" containerName="console" containerID="cri-o://4c04a7592ef78a990fff5e44cb25fa061c3742d968827264df50e48fc0bfc0eb" gracePeriod=15 Jul 15 10:09:45.580493 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.580461 2580 generic.go:356] "Generic (PLEG): container finished" podID="a47aa0ce-18dc-461e-b521-4783411438c1" containerID="4c04a7592ef78a990fff5e44cb25fa061c3742d968827264df50e48fc0bfc0eb" exitCode=0 Jul 15 10:09:45.580630 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.580532 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfc6c77c4-lksvt" event={"ID":"a47aa0ce-18dc-461e-b521-4783411438c1","Type":"ContainerDied","Data":"4c04a7592ef78a990fff5e44cb25fa061c3742d968827264df50e48fc0bfc0eb"} Jul 15 10:09:45.631096 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.631068 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:09:45.681368 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.681292 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a47aa0ce-18dc-461e-b521-4783411438c1-console-serving-cert\") pod \"a47aa0ce-18dc-461e-b521-4783411438c1\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " Jul 15 10:09:45.681368 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.681339 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a47aa0ce-18dc-461e-b521-4783411438c1-console-oauth-config\") pod \"a47aa0ce-18dc-461e-b521-4783411438c1\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " Jul 15 10:09:45.681368 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.681361 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-oauth-serving-cert\") pod \"a47aa0ce-18dc-461e-b521-4783411438c1\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " Jul 15 10:09:45.681559 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.681386 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64tfx\" (UniqueName: \"kubernetes.io/projected/a47aa0ce-18dc-461e-b521-4783411438c1-kube-api-access-64tfx\") pod \"a47aa0ce-18dc-461e-b521-4783411438c1\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " Jul 15 10:09:45.681559 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.681445 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-service-ca\") pod \"a47aa0ce-18dc-461e-b521-4783411438c1\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " Jul 15 10:09:45.681559 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.681464 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-console-config\") pod \"a47aa0ce-18dc-461e-b521-4783411438c1\" (UID: \"a47aa0ce-18dc-461e-b521-4783411438c1\") " Jul 15 10:09:45.681775 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.681745 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a47aa0ce-18dc-461e-b521-4783411438c1" (UID: "a47aa0ce-18dc-461e-b521-4783411438c1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:09:45.681878 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.681787 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-service-ca" (OuterVolumeSpecName: "service-ca") pod "a47aa0ce-18dc-461e-b521-4783411438c1" (UID: "a47aa0ce-18dc-461e-b521-4783411438c1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:09:45.681986 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.681958 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-console-config" (OuterVolumeSpecName: "console-config") pod "a47aa0ce-18dc-461e-b521-4783411438c1" (UID: "a47aa0ce-18dc-461e-b521-4783411438c1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:09:45.683493 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.683463 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a47aa0ce-18dc-461e-b521-4783411438c1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a47aa0ce-18dc-461e-b521-4783411438c1" (UID: "a47aa0ce-18dc-461e-b521-4783411438c1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:09:45.683820 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.683804 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47aa0ce-18dc-461e-b521-4783411438c1-kube-api-access-64tfx" (OuterVolumeSpecName: "kube-api-access-64tfx") pod "a47aa0ce-18dc-461e-b521-4783411438c1" (UID: "a47aa0ce-18dc-461e-b521-4783411438c1"). InnerVolumeSpecName "kube-api-access-64tfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:09:45.683883 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.683820 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a47aa0ce-18dc-461e-b521-4783411438c1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a47aa0ce-18dc-461e-b521-4783411438c1" (UID: "a47aa0ce-18dc-461e-b521-4783411438c1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:09:45.782533 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.782486 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a47aa0ce-18dc-461e-b521-4783411438c1-console-serving-cert\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:45.782533 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.782528 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a47aa0ce-18dc-461e-b521-4783411438c1-console-oauth-config\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:45.782533 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.782541 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-oauth-serving-cert\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:45.782745 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.782555 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64tfx\" (UniqueName: \"kubernetes.io/projected/a47aa0ce-18dc-461e-b521-4783411438c1-kube-api-access-64tfx\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:45.782745 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.782569 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-service-ca\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:45.782745 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:45.782581 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a47aa0ce-18dc-461e-b521-4783411438c1-console-config\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:09:46.584680 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:46.584643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfc6c77c4-lksvt" event={"ID":"a47aa0ce-18dc-461e-b521-4783411438c1","Type":"ContainerDied","Data":"a95e7c1723cbf04ceeddba569f5a44e255138d30e60e7f542170e5f111c725f5"} Jul 15 10:09:46.585128 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:46.584692 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfc6c77c4-lksvt" Jul 15 10:09:46.585128 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:46.584731 2580 scope.go:117] "RemoveContainer" containerID="4c04a7592ef78a990fff5e44cb25fa061c3742d968827264df50e48fc0bfc0eb" Jul 15 10:09:46.603552 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:46.603524 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cfc6c77c4-lksvt"] Jul 15 10:09:46.607415 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:46.607393 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cfc6c77c4-lksvt"] Jul 15 10:09:47.986484 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:09:47.986452 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a47aa0ce-18dc-461e-b521-4783411438c1" path="/var/lib/kubelet/pods/a47aa0ce-18dc-461e-b521-4783411438c1/volumes" Jul 15 10:10:32.146232 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.146154 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67d7fbffc8-9hcrh"] Jul 15 10:10:32.146622 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.146367 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5642ee70-4b44-4283-9ec0-370461185ed9" containerName="registry" Jul 15 10:10:32.146622 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.146377 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5642ee70-4b44-4283-9ec0-370461185ed9" containerName="registry" Jul 15 10:10:32.146622 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.146390 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8387dd8-12d7-4053-9d35-6fad5d752bdb" containerName="console" Jul 15 10:10:32.146622 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.146397 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8387dd8-12d7-4053-9d35-6fad5d752bdb" containerName="console" Jul 15 10:10:32.146622 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.146407 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a47aa0ce-18dc-461e-b521-4783411438c1" containerName="console" Jul 15 10:10:32.146622 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.146412 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a47aa0ce-18dc-461e-b521-4783411438c1" containerName="console" Jul 15 10:10:32.146622 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.146454 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5642ee70-4b44-4283-9ec0-370461185ed9" containerName="registry" Jul 15 10:10:32.146622 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.146462 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a47aa0ce-18dc-461e-b521-4783411438c1" containerName="console" Jul 15 10:10:32.146622 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.146469 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8387dd8-12d7-4053-9d35-6fad5d752bdb" containerName="console" Jul 15 10:10:32.148036 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.148020 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.150761 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.150739 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 10:10:32.150896 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.150740 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 10:10:32.153445 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.153423 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k5jsr\"" Jul 15 10:10:32.153540 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.153430 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 10:10:32.153540 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.153428 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 10:10:32.154358 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.154006 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 10:10:32.154358 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.154226 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 10:10:32.154811 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.154792 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 10:10:32.155656 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.155640 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 10:10:32.163152 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.163130 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67d7fbffc8-9hcrh"] Jul 15 10:10:32.203749 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.203717 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-serving-cert\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.203912 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.203758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-config\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.203912 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.203778 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k42sk\" (UniqueName: \"kubernetes.io/projected/572bb724-1f0e-40de-8e61-fe3a7c945e98-kube-api-access-k42sk\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.203912 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.203806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-service-ca\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.203912 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.203870 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-oauth-serving-cert\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.203912 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.203910 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-oauth-config\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.204135 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.203956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-trusted-ca-bundle\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.304472 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.304440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-serving-cert\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.304618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.304483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-config\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.304618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.304513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k42sk\" (UniqueName: \"kubernetes.io/projected/572bb724-1f0e-40de-8e61-fe3a7c945e98-kube-api-access-k42sk\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.304618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.304532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-service-ca\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.304618 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.304549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-oauth-serving-cert\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.304870 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.304668 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-oauth-config\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.304870 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.304714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-trusted-ca-bundle\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.305278 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.305258 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-oauth-serving-cert\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.305359 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.305310 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-config\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.305420 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.305357 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-service-ca\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.305703 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.305681 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-trusted-ca-bundle\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.307001 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.306982 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-serving-cert\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.307078 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.307058 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-oauth-config\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.312987 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.312966 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k42sk\" (UniqueName: \"kubernetes.io/projected/572bb724-1f0e-40de-8e61-fe3a7c945e98-kube-api-access-k42sk\") pod \"console-67d7fbffc8-9hcrh\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.456883 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.456775 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:32.603447 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.603414 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67d7fbffc8-9hcrh"] Jul 15 10:10:32.606646 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:10:32.606612 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572bb724_1f0e_40de_8e61_fe3a7c945e98.slice/crio-f890ccd3ab8338aac8489af56e98e673c9bec235216adee745e67eb0fb3d43f9 WatchSource:0}: Error finding container f890ccd3ab8338aac8489af56e98e673c9bec235216adee745e67eb0fb3d43f9: Status 404 returned error can't find the container with id f890ccd3ab8338aac8489af56e98e673c9bec235216adee745e67eb0fb3d43f9 Jul 15 10:10:32.739956 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.739911 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d7fbffc8-9hcrh" event={"ID":"572bb724-1f0e-40de-8e61-fe3a7c945e98","Type":"ContainerStarted","Data":"7235e4bbf1d333a06a63d20cfc42f45b2ec50dbbbf13b3f6afa5d52e53e6f9eb"} Jul 15 10:10:32.740124 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.739978 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d7fbffc8-9hcrh" event={"ID":"572bb724-1f0e-40de-8e61-fe3a7c945e98","Type":"ContainerStarted","Data":"f890ccd3ab8338aac8489af56e98e673c9bec235216adee745e67eb0fb3d43f9"} Jul 15 10:10:32.776462 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:32.776401 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67d7fbffc8-9hcrh" podStartSLOduration=0.776380382 podStartE2EDuration="776.380382ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:10:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:10:32.776241672 +0000 UTC m=+175.361909002" watchObservedRunningTime="2026-07-15 10:10:32.776380382 +0000 UTC m=+175.362047714" Jul 15 10:10:42.457572 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:42.457535 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:42.458009 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:42.457829 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:42.462464 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:42.462446 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:10:42.775071 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:10:42.775044 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:11:44.705402 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.705368 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5564b4588f-jbhkj"] Jul 15 10:11:44.707625 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.707608 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.720223 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.720198 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5564b4588f-jbhkj"] Jul 15 10:11:44.802855 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.802825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab339e05-64e0-4758-a954-7875d4b75ee2-console-oauth-config\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.802855 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.802858 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-trusted-ca-bundle\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.803066 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.802881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-oauth-serving-cert\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.803066 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.802903 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfrw8\" (UniqueName: \"kubernetes.io/projected/ab339e05-64e0-4758-a954-7875d4b75ee2-kube-api-access-wfrw8\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.803066 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.802961 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-service-ca\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.803066 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.802983 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab339e05-64e0-4758-a954-7875d4b75ee2-console-serving-cert\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.803066 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.803015 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-console-config\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.904176 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.904117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab339e05-64e0-4758-a954-7875d4b75ee2-console-oauth-config\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.904176 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.904185 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-trusted-ca-bundle\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.904429 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.904217 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-oauth-serving-cert\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.904429 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.904241 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfrw8\" (UniqueName: \"kubernetes.io/projected/ab339e05-64e0-4758-a954-7875d4b75ee2-kube-api-access-wfrw8\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.904429 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.904380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-service-ca\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.904429 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.904423 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab339e05-64e0-4758-a954-7875d4b75ee2-console-serving-cert\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.904616 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.904457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-console-config\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.905163 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.905132 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-service-ca\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.905292 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.905165 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-trusted-ca-bundle\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.905292 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.905131 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-oauth-serving-cert\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.905292 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.905231 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-console-config\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.906702 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.906682 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab339e05-64e0-4758-a954-7875d4b75ee2-console-oauth-config\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.906985 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.906963 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab339e05-64e0-4758-a954-7875d4b75ee2-console-serving-cert\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:44.912076 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:44.912047 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfrw8\" (UniqueName: \"kubernetes.io/projected/ab339e05-64e0-4758-a954-7875d4b75ee2-kube-api-access-wfrw8\") pod \"console-5564b4588f-jbhkj\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:45.016498 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:45.016474 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:45.146028 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:45.146006 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5564b4588f-jbhkj"] Jul 15 10:11:45.148502 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:11:45.148473 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab339e05_64e0_4758_a954_7875d4b75ee2.slice/crio-d1172ff573e23f4d22be41ba04fef793c71de719a96d3594fc91019ea7d6775e WatchSource:0}: Error finding container d1172ff573e23f4d22be41ba04fef793c71de719a96d3594fc91019ea7d6775e: Status 404 returned error can't find the container with id d1172ff573e23f4d22be41ba04fef793c71de719a96d3594fc91019ea7d6775e Jul 15 10:11:45.976738 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:45.976703 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5564b4588f-jbhkj" event={"ID":"ab339e05-64e0-4758-a954-7875d4b75ee2","Type":"ContainerStarted","Data":"c07fb901301ed70cf5a7069ac3b5ed1d276df8530bcbb87d8b09dad82f372b11"} Jul 15 10:11:45.977247 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:45.976763 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5564b4588f-jbhkj" event={"ID":"ab339e05-64e0-4758-a954-7875d4b75ee2","Type":"ContainerStarted","Data":"d1172ff573e23f4d22be41ba04fef793c71de719a96d3594fc91019ea7d6775e"} Jul 15 10:11:45.995895 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:45.995795 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5564b4588f-jbhkj" podStartSLOduration=1.9957770940000001 podStartE2EDuration="1.995777094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:11:45.995314349 +0000 UTC m=+248.580981692" watchObservedRunningTime="2026-07-15 10:11:45.995777094 +0000 UTC m=+248.581444427" Jul 15 10:11:55.017317 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:55.017280 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:55.017784 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:55.017347 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:55.021771 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:55.021753 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:56.015466 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:56.015434 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:11:56.070430 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:11:56.070401 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67d7fbffc8-9hcrh"] Jul 15 10:12:21.096640 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.096590 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67d7fbffc8-9hcrh" podUID="572bb724-1f0e-40de-8e61-fe3a7c945e98" containerName="console" containerID="cri-o://7235e4bbf1d333a06a63d20cfc42f45b2ec50dbbbf13b3f6afa5d52e53e6f9eb" gracePeriod=15 Jul 15 10:12:21.326621 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.326597 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:12:21.469214 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.469124 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-oauth-config\") pod \"572bb724-1f0e-40de-8e61-fe3a7c945e98\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " Jul 15 10:12:21.469214 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.469169 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-config\") pod \"572bb724-1f0e-40de-8e61-fe3a7c945e98\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " Jul 15 10:12:21.469214 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.469212 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-service-ca\") pod \"572bb724-1f0e-40de-8e61-fe3a7c945e98\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " Jul 15 10:12:21.469474 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.469243 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k42sk\" (UniqueName: \"kubernetes.io/projected/572bb724-1f0e-40de-8e61-fe3a7c945e98-kube-api-access-k42sk\") pod \"572bb724-1f0e-40de-8e61-fe3a7c945e98\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " Jul 15 10:12:21.469474 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.469262 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-trusted-ca-bundle\") pod \"572bb724-1f0e-40de-8e61-fe3a7c945e98\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " Jul 15 10:12:21.469474 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.469438 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-serving-cert\") pod \"572bb724-1f0e-40de-8e61-fe3a7c945e98\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " Jul 15 10:12:21.469625 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.469479 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-oauth-serving-cert\") pod \"572bb724-1f0e-40de-8e61-fe3a7c945e98\" (UID: \"572bb724-1f0e-40de-8e61-fe3a7c945e98\") " Jul 15 10:12:21.469677 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.469640 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-service-ca" (OuterVolumeSpecName: "service-ca") pod "572bb724-1f0e-40de-8e61-fe3a7c945e98" (UID: "572bb724-1f0e-40de-8e61-fe3a7c945e98"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:12:21.469677 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.469645 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-config" (OuterVolumeSpecName: "console-config") pod "572bb724-1f0e-40de-8e61-fe3a7c945e98" (UID: "572bb724-1f0e-40de-8e61-fe3a7c945e98"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:12:21.469762 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.469699 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "572bb724-1f0e-40de-8e61-fe3a7c945e98" (UID: "572bb724-1f0e-40de-8e61-fe3a7c945e98"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:12:21.469762 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.469716 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-service-ca\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:12:21.469984 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.469967 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "572bb724-1f0e-40de-8e61-fe3a7c945e98" (UID: "572bb724-1f0e-40de-8e61-fe3a7c945e98"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:12:21.471446 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.471422 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "572bb724-1f0e-40de-8e61-fe3a7c945e98" (UID: "572bb724-1f0e-40de-8e61-fe3a7c945e98"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:12:21.471734 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.471709 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "572bb724-1f0e-40de-8e61-fe3a7c945e98" (UID: "572bb724-1f0e-40de-8e61-fe3a7c945e98"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:12:21.471734 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.471718 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/572bb724-1f0e-40de-8e61-fe3a7c945e98-kube-api-access-k42sk" (OuterVolumeSpecName: "kube-api-access-k42sk") pod "572bb724-1f0e-40de-8e61-fe3a7c945e98" (UID: "572bb724-1f0e-40de-8e61-fe3a7c945e98"). InnerVolumeSpecName "kube-api-access-k42sk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:12:21.570224 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.570176 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-oauth-config\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:12:21.570224 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.570216 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-config\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:12:21.570224 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.570226 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k42sk\" (UniqueName: \"kubernetes.io/projected/572bb724-1f0e-40de-8e61-fe3a7c945e98-kube-api-access-k42sk\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:12:21.570224 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.570236 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-trusted-ca-bundle\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:12:21.570485 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.570245 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/572bb724-1f0e-40de-8e61-fe3a7c945e98-console-serving-cert\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:12:21.570485 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:21.570253 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/572bb724-1f0e-40de-8e61-fe3a7c945e98-oauth-serving-cert\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:12:22.091278 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:22.091239 2580 generic.go:356] "Generic (PLEG): container finished" podID="572bb724-1f0e-40de-8e61-fe3a7c945e98" containerID="7235e4bbf1d333a06a63d20cfc42f45b2ec50dbbbf13b3f6afa5d52e53e6f9eb" exitCode=0 Jul 15 10:12:22.091435 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:22.091282 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d7fbffc8-9hcrh" Jul 15 10:12:22.091435 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:22.091313 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d7fbffc8-9hcrh" event={"ID":"572bb724-1f0e-40de-8e61-fe3a7c945e98","Type":"ContainerDied","Data":"7235e4bbf1d333a06a63d20cfc42f45b2ec50dbbbf13b3f6afa5d52e53e6f9eb"} Jul 15 10:12:22.091435 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:22.091368 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d7fbffc8-9hcrh" event={"ID":"572bb724-1f0e-40de-8e61-fe3a7c945e98","Type":"ContainerDied","Data":"f890ccd3ab8338aac8489af56e98e673c9bec235216adee745e67eb0fb3d43f9"} Jul 15 10:12:22.091435 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:22.091389 2580 scope.go:117] "RemoveContainer" containerID="7235e4bbf1d333a06a63d20cfc42f45b2ec50dbbbf13b3f6afa5d52e53e6f9eb" Jul 15 10:12:22.100814 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:22.100530 2580 scope.go:117] "RemoveContainer" containerID="7235e4bbf1d333a06a63d20cfc42f45b2ec50dbbbf13b3f6afa5d52e53e6f9eb" Jul 15 10:12:22.101507 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:12:22.101085 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7235e4bbf1d333a06a63d20cfc42f45b2ec50dbbbf13b3f6afa5d52e53e6f9eb\": container with ID starting with 7235e4bbf1d333a06a63d20cfc42f45b2ec50dbbbf13b3f6afa5d52e53e6f9eb not found: ID does not exist" containerID="7235e4bbf1d333a06a63d20cfc42f45b2ec50dbbbf13b3f6afa5d52e53e6f9eb" Jul 15 10:12:22.101507 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:22.101110 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7235e4bbf1d333a06a63d20cfc42f45b2ec50dbbbf13b3f6afa5d52e53e6f9eb"} err="failed to get container status \"7235e4bbf1d333a06a63d20cfc42f45b2ec50dbbbf13b3f6afa5d52e53e6f9eb\": rpc error: code = NotFound desc = could not find container \"7235e4bbf1d333a06a63d20cfc42f45b2ec50dbbbf13b3f6afa5d52e53e6f9eb\": container with ID starting with 7235e4bbf1d333a06a63d20cfc42f45b2ec50dbbbf13b3f6afa5d52e53e6f9eb not found: ID does not exist" Jul 15 10:12:22.113276 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:22.113252 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67d7fbffc8-9hcrh"] Jul 15 10:12:22.117343 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:22.117319 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67d7fbffc8-9hcrh"] Jul 15 10:12:23.987287 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:23.987253 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="572bb724-1f0e-40de-8e61-fe3a7c945e98" path="/var/lib/kubelet/pods/572bb724-1f0e-40de-8e61-fe3a7c945e98/volumes" Jul 15 10:12:37.793073 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:37.793037 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkhzv_cbc94ec3-6996-4e3e-897c-8e1eb72fbe84/ovn-acl-logging/0.log" Jul 15 10:12:37.794993 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:37.794969 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkhzv_cbc94ec3-6996-4e3e-897c-8e1eb72fbe84/ovn-acl-logging/0.log" Jul 15 10:12:37.799834 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:12:37.799809 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 10:13:12.112717 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.112683 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq"] Jul 15 10:13:12.115101 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.112901 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572bb724-1f0e-40de-8e61-fe3a7c945e98" containerName="console" Jul 15 10:13:12.115101 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.112911 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="572bb724-1f0e-40de-8e61-fe3a7c945e98" containerName="console" Jul 15 10:13:12.115101 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.112989 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="572bb724-1f0e-40de-8e61-fe3a7c945e98" containerName="console" Jul 15 10:13:12.115948 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.115914 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" Jul 15 10:13:12.118386 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.118364 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 10:13:12.119261 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.119247 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 10:13:12.119343 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.119255 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6x9ls\"" Jul 15 10:13:12.121261 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.121239 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93941f28-f7b8-4da3-8485-14941d7932e9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq\" (UID: \"93941f28-f7b8-4da3-8485-14941d7932e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" Jul 15 10:13:12.121365 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.121287 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5dtx\" (UniqueName: \"kubernetes.io/projected/93941f28-f7b8-4da3-8485-14941d7932e9-kube-api-access-r5dtx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq\" (UID: \"93941f28-f7b8-4da3-8485-14941d7932e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" Jul 15 10:13:12.121430 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.121364 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93941f28-f7b8-4da3-8485-14941d7932e9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq\" (UID: \"93941f28-f7b8-4da3-8485-14941d7932e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" Jul 15 10:13:12.127129 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.127106 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq"] Jul 15 10:13:12.222678 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.222630 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93941f28-f7b8-4da3-8485-14941d7932e9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq\" (UID: \"93941f28-f7b8-4da3-8485-14941d7932e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" Jul 15 10:13:12.222678 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.222684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5dtx\" (UniqueName: \"kubernetes.io/projected/93941f28-f7b8-4da3-8485-14941d7932e9-kube-api-access-r5dtx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq\" (UID: \"93941f28-f7b8-4da3-8485-14941d7932e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" Jul 15 10:13:12.222888 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.222721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93941f28-f7b8-4da3-8485-14941d7932e9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq\" (UID: \"93941f28-f7b8-4da3-8485-14941d7932e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" Jul 15 10:13:12.223076 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.223056 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93941f28-f7b8-4da3-8485-14941d7932e9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq\" (UID: \"93941f28-f7b8-4da3-8485-14941d7932e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" Jul 15 10:13:12.223114 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.223073 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93941f28-f7b8-4da3-8485-14941d7932e9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq\" (UID: \"93941f28-f7b8-4da3-8485-14941d7932e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" Jul 15 10:13:12.232096 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.232076 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5dtx\" (UniqueName: \"kubernetes.io/projected/93941f28-f7b8-4da3-8485-14941d7932e9-kube-api-access-r5dtx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq\" (UID: \"93941f28-f7b8-4da3-8485-14941d7932e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" Jul 15 10:13:12.424845 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.424749 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" Jul 15 10:13:12.554837 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.554805 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq"] Jul 15 10:13:12.558237 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:13:12.558199 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93941f28_f7b8_4da3_8485_14941d7932e9.slice/crio-21e907b8a0f9f61fd56e0e78973610dc98041d17b2c55c948bd9beb793e678aa WatchSource:0}: Error finding container 21e907b8a0f9f61fd56e0e78973610dc98041d17b2c55c948bd9beb793e678aa: Status 404 returned error can't find the container with id 21e907b8a0f9f61fd56e0e78973610dc98041d17b2c55c948bd9beb793e678aa Jul 15 10:13:12.560299 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:12.560281 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 10:13:13.252205 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:13.252172 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" event={"ID":"93941f28-f7b8-4da3-8485-14941d7932e9","Type":"ContainerStarted","Data":"21e907b8a0f9f61fd56e0e78973610dc98041d17b2c55c948bd9beb793e678aa"} Jul 15 10:13:20.278173 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:20.278136 2580 generic.go:356] "Generic (PLEG): container finished" podID="93941f28-f7b8-4da3-8485-14941d7932e9" containerID="628abed9fb42484590cd5cf0171f639008fbcd37717d60e5c41f3452fbaf0eee" exitCode=0 Jul 15 10:13:20.278566 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:20.278186 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" event={"ID":"93941f28-f7b8-4da3-8485-14941d7932e9","Type":"ContainerDied","Data":"628abed9fb42484590cd5cf0171f639008fbcd37717d60e5c41f3452fbaf0eee"} Jul 15 10:13:23.292202 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:23.292167 2580 generic.go:356] "Generic (PLEG): container finished" podID="93941f28-f7b8-4da3-8485-14941d7932e9" containerID="1314397ab5277d3411fd278774a25685172822dcf44dd2500ed9730b92271393" exitCode=0 Jul 15 10:13:23.292597 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:23.292215 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" event={"ID":"93941f28-f7b8-4da3-8485-14941d7932e9","Type":"ContainerDied","Data":"1314397ab5277d3411fd278774a25685172822dcf44dd2500ed9730b92271393"} Jul 15 10:13:31.325881 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:31.325842 2580 generic.go:356] "Generic (PLEG): container finished" podID="93941f28-f7b8-4da3-8485-14941d7932e9" containerID="785d34525f7708816ce6f750d24cb3f0651f83f51199360f510dd37772adf3ae" exitCode=0 Jul 15 10:13:31.326261 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:31.325893 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" event={"ID":"93941f28-f7b8-4da3-8485-14941d7932e9","Type":"ContainerDied","Data":"785d34525f7708816ce6f750d24cb3f0651f83f51199360f510dd37772adf3ae"} Jul 15 10:13:32.448775 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:32.448752 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" Jul 15 10:13:32.474236 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:32.474208 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93941f28-f7b8-4da3-8485-14941d7932e9-util\") pod \"93941f28-f7b8-4da3-8485-14941d7932e9\" (UID: \"93941f28-f7b8-4da3-8485-14941d7932e9\") " Jul 15 10:13:32.474347 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:32.474257 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5dtx\" (UniqueName: \"kubernetes.io/projected/93941f28-f7b8-4da3-8485-14941d7932e9-kube-api-access-r5dtx\") pod \"93941f28-f7b8-4da3-8485-14941d7932e9\" (UID: \"93941f28-f7b8-4da3-8485-14941d7932e9\") " Jul 15 10:13:32.474347 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:32.474315 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93941f28-f7b8-4da3-8485-14941d7932e9-bundle\") pod \"93941f28-f7b8-4da3-8485-14941d7932e9\" (UID: \"93941f28-f7b8-4da3-8485-14941d7932e9\") " Jul 15 10:13:32.474984 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:32.474958 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93941f28-f7b8-4da3-8485-14941d7932e9-bundle" (OuterVolumeSpecName: "bundle") pod "93941f28-f7b8-4da3-8485-14941d7932e9" (UID: "93941f28-f7b8-4da3-8485-14941d7932e9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 10:13:32.476429 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:32.476401 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93941f28-f7b8-4da3-8485-14941d7932e9-kube-api-access-r5dtx" (OuterVolumeSpecName: "kube-api-access-r5dtx") pod "93941f28-f7b8-4da3-8485-14941d7932e9" (UID: "93941f28-f7b8-4da3-8485-14941d7932e9"). InnerVolumeSpecName "kube-api-access-r5dtx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:13:32.479984 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:32.479956 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93941f28-f7b8-4da3-8485-14941d7932e9-util" (OuterVolumeSpecName: "util") pod "93941f28-f7b8-4da3-8485-14941d7932e9" (UID: "93941f28-f7b8-4da3-8485-14941d7932e9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 10:13:32.575306 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:32.575272 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93941f28-f7b8-4da3-8485-14941d7932e9-bundle\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:13:32.575306 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:32.575299 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93941f28-f7b8-4da3-8485-14941d7932e9-util\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:13:32.575306 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:32.575308 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5dtx\" (UniqueName: \"kubernetes.io/projected/93941f28-f7b8-4da3-8485-14941d7932e9-kube-api-access-r5dtx\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:13:33.334612 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:33.334571 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" event={"ID":"93941f28-f7b8-4da3-8485-14941d7932e9","Type":"ContainerDied","Data":"21e907b8a0f9f61fd56e0e78973610dc98041d17b2c55c948bd9beb793e678aa"} Jul 15 10:13:33.334809 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:33.334628 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21e907b8a0f9f61fd56e0e78973610dc98041d17b2c55c948bd9beb793e678aa" Jul 15 10:13:33.334809 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:33.334590 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kv8zq" Jul 15 10:13:40.397757 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.397715 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9"] Jul 15 10:13:40.398231 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.397974 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93941f28-f7b8-4da3-8485-14941d7932e9" containerName="pull" Jul 15 10:13:40.398231 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.397986 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="93941f28-f7b8-4da3-8485-14941d7932e9" containerName="pull" Jul 15 10:13:40.398231 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.397995 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93941f28-f7b8-4da3-8485-14941d7932e9" containerName="util" Jul 15 10:13:40.398231 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.398001 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="93941f28-f7b8-4da3-8485-14941d7932e9" containerName="util" Jul 15 10:13:40.398231 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.398008 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93941f28-f7b8-4da3-8485-14941d7932e9" containerName="extract" Jul 15 10:13:40.398231 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.398013 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="93941f28-f7b8-4da3-8485-14941d7932e9" containerName="extract" Jul 15 10:13:40.398231 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.398056 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="93941f28-f7b8-4da3-8485-14941d7932e9" containerName="extract" Jul 15 10:13:40.401589 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.401572 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9" Jul 15 10:13:40.404169 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.404140 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-d8j4q\"" Jul 15 10:13:40.404379 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.404366 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 15 10:13:40.404572 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.404557 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 15 10:13:40.417208 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.417175 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9"] Jul 15 10:13:40.431114 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.431074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df2ws\" (UniqueName: \"kubernetes.io/projected/cbfb3b34-109a-4ce5-8f97-b0140763f947-kube-api-access-df2ws\") pod \"cert-manager-operator-controller-manager-56b4598547-7rbz9\" (UID: \"cbfb3b34-109a-4ce5-8f97-b0140763f947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9" Jul 15 10:13:40.431224 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.431140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbfb3b34-109a-4ce5-8f97-b0140763f947-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-7rbz9\" (UID: \"cbfb3b34-109a-4ce5-8f97-b0140763f947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9" Jul 15 10:13:40.531667 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.531625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df2ws\" (UniqueName: \"kubernetes.io/projected/cbfb3b34-109a-4ce5-8f97-b0140763f947-kube-api-access-df2ws\") pod \"cert-manager-operator-controller-manager-56b4598547-7rbz9\" (UID: \"cbfb3b34-109a-4ce5-8f97-b0140763f947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9" Jul 15 10:13:40.531869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.531685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbfb3b34-109a-4ce5-8f97-b0140763f947-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-7rbz9\" (UID: \"cbfb3b34-109a-4ce5-8f97-b0140763f947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9" Jul 15 10:13:40.532033 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.532024 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbfb3b34-109a-4ce5-8f97-b0140763f947-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-7rbz9\" (UID: \"cbfb3b34-109a-4ce5-8f97-b0140763f947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9" Jul 15 10:13:40.541076 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.541056 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df2ws\" (UniqueName: \"kubernetes.io/projected/cbfb3b34-109a-4ce5-8f97-b0140763f947-kube-api-access-df2ws\") pod \"cert-manager-operator-controller-manager-56b4598547-7rbz9\" (UID: \"cbfb3b34-109a-4ce5-8f97-b0140763f947\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9" Jul 15 10:13:40.710428 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.710328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9" Jul 15 10:13:40.845416 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:40.845379 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9"] Jul 15 10:13:40.849458 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:13:40.849432 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbfb3b34_109a_4ce5_8f97_b0140763f947.slice/crio-77c6dd6c9872ecaf783fde2481b95110692d0663d8cf1f97d649cdfa5198ee01 WatchSource:0}: Error finding container 77c6dd6c9872ecaf783fde2481b95110692d0663d8cf1f97d649cdfa5198ee01: Status 404 returned error can't find the container with id 77c6dd6c9872ecaf783fde2481b95110692d0663d8cf1f97d649cdfa5198ee01 Jul 15 10:13:41.363209 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:41.363164 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9" event={"ID":"cbfb3b34-109a-4ce5-8f97-b0140763f947","Type":"ContainerStarted","Data":"77c6dd6c9872ecaf783fde2481b95110692d0663d8cf1f97d649cdfa5198ee01"} Jul 15 10:13:42.368993 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:42.368956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9" event={"ID":"cbfb3b34-109a-4ce5-8f97-b0140763f947","Type":"ContainerStarted","Data":"26019f37647da0c79ece26d39d3f8303f8caca45af2e3fe4ca958a9fb9bbb9e7"} Jul 15 10:13:42.394357 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:42.394283 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-7rbz9" podStartSLOduration=1.08201912 podStartE2EDuration="2.394266668s" totalImagesPullingTime="1.312247548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:13:42.392542492 +0000 UTC m=+364.978209823" watchObservedRunningTime="2026-07-15 10:13:42.394266668 +0000 UTC m=+364.979933999" Jul 15 10:13:46.828901 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:46.828860 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r4tk6"] Jul 15 10:13:46.831024 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:46.831003 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r4tk6" Jul 15 10:13:46.833785 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:46.833763 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 10:13:46.834696 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:46.834680 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 10:13:46.834761 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:46.834692 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-g79jd\"" Jul 15 10:13:46.854478 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:46.854459 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r4tk6"] Jul 15 10:13:46.883834 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:46.883806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be9face3-707d-48a5-8d09-e741994ae12f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r4tk6\" (UID: \"be9face3-707d-48a5-8d09-e741994ae12f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r4tk6" Jul 15 10:13:46.884006 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:46.883848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcr88\" (UniqueName: \"kubernetes.io/projected/be9face3-707d-48a5-8d09-e741994ae12f-kube-api-access-kcr88\") pod \"cert-manager-webhook-6486ffd997-r4tk6\" (UID: \"be9face3-707d-48a5-8d09-e741994ae12f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r4tk6" Jul 15 10:13:46.984130 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:46.984103 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be9face3-707d-48a5-8d09-e741994ae12f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r4tk6\" (UID: \"be9face3-707d-48a5-8d09-e741994ae12f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r4tk6" Jul 15 10:13:46.984263 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:46.984134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcr88\" (UniqueName: \"kubernetes.io/projected/be9face3-707d-48a5-8d09-e741994ae12f-kube-api-access-kcr88\") pod \"cert-manager-webhook-6486ffd997-r4tk6\" (UID: \"be9face3-707d-48a5-8d09-e741994ae12f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r4tk6" Jul 15 10:13:46.992804 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:46.992777 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be9face3-707d-48a5-8d09-e741994ae12f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r4tk6\" (UID: \"be9face3-707d-48a5-8d09-e741994ae12f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r4tk6" Jul 15 10:13:46.993005 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:46.992988 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcr88\" (UniqueName: \"kubernetes.io/projected/be9face3-707d-48a5-8d09-e741994ae12f-kube-api-access-kcr88\") pod \"cert-manager-webhook-6486ffd997-r4tk6\" (UID: \"be9face3-707d-48a5-8d09-e741994ae12f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r4tk6" Jul 15 10:13:47.139425 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:47.139349 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r4tk6" Jul 15 10:13:47.271265 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:47.269020 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r4tk6"] Jul 15 10:13:47.275510 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:13:47.275477 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe9face3_707d_48a5_8d09_e741994ae12f.slice/crio-e92da0a012bf02e8b3c05c6b39878a8bbaea94681d372749acc9d039ee675b5c WatchSource:0}: Error finding container e92da0a012bf02e8b3c05c6b39878a8bbaea94681d372749acc9d039ee675b5c: Status 404 returned error can't find the container with id e92da0a012bf02e8b3c05c6b39878a8bbaea94681d372749acc9d039ee675b5c Jul 15 10:13:47.387852 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:47.387816 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r4tk6" event={"ID":"be9face3-707d-48a5-8d09-e741994ae12f","Type":"ContainerStarted","Data":"e92da0a012bf02e8b3c05c6b39878a8bbaea94681d372749acc9d039ee675b5c"} Jul 15 10:13:50.403085 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:50.403046 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r4tk6" event={"ID":"be9face3-707d-48a5-8d09-e741994ae12f","Type":"ContainerStarted","Data":"87b892ca3623f203a4e65254f70c873376342c4608660f231966a9423d904b68"} Jul 15 10:13:50.403456 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:50.403118 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r4tk6" Jul 15 10:13:50.423947 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:50.423883 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-r4tk6" podStartSLOduration=2.166118807 podStartE2EDuration="4.423868135s" totalImagesPullingTime="2.257749328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:13:50.423496488 +0000 UTC m=+373.009163829" watchObservedRunningTime="2026-07-15 10:13:50.423868135 +0000 UTC m=+373.009535464" Jul 15 10:13:54.721124 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:54.721091 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-txjpn"] Jul 15 10:13:54.723180 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:54.723160 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-txjpn" Jul 15 10:13:54.725495 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:54.725473 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qpnj5\"" Jul 15 10:13:54.734445 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:54.734424 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-txjpn"] Jul 15 10:13:54.846292 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:54.846257 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrlz5\" (UniqueName: \"kubernetes.io/projected/8464257c-5625-4430-bc32-6a7b102e7d09-kube-api-access-nrlz5\") pod \"cert-manager-55b4d954d5-txjpn\" (UID: \"8464257c-5625-4430-bc32-6a7b102e7d09\") " pod="cert-manager/cert-manager-55b4d954d5-txjpn" Jul 15 10:13:54.846469 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:54.846304 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8464257c-5625-4430-bc32-6a7b102e7d09-bound-sa-token\") pod \"cert-manager-55b4d954d5-txjpn\" (UID: \"8464257c-5625-4430-bc32-6a7b102e7d09\") " pod="cert-manager/cert-manager-55b4d954d5-txjpn" Jul 15 10:13:54.946799 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:54.946755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8464257c-5625-4430-bc32-6a7b102e7d09-bound-sa-token\") pod \"cert-manager-55b4d954d5-txjpn\" (UID: \"8464257c-5625-4430-bc32-6a7b102e7d09\") " pod="cert-manager/cert-manager-55b4d954d5-txjpn" Jul 15 10:13:54.946983 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:54.946865 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrlz5\" (UniqueName: \"kubernetes.io/projected/8464257c-5625-4430-bc32-6a7b102e7d09-kube-api-access-nrlz5\") pod \"cert-manager-55b4d954d5-txjpn\" (UID: \"8464257c-5625-4430-bc32-6a7b102e7d09\") " pod="cert-manager/cert-manager-55b4d954d5-txjpn" Jul 15 10:13:54.960632 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:54.960606 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrlz5\" (UniqueName: \"kubernetes.io/projected/8464257c-5625-4430-bc32-6a7b102e7d09-kube-api-access-nrlz5\") pod \"cert-manager-55b4d954d5-txjpn\" (UID: \"8464257c-5625-4430-bc32-6a7b102e7d09\") " pod="cert-manager/cert-manager-55b4d954d5-txjpn" Jul 15 10:13:54.962720 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:54.962704 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8464257c-5625-4430-bc32-6a7b102e7d09-bound-sa-token\") pod \"cert-manager-55b4d954d5-txjpn\" (UID: \"8464257c-5625-4430-bc32-6a7b102e7d09\") " pod="cert-manager/cert-manager-55b4d954d5-txjpn" Jul 15 10:13:55.031472 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:55.031440 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-txjpn" Jul 15 10:13:55.156337 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:55.156304 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-txjpn"] Jul 15 10:13:55.159259 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:13:55.159223 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8464257c_5625_4430_bc32_6a7b102e7d09.slice/crio-d04c72c243c283ba6ff5a01965c0932b9755813ac0145f9fc70db4013ba37f0d WatchSource:0}: Error finding container d04c72c243c283ba6ff5a01965c0932b9755813ac0145f9fc70db4013ba37f0d: Status 404 returned error can't find the container with id d04c72c243c283ba6ff5a01965c0932b9755813ac0145f9fc70db4013ba37f0d Jul 15 10:13:55.422909 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:55.422809 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-txjpn" event={"ID":"8464257c-5625-4430-bc32-6a7b102e7d09","Type":"ContainerStarted","Data":"be0535d15370be5025b31d5903feb57f357b6b4e830bda4cad448d6b4a0b80c7"} Jul 15 10:13:55.422909 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:55.422854 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-txjpn" event={"ID":"8464257c-5625-4430-bc32-6a7b102e7d09","Type":"ContainerStarted","Data":"d04c72c243c283ba6ff5a01965c0932b9755813ac0145f9fc70db4013ba37f0d"} Jul 15 10:13:55.458534 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:55.458486 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-txjpn" podStartSLOduration=1.458472232 podStartE2EDuration="1.458472232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:13:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:13:55.457446118 +0000 UTC m=+378.043113449" watchObservedRunningTime="2026-07-15 10:13:55.458472232 +0000 UTC m=+378.044139561" Jul 15 10:13:56.409281 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.409241 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r4tk6" Jul 15 10:13:56.645013 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.644967 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht"] Jul 15 10:13:56.647269 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.647245 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" Jul 15 10:13:56.649798 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.649775 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6x9ls\"" Jul 15 10:13:56.649946 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.649783 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 10:13:56.649946 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.649826 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 10:13:56.658200 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.658167 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht"] Jul 15 10:13:56.761117 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.761082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d15b6dd-470a-4614-8b77-29106880ee04-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht\" (UID: \"2d15b6dd-470a-4614-8b77-29106880ee04\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" Jul 15 10:13:56.761270 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.761137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d15b6dd-470a-4614-8b77-29106880ee04-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht\" (UID: \"2d15b6dd-470a-4614-8b77-29106880ee04\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" Jul 15 10:13:56.761270 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.761195 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvctr\" (UniqueName: \"kubernetes.io/projected/2d15b6dd-470a-4614-8b77-29106880ee04-kube-api-access-nvctr\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht\" (UID: \"2d15b6dd-470a-4614-8b77-29106880ee04\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" Jul 15 10:13:56.862405 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.862346 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d15b6dd-470a-4614-8b77-29106880ee04-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht\" (UID: \"2d15b6dd-470a-4614-8b77-29106880ee04\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" Jul 15 10:13:56.862583 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.862421 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d15b6dd-470a-4614-8b77-29106880ee04-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht\" (UID: \"2d15b6dd-470a-4614-8b77-29106880ee04\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" Jul 15 10:13:56.862583 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.862442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvctr\" (UniqueName: \"kubernetes.io/projected/2d15b6dd-470a-4614-8b77-29106880ee04-kube-api-access-nvctr\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht\" (UID: \"2d15b6dd-470a-4614-8b77-29106880ee04\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" Jul 15 10:13:56.862835 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.862811 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d15b6dd-470a-4614-8b77-29106880ee04-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht\" (UID: \"2d15b6dd-470a-4614-8b77-29106880ee04\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" Jul 15 10:13:56.862869 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.862821 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d15b6dd-470a-4614-8b77-29106880ee04-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht\" (UID: \"2d15b6dd-470a-4614-8b77-29106880ee04\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" Jul 15 10:13:56.870826 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.870802 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvctr\" (UniqueName: \"kubernetes.io/projected/2d15b6dd-470a-4614-8b77-29106880ee04-kube-api-access-nvctr\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht\" (UID: \"2d15b6dd-470a-4614-8b77-29106880ee04\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" Jul 15 10:13:56.956546 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:56.956508 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" Jul 15 10:13:57.084663 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:57.084626 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht"] Jul 15 10:13:57.087268 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:13:57.087244 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d15b6dd_470a_4614_8b77_29106880ee04.slice/crio-0777b1e122b636ddcc42d14fb45a4c09822c5af7a822a74d15d10117334d0862 WatchSource:0}: Error finding container 0777b1e122b636ddcc42d14fb45a4c09822c5af7a822a74d15d10117334d0862: Status 404 returned error can't find the container with id 0777b1e122b636ddcc42d14fb45a4c09822c5af7a822a74d15d10117334d0862 Jul 15 10:13:57.432196 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:57.432117 2580 generic.go:356] "Generic (PLEG): container finished" podID="2d15b6dd-470a-4614-8b77-29106880ee04" containerID="62009c8405b02fb201ff42212ce4e416e7c91610eb67398201654f658bd5cac2" exitCode=0 Jul 15 10:13:57.432196 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:57.432159 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" event={"ID":"2d15b6dd-470a-4614-8b77-29106880ee04","Type":"ContainerDied","Data":"62009c8405b02fb201ff42212ce4e416e7c91610eb67398201654f658bd5cac2"} Jul 15 10:13:57.432196 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:57.432194 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" event={"ID":"2d15b6dd-470a-4614-8b77-29106880ee04","Type":"ContainerStarted","Data":"0777b1e122b636ddcc42d14fb45a4c09822c5af7a822a74d15d10117334d0862"} Jul 15 10:13:59.441701 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:13:59.441666 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" event={"ID":"2d15b6dd-470a-4614-8b77-29106880ee04","Type":"ContainerStarted","Data":"c307041c775b4f61465b7b1c37d2650a74656bdb2c220da07aea3a61d9512cc9"} Jul 15 10:14:00.446821 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:00.446791 2580 generic.go:356] "Generic (PLEG): container finished" podID="2d15b6dd-470a-4614-8b77-29106880ee04" containerID="c307041c775b4f61465b7b1c37d2650a74656bdb2c220da07aea3a61d9512cc9" exitCode=0 Jul 15 10:14:00.447225 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:00.446889 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" event={"ID":"2d15b6dd-470a-4614-8b77-29106880ee04","Type":"ContainerDied","Data":"c307041c775b4f61465b7b1c37d2650a74656bdb2c220da07aea3a61d9512cc9"} Jul 15 10:14:01.453482 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:01.453450 2580 generic.go:356] "Generic (PLEG): container finished" podID="2d15b6dd-470a-4614-8b77-29106880ee04" containerID="c9ed1b9bbc6d50908bb7fd8bbb0d174a5546adcb6506229e35bbfc7ac8f027d2" exitCode=0 Jul 15 10:14:01.453864 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:01.453540 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" event={"ID":"2d15b6dd-470a-4614-8b77-29106880ee04","Type":"ContainerDied","Data":"c9ed1b9bbc6d50908bb7fd8bbb0d174a5546adcb6506229e35bbfc7ac8f027d2"} Jul 15 10:14:02.578683 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:02.578659 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" Jul 15 10:14:02.705803 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:02.705770 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvctr\" (UniqueName: \"kubernetes.io/projected/2d15b6dd-470a-4614-8b77-29106880ee04-kube-api-access-nvctr\") pod \"2d15b6dd-470a-4614-8b77-29106880ee04\" (UID: \"2d15b6dd-470a-4614-8b77-29106880ee04\") " Jul 15 10:14:02.706012 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:02.705842 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d15b6dd-470a-4614-8b77-29106880ee04-util\") pod \"2d15b6dd-470a-4614-8b77-29106880ee04\" (UID: \"2d15b6dd-470a-4614-8b77-29106880ee04\") " Jul 15 10:14:02.706012 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:02.705869 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d15b6dd-470a-4614-8b77-29106880ee04-bundle\") pod \"2d15b6dd-470a-4614-8b77-29106880ee04\" (UID: \"2d15b6dd-470a-4614-8b77-29106880ee04\") " Jul 15 10:14:02.706283 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:02.706254 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d15b6dd-470a-4614-8b77-29106880ee04-bundle" (OuterVolumeSpecName: "bundle") pod "2d15b6dd-470a-4614-8b77-29106880ee04" (UID: "2d15b6dd-470a-4614-8b77-29106880ee04"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 10:14:02.708057 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:02.708004 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d15b6dd-470a-4614-8b77-29106880ee04-kube-api-access-nvctr" (OuterVolumeSpecName: "kube-api-access-nvctr") pod "2d15b6dd-470a-4614-8b77-29106880ee04" (UID: "2d15b6dd-470a-4614-8b77-29106880ee04"). InnerVolumeSpecName "kube-api-access-nvctr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:14:02.710402 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:02.710365 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d15b6dd-470a-4614-8b77-29106880ee04-util" (OuterVolumeSpecName: "util") pod "2d15b6dd-470a-4614-8b77-29106880ee04" (UID: "2d15b6dd-470a-4614-8b77-29106880ee04"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 10:14:02.807216 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:02.807183 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d15b6dd-470a-4614-8b77-29106880ee04-bundle\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:14:02.807216 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:02.807209 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvctr\" (UniqueName: \"kubernetes.io/projected/2d15b6dd-470a-4614-8b77-29106880ee04-kube-api-access-nvctr\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:14:02.807216 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:02.807219 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d15b6dd-470a-4614-8b77-29106880ee04-util\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:14:03.463212 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:03.463169 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" event={"ID":"2d15b6dd-470a-4614-8b77-29106880ee04","Type":"ContainerDied","Data":"0777b1e122b636ddcc42d14fb45a4c09822c5af7a822a74d15d10117334d0862"} Jul 15 10:14:03.463371 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:03.463234 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0777b1e122b636ddcc42d14fb45a4c09822c5af7a822a74d15d10117334d0862" Jul 15 10:14:03.463371 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:03.463184 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78exf9ht" Jul 15 10:14:36.279868 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.279828 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2"] Jul 15 10:14:36.280322 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.280114 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d15b6dd-470a-4614-8b77-29106880ee04" containerName="pull" Jul 15 10:14:36.280322 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.280125 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d15b6dd-470a-4614-8b77-29106880ee04" containerName="pull" Jul 15 10:14:36.280322 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.280136 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d15b6dd-470a-4614-8b77-29106880ee04" containerName="extract" Jul 15 10:14:36.280322 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.280142 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d15b6dd-470a-4614-8b77-29106880ee04" containerName="extract" Jul 15 10:14:36.280322 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.280154 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d15b6dd-470a-4614-8b77-29106880ee04" containerName="util" Jul 15 10:14:36.280322 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.280161 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d15b6dd-470a-4614-8b77-29106880ee04" containerName="util" Jul 15 10:14:36.280322 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.280212 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d15b6dd-470a-4614-8b77-29106880ee04" containerName="extract" Jul 15 10:14:36.284298 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.284267 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" Jul 15 10:14:36.287505 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.287482 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 15 10:14:36.288322 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.288301 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-js6sz\"" Jul 15 10:14:36.288424 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.288368 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 10:14:36.288424 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.288412 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 15 10:14:36.288505 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.288426 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 10:14:36.300535 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.300507 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2"] Jul 15 10:14:36.365732 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.365694 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/5cc3ca7d-4f1c-46e5-8369-da7f7b13779d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-ns4v2\" (UID: \"5cc3ca7d-4f1c-46e5-8369-da7f7b13779d\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" Jul 15 10:14:36.365732 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.365745 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg59f\" (UniqueName: \"kubernetes.io/projected/5cc3ca7d-4f1c-46e5-8369-da7f7b13779d-kube-api-access-rg59f\") pod \"kubeflow-trainer-controller-manager-857f77d56c-ns4v2\" (UID: \"5cc3ca7d-4f1c-46e5-8369-da7f7b13779d\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" Jul 15 10:14:36.365998 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.365774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cc3ca7d-4f1c-46e5-8369-da7f7b13779d-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-ns4v2\" (UID: \"5cc3ca7d-4f1c-46e5-8369-da7f7b13779d\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" Jul 15 10:14:36.466603 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.466552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/5cc3ca7d-4f1c-46e5-8369-da7f7b13779d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-ns4v2\" (UID: \"5cc3ca7d-4f1c-46e5-8369-da7f7b13779d\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" Jul 15 10:14:36.466603 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.466596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg59f\" (UniqueName: \"kubernetes.io/projected/5cc3ca7d-4f1c-46e5-8369-da7f7b13779d-kube-api-access-rg59f\") pod \"kubeflow-trainer-controller-manager-857f77d56c-ns4v2\" (UID: \"5cc3ca7d-4f1c-46e5-8369-da7f7b13779d\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" Jul 15 10:14:36.466905 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.466634 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cc3ca7d-4f1c-46e5-8369-da7f7b13779d-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-ns4v2\" (UID: \"5cc3ca7d-4f1c-46e5-8369-da7f7b13779d\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" Jul 15 10:14:36.467284 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.467262 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/5cc3ca7d-4f1c-46e5-8369-da7f7b13779d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-ns4v2\" (UID: \"5cc3ca7d-4f1c-46e5-8369-da7f7b13779d\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" Jul 15 10:14:36.469027 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.469005 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cc3ca7d-4f1c-46e5-8369-da7f7b13779d-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-ns4v2\" (UID: \"5cc3ca7d-4f1c-46e5-8369-da7f7b13779d\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" Jul 15 10:14:36.475447 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.475423 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg59f\" (UniqueName: \"kubernetes.io/projected/5cc3ca7d-4f1c-46e5-8369-da7f7b13779d-kube-api-access-rg59f\") pod \"kubeflow-trainer-controller-manager-857f77d56c-ns4v2\" (UID: \"5cc3ca7d-4f1c-46e5-8369-da7f7b13779d\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" Jul 15 10:14:36.593368 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.593277 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" Jul 15 10:14:36.724615 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:36.724581 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2"] Jul 15 10:14:36.727737 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:14:36.727708 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cc3ca7d_4f1c_46e5_8369_da7f7b13779d.slice/crio-fb32ab09cb03e9fada253eaba772f4911b69a5b99149c7955b9f87287825b9fa WatchSource:0}: Error finding container fb32ab09cb03e9fada253eaba772f4911b69a5b99149c7955b9f87287825b9fa: Status 404 returned error can't find the container with id fb32ab09cb03e9fada253eaba772f4911b69a5b99149c7955b9f87287825b9fa Jul 15 10:14:37.598154 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:37.598117 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" event={"ID":"5cc3ca7d-4f1c-46e5-8369-da7f7b13779d","Type":"ContainerStarted","Data":"fb32ab09cb03e9fada253eaba772f4911b69a5b99149c7955b9f87287825b9fa"} Jul 15 10:14:39.608133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:39.608035 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" event={"ID":"5cc3ca7d-4f1c-46e5-8369-da7f7b13779d","Type":"ContainerStarted","Data":"c1e954f496de7b5a74565de9f47ef385ba96442bf5b960800e7ab2e359c2812f"} Jul 15 10:14:39.608522 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:39.608176 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" Jul 15 10:14:39.625907 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:39.625855 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" podStartSLOduration=1.02472686 podStartE2EDuration="3.62583941s" totalImagesPullingTime="2.60111255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:14:39.625111274 +0000 UTC m=+422.210778603" watchObservedRunningTime="2026-07-15 10:14:39.62583941 +0000 UTC m=+422.211506741" Jul 15 10:14:55.618468 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:14:55.618435 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-ns4v2" Jul 15 10:15:45.387380 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.387341 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f596f9d78-tdfbn"] Jul 15 10:15:45.390373 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.390356 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.408834 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.408807 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f596f9d78-tdfbn"] Jul 15 10:15:45.488398 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.488360 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtbkd\" (UniqueName: \"kubernetes.io/projected/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-kube-api-access-qtbkd\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.488398 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.488404 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-service-ca\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.488656 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.488422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-console-serving-cert\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.488656 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.488512 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-console-config\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.488656 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.488541 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-trusted-ca-bundle\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.488656 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.488569 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-console-oauth-config\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.488656 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.488586 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-oauth-serving-cert\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.589294 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.589263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-console-config\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.589497 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.589302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-trusted-ca-bundle\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.589497 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.589333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-console-oauth-config\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.589497 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.589355 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-oauth-serving-cert\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.589497 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.589407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtbkd\" (UniqueName: \"kubernetes.io/projected/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-kube-api-access-qtbkd\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.589705 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.589536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-service-ca\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.589705 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.589587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-console-serving-cert\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.590256 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.590195 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-oauth-serving-cert\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.590558 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.590510 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-service-ca\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.590679 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.590656 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-console-config\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.591244 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.591229 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-trusted-ca-bundle\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.593010 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.592985 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-console-oauth-config\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.593219 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.593200 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-console-serving-cert\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.601917 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.599718 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtbkd\" (UniqueName: \"kubernetes.io/projected/3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37-kube-api-access-qtbkd\") pod \"console-f596f9d78-tdfbn\" (UID: \"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37\") " pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.699337 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.699246 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:45.832105 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.832064 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f596f9d78-tdfbn"] Jul 15 10:15:45.835217 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:15:45.835188 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb8cfa7_9c56_462a_ac2b_58dcd83ddb37.slice/crio-bc64efa0f6ba31ad56db7fad7a43691a41fa21a899a271bc17fef1e639dfde39 WatchSource:0}: Error finding container bc64efa0f6ba31ad56db7fad7a43691a41fa21a899a271bc17fef1e639dfde39: Status 404 returned error can't find the container with id bc64efa0f6ba31ad56db7fad7a43691a41fa21a899a271bc17fef1e639dfde39 Jul 15 10:15:45.862114 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:45.862086 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f596f9d78-tdfbn" event={"ID":"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37","Type":"ContainerStarted","Data":"bc64efa0f6ba31ad56db7fad7a43691a41fa21a899a271bc17fef1e639dfde39"} Jul 15 10:15:46.866982 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:46.866950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f596f9d78-tdfbn" event={"ID":"3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37","Type":"ContainerStarted","Data":"3431c832dfe2eb1065664c2caf8e6354a38b234d16e254a64996d7a3e58704a3"} Jul 15 10:15:46.887353 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:46.887287 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f596f9d78-tdfbn" podStartSLOduration=1.887268936 podStartE2EDuration="1.887268936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:15:46.886064114 +0000 UTC m=+489.471731447" watchObservedRunningTime="2026-07-15 10:15:46.887268936 +0000 UTC m=+489.472936267" Jul 15 10:15:55.699433 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:55.699399 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:55.699878 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:55.699465 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:55.704163 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:55.704137 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:55.904861 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:55.904835 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f596f9d78-tdfbn" Jul 15 10:15:55.953239 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:15:55.953145 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5564b4588f-jbhkj"] Jul 15 10:16:05.625354 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:05.625318 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4"] Jul 15 10:16:05.628252 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:05.628234 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4" Jul 15 10:16:05.630532 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:05.630507 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-jh59t\"/\"default-dockercfg-n64jk\"" Jul 15 10:16:05.630667 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:05.630619 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-jh59t\"/\"openshift-service-ca.crt\"" Jul 15 10:16:05.631376 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:05.631356 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-jh59t\"/\"kube-root-ca.crt\"" Jul 15 10:16:05.637255 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:05.637234 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4"] Jul 15 10:16:05.735346 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:05.735306 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7xvj\" (UniqueName: \"kubernetes.io/projected/de828930-bc54-435c-9baf-693417c4613b-kube-api-access-v7xvj\") pod \"test-trainjob-hj2qk-node-0-0-6x8p4\" (UID: \"de828930-bc54-435c-9baf-693417c4613b\") " pod="test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4" Jul 15 10:16:05.835867 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:05.835828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7xvj\" (UniqueName: \"kubernetes.io/projected/de828930-bc54-435c-9baf-693417c4613b-kube-api-access-v7xvj\") pod \"test-trainjob-hj2qk-node-0-0-6x8p4\" (UID: \"de828930-bc54-435c-9baf-693417c4613b\") " pod="test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4" Jul 15 10:16:05.846048 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:05.846022 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7xvj\" (UniqueName: \"kubernetes.io/projected/de828930-bc54-435c-9baf-693417c4613b-kube-api-access-v7xvj\") pod \"test-trainjob-hj2qk-node-0-0-6x8p4\" (UID: \"de828930-bc54-435c-9baf-693417c4613b\") " pod="test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4" Jul 15 10:16:05.937513 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:05.937427 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4" Jul 15 10:16:06.072528 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:06.072495 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4"] Jul 15 10:16:06.075985 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:16:06.075957 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde828930_bc54_435c_9baf_693417c4613b.slice/crio-9c3c239d00bc4f87bf776926e0c4a223c2e6a382b5e5c5f19d308893e5ca693d WatchSource:0}: Error finding container 9c3c239d00bc4f87bf776926e0c4a223c2e6a382b5e5c5f19d308893e5ca693d: Status 404 returned error can't find the container with id 9c3c239d00bc4f87bf776926e0c4a223c2e6a382b5e5c5f19d308893e5ca693d Jul 15 10:16:06.943796 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:06.943753 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4" event={"ID":"de828930-bc54-435c-9baf-693417c4613b","Type":"ContainerStarted","Data":"9c3c239d00bc4f87bf776926e0c4a223c2e6a382b5e5c5f19d308893e5ca693d"} Jul 15 10:16:20.975492 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:20.975421 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5564b4588f-jbhkj" podUID="ab339e05-64e0-4758-a954-7875d4b75ee2" containerName="console" containerID="cri-o://c07fb901301ed70cf5a7069ac3b5ed1d276df8530bcbb87d8b09dad82f372b11" gracePeriod=15 Jul 15 10:16:21.229408 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.229345 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:16:21.371710 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.371678 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfrw8\" (UniqueName: \"kubernetes.io/projected/ab339e05-64e0-4758-a954-7875d4b75ee2-kube-api-access-wfrw8\") pod \"ab339e05-64e0-4758-a954-7875d4b75ee2\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " Jul 15 10:16:21.371710 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.371716 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab339e05-64e0-4758-a954-7875d4b75ee2-console-oauth-config\") pod \"ab339e05-64e0-4758-a954-7875d4b75ee2\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " Jul 15 10:16:21.371977 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.371735 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-oauth-serving-cert\") pod \"ab339e05-64e0-4758-a954-7875d4b75ee2\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " Jul 15 10:16:21.371977 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.371751 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-service-ca\") pod \"ab339e05-64e0-4758-a954-7875d4b75ee2\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " Jul 15 10:16:21.371977 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.371767 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-console-config\") pod \"ab339e05-64e0-4758-a954-7875d4b75ee2\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " Jul 15 10:16:21.371977 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.371879 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-trusted-ca-bundle\") pod \"ab339e05-64e0-4758-a954-7875d4b75ee2\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " Jul 15 10:16:21.372191 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.371992 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab339e05-64e0-4758-a954-7875d4b75ee2-console-serving-cert\") pod \"ab339e05-64e0-4758-a954-7875d4b75ee2\" (UID: \"ab339e05-64e0-4758-a954-7875d4b75ee2\") " Jul 15 10:16:21.372191 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.372169 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ab339e05-64e0-4758-a954-7875d4b75ee2" (UID: "ab339e05-64e0-4758-a954-7875d4b75ee2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:16:21.372275 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.372217 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-console-config" (OuterVolumeSpecName: "console-config") pod "ab339e05-64e0-4758-a954-7875d4b75ee2" (UID: "ab339e05-64e0-4758-a954-7875d4b75ee2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:16:21.372275 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.372223 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-service-ca" (OuterVolumeSpecName: "service-ca") pod "ab339e05-64e0-4758-a954-7875d4b75ee2" (UID: "ab339e05-64e0-4758-a954-7875d4b75ee2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:16:21.372517 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.372488 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ab339e05-64e0-4758-a954-7875d4b75ee2" (UID: "ab339e05-64e0-4758-a954-7875d4b75ee2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:16:21.373998 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.373975 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab339e05-64e0-4758-a954-7875d4b75ee2-kube-api-access-wfrw8" (OuterVolumeSpecName: "kube-api-access-wfrw8") pod "ab339e05-64e0-4758-a954-7875d4b75ee2" (UID: "ab339e05-64e0-4758-a954-7875d4b75ee2"). InnerVolumeSpecName "kube-api-access-wfrw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:16:21.374098 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.374065 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab339e05-64e0-4758-a954-7875d4b75ee2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ab339e05-64e0-4758-a954-7875d4b75ee2" (UID: "ab339e05-64e0-4758-a954-7875d4b75ee2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:16:21.374145 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.374124 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab339e05-64e0-4758-a954-7875d4b75ee2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ab339e05-64e0-4758-a954-7875d4b75ee2" (UID: "ab339e05-64e0-4758-a954-7875d4b75ee2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:16:21.473486 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.473451 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab339e05-64e0-4758-a954-7875d4b75ee2-console-serving-cert\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:16:21.473486 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.473480 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfrw8\" (UniqueName: \"kubernetes.io/projected/ab339e05-64e0-4758-a954-7875d4b75ee2-kube-api-access-wfrw8\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:16:21.473486 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.473493 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab339e05-64e0-4758-a954-7875d4b75ee2-console-oauth-config\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:16:21.473731 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.473502 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-oauth-serving-cert\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:16:21.473731 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.473512 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-service-ca\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:16:21.473731 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.473520 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-console-config\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:16:21.473731 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:21.473528 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab339e05-64e0-4758-a954-7875d4b75ee2-trusted-ca-bundle\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:16:22.016381 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:22.016347 2580 generic.go:356] "Generic (PLEG): container finished" podID="ab339e05-64e0-4758-a954-7875d4b75ee2" containerID="c07fb901301ed70cf5a7069ac3b5ed1d276df8530bcbb87d8b09dad82f372b11" exitCode=0 Jul 15 10:16:22.016762 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:22.016399 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5564b4588f-jbhkj" Jul 15 10:16:22.016762 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:22.016402 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5564b4588f-jbhkj" event={"ID":"ab339e05-64e0-4758-a954-7875d4b75ee2","Type":"ContainerDied","Data":"c07fb901301ed70cf5a7069ac3b5ed1d276df8530bcbb87d8b09dad82f372b11"} Jul 15 10:16:22.016762 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:22.016505 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5564b4588f-jbhkj" event={"ID":"ab339e05-64e0-4758-a954-7875d4b75ee2","Type":"ContainerDied","Data":"d1172ff573e23f4d22be41ba04fef793c71de719a96d3594fc91019ea7d6775e"} Jul 15 10:16:22.016762 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:22.016525 2580 scope.go:117] "RemoveContainer" containerID="c07fb901301ed70cf5a7069ac3b5ed1d276df8530bcbb87d8b09dad82f372b11" Jul 15 10:16:22.024526 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:22.024503 2580 scope.go:117] "RemoveContainer" containerID="c07fb901301ed70cf5a7069ac3b5ed1d276df8530bcbb87d8b09dad82f372b11" Jul 15 10:16:22.024780 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:16:22.024762 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c07fb901301ed70cf5a7069ac3b5ed1d276df8530bcbb87d8b09dad82f372b11\": container with ID starting with c07fb901301ed70cf5a7069ac3b5ed1d276df8530bcbb87d8b09dad82f372b11 not found: ID does not exist" containerID="c07fb901301ed70cf5a7069ac3b5ed1d276df8530bcbb87d8b09dad82f372b11" Jul 15 10:16:22.024874 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:22.024788 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c07fb901301ed70cf5a7069ac3b5ed1d276df8530bcbb87d8b09dad82f372b11"} err="failed to get container status \"c07fb901301ed70cf5a7069ac3b5ed1d276df8530bcbb87d8b09dad82f372b11\": rpc error: code = NotFound desc = could not find container \"c07fb901301ed70cf5a7069ac3b5ed1d276df8530bcbb87d8b09dad82f372b11\": container with ID starting with c07fb901301ed70cf5a7069ac3b5ed1d276df8530bcbb87d8b09dad82f372b11 not found: ID does not exist" Jul 15 10:16:22.032451 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:22.032427 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5564b4588f-jbhkj"] Jul 15 10:16:22.038511 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:22.038490 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5564b4588f-jbhkj"] Jul 15 10:16:23.987145 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:16:23.987111 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab339e05-64e0-4758-a954-7875d4b75ee2" path="/var/lib/kubelet/pods/ab339e05-64e0-4758-a954-7875d4b75ee2/volumes" Jul 15 10:17:37.816400 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:17:37.816358 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkhzv_cbc94ec3-6996-4e3e-897c-8e1eb72fbe84/ovn-acl-logging/0.log" Jul 15 10:17:37.822038 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:17:37.822014 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkhzv_cbc94ec3-6996-4e3e-897c-8e1eb72fbe84/ovn-acl-logging/0.log" Jul 15 10:22:50.830011 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:50.829985 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkhzv_cbc94ec3-6996-4e3e-897c-8e1eb72fbe84/ovn-acl-logging/0.log" Jul 15 10:22:50.830551 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:50.829985 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkhzv_cbc94ec3-6996-4e3e-897c-8e1eb72fbe84/ovn-acl-logging/0.log" Jul 15 10:22:52.667405 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:52.667358 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4" event={"ID":"de828930-bc54-435c-9baf-693417c4613b","Type":"ContainerStarted","Data":"6a36cd6170adac35b4a4979ecc547649c0aca7001d4b3b25bbb60fddc837467f"} Jul 15 10:22:52.669971 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:52.669944 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-jh59t\"/\"default-dockercfg-n64jk\"" Jul 15 10:22:52.695989 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:52.695915 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4" podStartSLOduration=1.965136985 podStartE2EDuration="6m47.695897301s" totalImagesPullingTime="6m45.730760316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:22:52.694505108 +0000 UTC m=+915.280172440" watchObservedRunningTime="2026-07-15 10:22:52.695897301 +0000 UTC m=+915.281564709" Jul 15 10:22:52.861342 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:52.861312 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-jh59t\"/\"kube-root-ca.crt\"" Jul 15 10:22:52.871666 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:52.871640 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-jh59t\"/\"openshift-service-ca.crt\"" Jul 15 10:22:53.469989 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:53.469962 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jh59t_test-trainjob-hj2qk-node-0-0-6x8p4_de828930-bc54-435c-9baf-693417c4613b/node/0.log" Jul 15 10:22:54.676552 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:54.676459 2580 generic.go:356] "Generic (PLEG): container finished" podID="de828930-bc54-435c-9baf-693417c4613b" containerID="6a36cd6170adac35b4a4979ecc547649c0aca7001d4b3b25bbb60fddc837467f" exitCode=0 Jul 15 10:22:54.676552 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:54.676511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4" event={"ID":"de828930-bc54-435c-9baf-693417c4613b","Type":"ContainerDied","Data":"6a36cd6170adac35b4a4979ecc547649c0aca7001d4b3b25bbb60fddc837467f"} Jul 15 10:22:55.813488 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:55.813463 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4" Jul 15 10:22:55.982484 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:55.982398 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7xvj\" (UniqueName: \"kubernetes.io/projected/de828930-bc54-435c-9baf-693417c4613b-kube-api-access-v7xvj\") pod \"de828930-bc54-435c-9baf-693417c4613b\" (UID: \"de828930-bc54-435c-9baf-693417c4613b\") " Jul 15 10:22:55.984709 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:55.984673 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de828930-bc54-435c-9baf-693417c4613b-kube-api-access-v7xvj" (OuterVolumeSpecName: "kube-api-access-v7xvj") pod "de828930-bc54-435c-9baf-693417c4613b" (UID: "de828930-bc54-435c-9baf-693417c4613b"). InnerVolumeSpecName "kube-api-access-v7xvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:22:56.083568 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:56.083533 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7xvj\" (UniqueName: \"kubernetes.io/projected/de828930-bc54-435c-9baf-693417c4613b-kube-api-access-v7xvj\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:22:56.469344 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:56.469315 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jh59t_test-trainjob-hj2qk-node-0-0-6x8p4_de828930-bc54-435c-9baf-693417c4613b/node/0.log" Jul 15 10:22:56.686411 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:56.686377 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4" event={"ID":"de828930-bc54-435c-9baf-693417c4613b","Type":"ContainerDied","Data":"9c3c239d00bc4f87bf776926e0c4a223c2e6a382b5e5c5f19d308893e5ca693d"} Jul 15 10:22:56.686411 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:56.686403 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4" Jul 15 10:22:56.686411 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:56.686416 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c3c239d00bc4f87bf776926e0c4a223c2e6a382b5e5c5f19d308893e5ca693d" Jul 15 10:22:57.279889 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:57.279863 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-jh59t_test-trainjob-hj2qk-node-0-0-6x8p4_de828930-bc54-435c-9baf-693417c4613b/node/0.log" Jul 15 10:22:58.672271 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.672234 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-55msq/must-gather-khr7x"] Jul 15 10:22:58.672661 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.672515 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de828930-bc54-435c-9baf-693417c4613b" containerName="node" Jul 15 10:22:58.672661 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.672525 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="de828930-bc54-435c-9baf-693417c4613b" containerName="node" Jul 15 10:22:58.672661 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.672539 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab339e05-64e0-4758-a954-7875d4b75ee2" containerName="console" Jul 15 10:22:58.672661 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.672544 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab339e05-64e0-4758-a954-7875d4b75ee2" containerName="console" Jul 15 10:22:58.672661 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.672581 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab339e05-64e0-4758-a954-7875d4b75ee2" containerName="console" Jul 15 10:22:58.672661 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.672589 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="de828930-bc54-435c-9baf-693417c4613b" containerName="node" Jul 15 10:22:58.693178 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.693140 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-55msq/must-gather-khr7x"] Jul 15 10:22:58.693339 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.693249 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-55msq/must-gather-khr7x" Jul 15 10:22:58.696196 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.696176 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-55msq\"/\"kube-root-ca.crt\"" Jul 15 10:22:58.696320 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.696181 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-55msq\"/\"openshift-service-ca.crt\"" Jul 15 10:22:58.697141 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.697117 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-55msq\"/\"default-dockercfg-6k8dk\"" Jul 15 10:22:58.704023 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.704006 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e123864-d056-4b92-9466-dd29b7e9c225-must-gather-output\") pod \"must-gather-khr7x\" (UID: \"8e123864-d056-4b92-9466-dd29b7e9c225\") " pod="openshift-must-gather-55msq/must-gather-khr7x" Jul 15 10:22:58.704105 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.704030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2rkc\" (UniqueName: \"kubernetes.io/projected/8e123864-d056-4b92-9466-dd29b7e9c225-kube-api-access-q2rkc\") pod \"must-gather-khr7x\" (UID: \"8e123864-d056-4b92-9466-dd29b7e9c225\") " pod="openshift-must-gather-55msq/must-gather-khr7x" Jul 15 10:22:58.805431 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.805395 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e123864-d056-4b92-9466-dd29b7e9c225-must-gather-output\") pod \"must-gather-khr7x\" (UID: \"8e123864-d056-4b92-9466-dd29b7e9c225\") " pod="openshift-must-gather-55msq/must-gather-khr7x" Jul 15 10:22:58.805431 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.805431 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2rkc\" (UniqueName: \"kubernetes.io/projected/8e123864-d056-4b92-9466-dd29b7e9c225-kube-api-access-q2rkc\") pod \"must-gather-khr7x\" (UID: \"8e123864-d056-4b92-9466-dd29b7e9c225\") " pod="openshift-must-gather-55msq/must-gather-khr7x" Jul 15 10:22:58.805816 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.805795 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e123864-d056-4b92-9466-dd29b7e9c225-must-gather-output\") pod \"must-gather-khr7x\" (UID: \"8e123864-d056-4b92-9466-dd29b7e9c225\") " pod="openshift-must-gather-55msq/must-gather-khr7x" Jul 15 10:22:58.813133 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:58.813103 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2rkc\" (UniqueName: \"kubernetes.io/projected/8e123864-d056-4b92-9466-dd29b7e9c225-kube-api-access-q2rkc\") pod \"must-gather-khr7x\" (UID: \"8e123864-d056-4b92-9466-dd29b7e9c225\") " pod="openshift-must-gather-55msq/must-gather-khr7x" Jul 15 10:22:59.002375 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:59.002343 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-55msq/must-gather-khr7x" Jul 15 10:22:59.145156 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:59.145126 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-55msq/must-gather-khr7x"] Jul 15 10:22:59.148061 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:22:59.148032 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e123864_d056_4b92_9466_dd29b7e9c225.slice/crio-293c6d529a2ec4c49c2911deda5efeabe2fd89ff9449e497a8287e6353c17192 WatchSource:0}: Error finding container 293c6d529a2ec4c49c2911deda5efeabe2fd89ff9449e497a8287e6353c17192: Status 404 returned error can't find the container with id 293c6d529a2ec4c49c2911deda5efeabe2fd89ff9449e497a8287e6353c17192 Jul 15 10:22:59.149976 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:59.149958 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 10:22:59.698956 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:22:59.698908 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-55msq/must-gather-khr7x" event={"ID":"8e123864-d056-4b92-9466-dd29b7e9c225","Type":"ContainerStarted","Data":"293c6d529a2ec4c49c2911deda5efeabe2fd89ff9449e497a8287e6353c17192"} Jul 15 10:23:02.310633 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:23:02.310593 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4"] Jul 15 10:23:02.313633 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:23:02.313595 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-jh59t/test-trainjob-hj2qk-node-0-0-6x8p4"] Jul 15 10:23:03.989643 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:23:03.989606 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de828930-bc54-435c-9baf-693417c4613b" path="/var/lib/kubelet/pods/de828930-bc54-435c-9baf-693417c4613b/volumes" Jul 15 10:23:06.735314 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:23:06.735275 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-55msq/must-gather-khr7x" event={"ID":"8e123864-d056-4b92-9466-dd29b7e9c225","Type":"ContainerStarted","Data":"f68ead4027e967bd01b4fecd5730a7d69e38c09065cf959301fba30544f2db28"} Jul 15 10:23:07.740783 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:23:07.740745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-55msq/must-gather-khr7x" event={"ID":"8e123864-d056-4b92-9466-dd29b7e9c225","Type":"ContainerStarted","Data":"771b61960e4d6e0dfdb6f9f61654855fdc67c792845a9d2224416a9791996123"} Jul 15 10:23:07.758579 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:23:07.758529 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-55msq/must-gather-khr7x" podStartSLOduration=2.359914429 podStartE2EDuration="9.758514765s" totalImagesPullingTime="7.398600336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:23:07.756579253 +0000 UTC m=+930.342246583" watchObservedRunningTime="2026-07-15 10:23:07.758514765 +0000 UTC m=+930.344182138" Jul 15 10:23:17.264866 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:23:17.264835 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-ns4v2_5cc3ca7d-4f1c-46e5-8369-da7f7b13779d/manager/0.log" Jul 15 10:23:17.748556 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:23:17.748516 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-ns4v2_5cc3ca7d-4f1c-46e5-8369-da7f7b13779d/manager/0.log" Jul 15 10:23:18.251357 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:23:18.251331 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-ns4v2_5cc3ca7d-4f1c-46e5-8369-da7f7b13779d/manager/0.log" Jul 15 10:23:57.973581 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:23:57.973496 2580 generic.go:356] "Generic (PLEG): container finished" podID="8e123864-d056-4b92-9466-dd29b7e9c225" containerID="f68ead4027e967bd01b4fecd5730a7d69e38c09065cf959301fba30544f2db28" exitCode=0 Jul 15 10:23:57.973581 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:23:57.973568 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-55msq/must-gather-khr7x" event={"ID":"8e123864-d056-4b92-9466-dd29b7e9c225","Type":"ContainerDied","Data":"f68ead4027e967bd01b4fecd5730a7d69e38c09065cf959301fba30544f2db28"} Jul 15 10:23:57.974009 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:23:57.973887 2580 scope.go:117] "RemoveContainer" containerID="f68ead4027e967bd01b4fecd5730a7d69e38c09065cf959301fba30544f2db28" Jul 15 10:23:58.676626 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:23:58.676596 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-55msq_must-gather-khr7x_8e123864-d056-4b92-9466-dd29b7e9c225/gather/0.log" Jul 15 10:24:04.022141 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.022062 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-55msq/must-gather-khr7x"] Jul 15 10:24:04.022529 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.022248 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-55msq/must-gather-khr7x" podUID="8e123864-d056-4b92-9466-dd29b7e9c225" containerName="copy" containerID="cri-o://771b61960e4d6e0dfdb6f9f61654855fdc67c792845a9d2224416a9791996123" gracePeriod=2 Jul 15 10:24:04.026695 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.026522 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-55msq/must-gather-khr7x"] Jul 15 10:24:04.260055 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.260032 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-55msq_must-gather-khr7x_8e123864-d056-4b92-9466-dd29b7e9c225/copy/0.log" Jul 15 10:24:04.261852 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.261830 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-55msq/must-gather-khr7x" Jul 15 10:24:04.264107 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:24:04.264080 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-khr7x\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-55msq\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" podUID="8e123864-d056-4b92-9466-dd29b7e9c225" pod="openshift-must-gather-55msq/must-gather-khr7x" Jul 15 10:24:04.350580 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.350495 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2rkc\" (UniqueName: \"kubernetes.io/projected/8e123864-d056-4b92-9466-dd29b7e9c225-kube-api-access-q2rkc\") pod \"8e123864-d056-4b92-9466-dd29b7e9c225\" (UID: \"8e123864-d056-4b92-9466-dd29b7e9c225\") " Jul 15 10:24:04.350580 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.350546 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e123864-d056-4b92-9466-dd29b7e9c225-must-gather-output\") pod \"8e123864-d056-4b92-9466-dd29b7e9c225\" (UID: \"8e123864-d056-4b92-9466-dd29b7e9c225\") " Jul 15 10:24:04.352683 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.352649 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e123864-d056-4b92-9466-dd29b7e9c225-kube-api-access-q2rkc" (OuterVolumeSpecName: "kube-api-access-q2rkc") pod "8e123864-d056-4b92-9466-dd29b7e9c225" (UID: "8e123864-d056-4b92-9466-dd29b7e9c225"). InnerVolumeSpecName "kube-api-access-q2rkc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:24:04.352851 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.352829 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e123864-d056-4b92-9466-dd29b7e9c225-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "8e123864-d056-4b92-9466-dd29b7e9c225" (UID: "8e123864-d056-4b92-9466-dd29b7e9c225"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 10:24:04.451698 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.451671 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2rkc\" (UniqueName: \"kubernetes.io/projected/8e123864-d056-4b92-9466-dd29b7e9c225-kube-api-access-q2rkc\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:24:04.451698 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.451696 2580 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e123864-d056-4b92-9466-dd29b7e9c225-must-gather-output\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 15 10:24:04.799737 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.799707 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vhn9t_81869c04-f7bf-4cc7-81e2-c7279e070c38/global-pull-secret-syncer/0.log" Jul 15 10:24:04.869097 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.869064 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rrjcd_f999c8ca-9638-4bae-93a8-52743104c377/konnectivity-agent/0.log" Jul 15 10:24:04.924713 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:04.924684 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-144.ec2.internal_0124dca64ed1505b90e32949bfca1c08/haproxy/0.log" Jul 15 10:24:05.002723 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:05.002693 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-55msq_must-gather-khr7x_8e123864-d056-4b92-9466-dd29b7e9c225/copy/0.log" Jul 15 10:24:05.003078 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:05.003053 2580 generic.go:356] "Generic (PLEG): container finished" podID="8e123864-d056-4b92-9466-dd29b7e9c225" containerID="771b61960e4d6e0dfdb6f9f61654855fdc67c792845a9d2224416a9791996123" exitCode=143 Jul 15 10:24:05.003147 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:05.003105 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-55msq/must-gather-khr7x" Jul 15 10:24:05.003147 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:05.003109 2580 scope.go:117] "RemoveContainer" containerID="771b61960e4d6e0dfdb6f9f61654855fdc67c792845a9d2224416a9791996123" Jul 15 10:24:05.005698 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:24:05.005669 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-khr7x\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-55msq\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" podUID="8e123864-d056-4b92-9466-dd29b7e9c225" pod="openshift-must-gather-55msq/must-gather-khr7x" Jul 15 10:24:05.011121 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:05.011100 2580 scope.go:117] "RemoveContainer" containerID="f68ead4027e967bd01b4fecd5730a7d69e38c09065cf959301fba30544f2db28" Jul 15 10:24:05.014039 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:24:05.014015 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-khr7x\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-55msq\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" podUID="8e123864-d056-4b92-9466-dd29b7e9c225" pod="openshift-must-gather-55msq/must-gather-khr7x" Jul 15 10:24:05.022102 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:05.022088 2580 scope.go:117] "RemoveContainer" containerID="771b61960e4d6e0dfdb6f9f61654855fdc67c792845a9d2224416a9791996123" Jul 15 10:24:05.022315 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:24:05.022296 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"771b61960e4d6e0dfdb6f9f61654855fdc67c792845a9d2224416a9791996123\": container with ID starting with 771b61960e4d6e0dfdb6f9f61654855fdc67c792845a9d2224416a9791996123 not found: ID does not exist" containerID="771b61960e4d6e0dfdb6f9f61654855fdc67c792845a9d2224416a9791996123" Jul 15 10:24:05.022538 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:05.022323 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"771b61960e4d6e0dfdb6f9f61654855fdc67c792845a9d2224416a9791996123"} err="failed to get container status \"771b61960e4d6e0dfdb6f9f61654855fdc67c792845a9d2224416a9791996123\": rpc error: code = NotFound desc = could not find container \"771b61960e4d6e0dfdb6f9f61654855fdc67c792845a9d2224416a9791996123\": container with ID starting with 771b61960e4d6e0dfdb6f9f61654855fdc67c792845a9d2224416a9791996123 not found: ID does not exist" Jul 15 10:24:05.022538 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:05.022344 2580 scope.go:117] "RemoveContainer" containerID="f68ead4027e967bd01b4fecd5730a7d69e38c09065cf959301fba30544f2db28" Jul 15 10:24:05.022538 ip-10-0-128-144 kubenswrapper[2580]: E0715 10:24:05.022522 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f68ead4027e967bd01b4fecd5730a7d69e38c09065cf959301fba30544f2db28\": container with ID starting with f68ead4027e967bd01b4fecd5730a7d69e38c09065cf959301fba30544f2db28 not found: ID does not exist" containerID="f68ead4027e967bd01b4fecd5730a7d69e38c09065cf959301fba30544f2db28" Jul 15 10:24:05.022639 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:05.022537 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68ead4027e967bd01b4fecd5730a7d69e38c09065cf959301fba30544f2db28"} err="failed to get container status \"f68ead4027e967bd01b4fecd5730a7d69e38c09065cf959301fba30544f2db28\": rpc error: code = NotFound desc = could not find container \"f68ead4027e967bd01b4fecd5730a7d69e38c09065cf959301fba30544f2db28\": container with ID starting with f68ead4027e967bd01b4fecd5730a7d69e38c09065cf959301fba30544f2db28 not found: ID does not exist" Jul 15 10:24:05.986999 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:05.986962 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e123864-d056-4b92-9466-dd29b7e9c225" path="/var/lib/kubelet/pods/8e123864-d056-4b92-9466-dd29b7e9c225/volumes" Jul 15 10:24:09.361316 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:09.361282 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pj2qn_ceba64ce-55bb-4176-9f94-7f1e47962740/node-exporter/0.log" Jul 15 10:24:09.405123 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:09.405081 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pj2qn_ceba64ce-55bb-4176-9f94-7f1e47962740/kube-rbac-proxy/0.log" Jul 15 10:24:09.454112 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:09.454084 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pj2qn_ceba64ce-55bb-4176-9f94-7f1e47962740/init-textfile/0.log" Jul 15 10:24:11.905270 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:11.905231 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg"] Jul 15 10:24:11.905772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:11.905610 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e123864-d056-4b92-9466-dd29b7e9c225" containerName="gather" Jul 15 10:24:11.905772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:11.905628 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e123864-d056-4b92-9466-dd29b7e9c225" containerName="gather" Jul 15 10:24:11.905772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:11.905638 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e123864-d056-4b92-9466-dd29b7e9c225" containerName="copy" Jul 15 10:24:11.905772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:11.905646 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e123864-d056-4b92-9466-dd29b7e9c225" containerName="copy" Jul 15 10:24:11.905772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:11.905716 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e123864-d056-4b92-9466-dd29b7e9c225" containerName="copy" Jul 15 10:24:11.905772 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:11.905730 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e123864-d056-4b92-9466-dd29b7e9c225" containerName="gather" Jul 15 10:24:11.908243 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:11.908219 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:11.911105 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:11.911064 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c59fk\"/\"default-dockercfg-55n4n\"" Jul 15 10:24:11.916825 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:11.916633 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c59fk\"/\"kube-root-ca.crt\"" Jul 15 10:24:11.916825 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:11.916816 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c59fk\"/\"openshift-service-ca.crt\"" Jul 15 10:24:11.935946 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:11.935898 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg"] Jul 15 10:24:12.008023 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.007988 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-sys\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.008185 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.008034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-lib-modules\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.008185 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.008068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z26sm\" (UniqueName: \"kubernetes.io/projected/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-kube-api-access-z26sm\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.008185 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.008100 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-podres\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.008185 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.008118 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-proc\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.109445 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.109407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-sys\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.109648 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.109457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-lib-modules\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.109648 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.109483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z26sm\" (UniqueName: \"kubernetes.io/projected/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-kube-api-access-z26sm\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.109648 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.109514 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-podres\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.109648 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.109531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-proc\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.109648 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.109534 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-sys\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.109648 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.109625 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-lib-modules\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.109648 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.109642 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-proc\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.109960 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.109657 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-podres\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.120660 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.120626 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z26sm\" (UniqueName: \"kubernetes.io/projected/9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985-kube-api-access-z26sm\") pod \"perf-node-gather-daemonset-w78sg\" (UID: \"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985\") " pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.222991 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.222869 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:12.363898 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:12.363869 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg"] Jul 15 10:24:12.366101 ip-10-0-128-144 kubenswrapper[2580]: W0715 10:24:12.366072 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9f23bbd0_b97c_43d5_9bb8_a6ae9a41c985.slice/crio-ffe14a3c93fb86428ad6d4694a6922878c4e0f754614afd0af591933d2d1b3ea WatchSource:0}: Error finding container ffe14a3c93fb86428ad6d4694a6922878c4e0f754614afd0af591933d2d1b3ea: Status 404 returned error can't find the container with id ffe14a3c93fb86428ad6d4694a6922878c4e0f754614afd0af591933d2d1b3ea Jul 15 10:24:13.043119 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:13.043079 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" event={"ID":"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985","Type":"ContainerStarted","Data":"238c3dbe51ae751b9f8d85657e99d3dbb7809846932ef58a7d72a8dcfebcedfd"} Jul 15 10:24:13.043645 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:13.043146 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" event={"ID":"9f23bbd0-b97c-43d5-9bb8-a6ae9a41c985","Type":"ContainerStarted","Data":"ffe14a3c93fb86428ad6d4694a6922878c4e0f754614afd0af591933d2d1b3ea"} Jul 15 10:24:13.043645 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:13.043174 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:13.063426 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:13.063394 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f596f9d78-tdfbn_3eb8cfa7-9c56-462a-ac2b-58dcd83ddb37/console/0.log" Jul 15 10:24:13.067797 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:13.067746 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" podStartSLOduration=2.067727396 podStartE2EDuration="2.067727396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:24:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:24:13.065322928 +0000 UTC m=+995.650990258" watchObservedRunningTime="2026-07-15 10:24:13.067727396 +0000 UTC m=+995.653394747" Jul 15 10:24:14.661073 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:14.661048 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nlh65_119c6341-b963-43a9-8b75-3aef3cb786e0/dns/0.log" Jul 15 10:24:14.693474 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:14.693444 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nlh65_119c6341-b963-43a9-8b75-3aef3cb786e0/kube-rbac-proxy/0.log" Jul 15 10:24:14.735471 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:14.735433 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lxhkh_2bd6de8e-5daf-4e9f-b0e7-f149908e966b/dns-node-resolver/0.log" Jul 15 10:24:15.267243 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:15.267214 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67c9cbc66-2cntd_72db0911-fa1d-4b1d-bfe5-bea60edf72e6/registry/0.log" Jul 15 10:24:15.366076 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:15.366048 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zdcrg_756700bc-c6f9-4a06-8fc2-aae762d968c3/node-ca/0.log" Jul 15 10:24:16.786376 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:16.786353 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dpj55_4dfcebda-b161-49e1-900a-4b8ce5c8628a/serve-healthcheck-canary/0.log" Jul 15 10:24:17.578547 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:17.578514 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cft4x_eed75aef-e275-48df-afe1-cafede0162a7/kube-rbac-proxy/0.log" Jul 15 10:24:17.615392 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:17.615367 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cft4x_eed75aef-e275-48df-afe1-cafede0162a7/exporter/0.log" Jul 15 10:24:17.649674 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:17.649650 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cft4x_eed75aef-e275-48df-afe1-cafede0162a7/extractor/0.log" Jul 15 10:24:19.058080 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:19.058053 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c59fk/perf-node-gather-daemonset-w78sg" Jul 15 10:24:25.348198 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:25.348166 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zn_738da552-87c0-4b57-9a12-3de99011fb3c/kube-multus-additional-cni-plugins/0.log" Jul 15 10:24:25.408352 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:25.408326 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zn_738da552-87c0-4b57-9a12-3de99011fb3c/egress-router-binary-copy/0.log" Jul 15 10:24:25.460100 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:25.460078 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zn_738da552-87c0-4b57-9a12-3de99011fb3c/cni-plugins/0.log" Jul 15 10:24:25.500239 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:25.500214 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zn_738da552-87c0-4b57-9a12-3de99011fb3c/bond-cni-plugin/0.log" Jul 15 10:24:25.547026 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:25.546995 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zn_738da552-87c0-4b57-9a12-3de99011fb3c/routeoverride-cni/0.log" Jul 15 10:24:25.634459 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:25.634387 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zn_738da552-87c0-4b57-9a12-3de99011fb3c/whereabouts-cni-bincopy/0.log" Jul 15 10:24:25.726507 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:25.726478 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5l4zn_738da552-87c0-4b57-9a12-3de99011fb3c/whereabouts-cni/0.log" Jul 15 10:24:26.440916 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:26.440886 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mwqr5_fd8d9e78-4582-40da-8104-cebed9aab183/kube-multus/0.log" Jul 15 10:24:26.612517 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:26.612489 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jbtcn_318fb46e-f43b-48f1-8fc3-07f871da0b1e/network-metrics-daemon/0.log" Jul 15 10:24:26.649451 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:26.649424 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jbtcn_318fb46e-f43b-48f1-8fc3-07f871da0b1e/kube-rbac-proxy/0.log" Jul 15 10:24:28.151524 ip-10-0-128-144 kubenswrapper[2580]: I0715 10:24:28.151497 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bkhzv_cbc94ec3-6996-4e3e-897c-8e1eb72fbe84/ovn-controller/0.log"