Jul 03 19:09:50.660151 ip-10-0-131-31 systemd[1]: Starting Kubernetes Kubelet... Jul 03 19:09:51.095963 ip-10-0-131-31 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 19:09:51.095963 ip-10-0-131-31 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 03 19:09:51.095963 ip-10-0-131-31 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 19:09:51.095963 ip-10-0-131-31 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 03 19:09:51.095963 ip-10-0-131-31 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 19:09:51.096925 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.096826 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 03 19:09:51.101183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101168 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:09:51.101183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101183 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101187 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101190 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101194 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101198 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101201 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101204 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101211 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101214 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101217 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101220 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101224 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101227 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101230 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101233 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101235 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101240 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101243 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:09:51.101247 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101246 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101249 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101252 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101255 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101258 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101261 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101264 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101267 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101269 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101272 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101274 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101277 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101279 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101282 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101284 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101286 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101289 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101291 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101293 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101296 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:09:51.101676 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101299 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101302 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101304 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101307 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101309 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101311 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101314 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101316 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101318 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101321 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101323 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101326 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101328 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101331 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101334 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101337 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101339 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101342 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101345 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101347 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:09:51.102213 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101349 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101352 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101354 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101357 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101359 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101361 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101364 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101366 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101369 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101371 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101374 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101376 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101379 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101382 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101385 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101387 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101390 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101392 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101395 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101398 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:09:51.102691 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101400 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101402 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101405 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101407 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101409 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101412 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101415 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101418 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101421 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101423 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101425 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101428 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101431 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101433 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101435 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101438 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101441 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101443 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101446 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.101448 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102198 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:09:51.103183 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102205 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102209 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102212 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102215 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102217 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102220 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102223 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102226 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102229 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102232 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102235 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102237 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102240 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102243 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102246 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102248 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102251 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102253 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102256 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102259 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:09:51.103714 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102261 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102264 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102266 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102269 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102271 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102274 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102276 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102279 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102281 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102285 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102288 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102291 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102295 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102298 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102301 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102304 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102307 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102310 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102313 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:09:51.104245 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102316 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102319 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102322 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102325 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102327 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102330 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102332 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102335 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102338 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102340 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102343 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102345 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102348 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102350 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102353 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102355 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102358 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102361 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102363 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102366 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:09:51.104711 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102368 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102372 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102375 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102378 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102381 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102384 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102387 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102390 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102392 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102395 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102398 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102400 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102403 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102406 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102408 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102411 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102414 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102417 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102419 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102421 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:09:51.105217 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102424 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102426 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102429 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102431 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102434 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102436 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102439 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102443 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102445 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102447 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102450 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102453 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102455 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102458 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102461 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102463 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102466 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102468 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102471 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:09:51.105713 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102820 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102825 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102828 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102831 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102833 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102836 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102839 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102842 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102844 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102847 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102849 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102852 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102854 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102857 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102860 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102862 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102865 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102867 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102869 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102889 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102894 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:09:51.106189 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102898 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102900 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102903 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102905 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102908 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102910 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102916 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102918 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102921 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102923 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102926 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102928 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102931 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102933 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102936 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102939 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102941 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102944 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102948 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102951 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:09:51.106687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102954 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102956 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102959 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102961 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102964 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102966 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102969 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102972 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102974 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102978 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102981 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102984 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102986 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102989 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102991 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102994 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.102996 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103000 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103005 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:09:51.107177 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103008 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103011 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103013 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103016 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103019 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103022 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103025 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103028 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103030 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103033 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103036 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103039 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103042 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103045 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103047 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103049 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103052 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103054 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103057 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103059 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:09:51.107650 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103062 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103064 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103068 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103070 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103073 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103075 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103077 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103080 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103082 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103085 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103087 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103090 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103093 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103095 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103099 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103102 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103105 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103108 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103112 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103177 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 03 19:09:51.108167 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103186 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103192 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103197 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103201 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103205 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103209 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103213 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103216 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103219 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103223 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103226 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103229 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103232 2580 flags.go:64] FLAG: --cgroup-root="" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103235 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103238 2580 flags.go:64] FLAG: --client-ca-file="" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103241 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103243 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103247 2580 flags.go:64] FLAG: --cluster-domain="" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103250 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103253 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103256 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103259 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103262 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 03 19:09:51.108646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103266 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103269 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103273 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103276 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103279 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103282 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103285 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103288 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103292 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103296 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103300 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103302 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103305 2580 flags.go:64] FLAG: --enable-server="true" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103308 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103316 2580 flags.go:64] FLAG: --event-burst="100" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103320 2580 flags.go:64] FLAG: --event-qps="50" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103322 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103326 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103328 2580 flags.go:64] FLAG: --eviction-hard="" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103332 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103335 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103338 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103341 2580 flags.go:64] FLAG: --eviction-soft="" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103343 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103346 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 03 19:09:51.109207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103349 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103352 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103355 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103357 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103360 2580 flags.go:64] FLAG: --feature-gates="" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103364 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103367 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103370 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103373 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103376 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103379 2580 flags.go:64] FLAG: --help="false" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103381 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103384 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103387 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103390 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103393 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103398 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103401 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103404 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103406 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103409 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103412 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103415 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103418 2580 flags.go:64] FLAG: --kube-reserved="" Jul 03 19:09:51.109862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103421 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103424 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103427 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103430 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103432 2580 flags.go:64] FLAG: --lock-file="" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103435 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103438 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103441 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103446 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103448 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103451 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103454 2580 flags.go:64] FLAG: --logging-format="text" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103457 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103460 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103463 2580 flags.go:64] FLAG: --manifest-url="" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103466 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103470 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103473 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103477 2580 flags.go:64] FLAG: --max-pods="110" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103480 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103483 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103486 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103489 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103491 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103496 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 03 19:09:51.110495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103499 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103507 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103510 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103513 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103516 2580 flags.go:64] FLAG: --pod-cidr="" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103519 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103524 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103527 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103530 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103533 2580 flags.go:64] FLAG: --port="10250" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103536 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103539 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ef7b9d15b761158c" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103542 2580 flags.go:64] FLAG: --qos-reserved="" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103545 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103548 2580 flags.go:64] FLAG: --register-node="true" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103551 2580 flags.go:64] FLAG: --register-with-taints="" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103554 2580 flags.go:64] FLAG: --registry-burst="10" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103557 2580 flags.go:64] FLAG: --registry-qps="5" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103560 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103563 2580 flags.go:64] FLAG: --reserved-memory="" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103566 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103569 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103572 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103574 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103577 2580 flags.go:64] FLAG: --runonce="false" Jul 03 19:09:51.111162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103580 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103584 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103587 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103589 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103592 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103595 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103598 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103602 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103605 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103608 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103611 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103613 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103616 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103619 2580 flags.go:64] FLAG: --system-cgroups="" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103622 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103628 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103631 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103633 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103637 2580 flags.go:64] FLAG: --tls-min-version="" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103640 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103643 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103646 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103649 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103652 2580 flags.go:64] FLAG: --v="2" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103655 2580 flags.go:64] FLAG: --version="false" Jul 03 19:09:51.112159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103659 2580 flags.go:64] FLAG: --vmodule="" Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103663 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.103666 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103781 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103784 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103787 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103790 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103794 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103798 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103802 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103804 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103807 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103810 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103813 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103817 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103820 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103823 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103825 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103828 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:09:51.112821 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103830 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103833 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103835 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103838 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103841 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103843 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103846 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103848 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103852 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103855 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103857 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103860 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103862 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103865 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103867 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103870 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103888 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103892 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103894 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103897 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:09:51.113392 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103900 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103902 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103905 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103908 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103910 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103913 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103915 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103921 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103924 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103927 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103930 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103933 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103936 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103939 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103942 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103944 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103947 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103950 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103953 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:09:51.113949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103956 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103959 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103962 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103964 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103967 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103969 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103972 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103975 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103977 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103980 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103982 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103984 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103987 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103989 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103992 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103994 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103997 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.103999 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104002 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104004 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:09:51.114422 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104008 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104010 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104013 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104017 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104020 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104023 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104026 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104029 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104031 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104034 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104053 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104057 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104060 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104064 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104066 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104069 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104072 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104074 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104077 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104079 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:09:51.114933 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104082 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104084 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104087 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.104089 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.104732 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.113173 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.113188 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.113208 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.113217 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113274 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113279 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113283 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113286 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113289 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113291 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:09:51.115429 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113294 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113297 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113300 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113302 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113306 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113310 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113313 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113316 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113319 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113322 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113324 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113327 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113330 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113332 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113335 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113337 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113340 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113343 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113346 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:09:51.115810 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113348 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113351 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113354 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113357 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113361 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113364 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113367 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113369 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113372 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113374 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113377 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113379 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113382 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113385 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113387 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113389 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113392 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113395 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113398 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113400 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:09:51.116286 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113403 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113406 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113409 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113411 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113414 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113416 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113419 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113421 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113424 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113426 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113429 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113431 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113434 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113436 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113439 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113442 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113445 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113447 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113450 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113452 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:09:51.116769 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113456 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113460 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113463 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113465 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113468 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113471 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113474 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113476 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113478 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113481 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113483 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113486 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113488 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113491 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113494 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113497 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113499 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113502 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113504 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113507 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:09:51.117275 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113509 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113512 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113514 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113517 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113519 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113522 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113524 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113527 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113530 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113533 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113535 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113538 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113540 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113544 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:09:51.117767 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.113550 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113673 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113679 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113682 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113686 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113689 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113692 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113695 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113698 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113701 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113704 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113707 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113709 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113712 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113715 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113718 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113720 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113722 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113725 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113728 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:09:51.118196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113731 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113733 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113736 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113739 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113741 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113743 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113746 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113749 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113751 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113754 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113757 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113759 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113761 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113764 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113766 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113769 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113772 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113776 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113779 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:09:51.118682 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113789 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113793 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113796 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113798 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113801 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113804 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113807 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113811 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113813 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113816 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113819 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113821 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113824 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113826 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113829 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113831 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113834 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113837 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113839 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113842 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:09:51.119194 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113844 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113847 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113849 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113852 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113854 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113856 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113859 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113861 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113864 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113866 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113869 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113886 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113889 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113891 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113894 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113896 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113900 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113903 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113906 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113909 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:09:51.119753 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113913 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113916 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113918 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113921 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113923 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113926 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113929 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113932 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113934 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113936 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113939 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113942 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113944 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113947 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113950 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113952 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113956 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113960 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113963 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113966 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:09:51.120261 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:51.113969 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:09:51.120758 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.113974 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 19:09:51.120758 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.114089 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 03 19:09:51.120758 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.117625 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 03 19:09:51.120758 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.119071 2580 server.go:1019] "Starting client certificate rotation" Jul 03 19:09:51.120758 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.119185 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 19:09:51.120758 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.119230 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 19:09:51.122516 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.122499 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 19:09:51.123708 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.123692 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 19:09:51.136486 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.136467 2580 log.go:25] "Validated CRI v1 runtime API" Jul 03 19:09:51.138532 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.138513 2580 log.go:25] "Validated CRI v1 image API" Jul 03 19:09:51.139304 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.139289 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 03 19:09:51.141737 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.141709 2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 aa1e3148-dfe2-4c3d-9f7b-83602a46baa2:/dev/nvme0n1p4 d83d6d12-939e-40c7-adc1-f28248ef13a5:/dev/nvme0n1p3] Jul 03 19:09:51.141841 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.141735 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 03 19:09:51.147338 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.147319 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 19:09:51.147603 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.147479 2580 manager.go:216] Machine: {Timestamp:2026-07-03 19:09:51.146161517 +0000 UTC m=+0.367905945 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104079 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cbb7982d813fce16ae109cca1fc28 SystemUUID:ec2cbb79-82d8-13fc-e16a-e109cca1fc28 BootID:0c44f956-2001-4419-9f1c-52efac2ca045 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6d:3d:73:d7:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6d:3d:73:d7:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:89:85:b7:2f:87 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 03 19:09:51.147692 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.147604 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 03 19:09:51.147741 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.147717 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 03 19:09:51.148865 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.148844 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 03 19:09:51.149950 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.148868 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-31.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 03 19:09:51.150709 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.150646 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 03 19:09:51.150808 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.150752 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 03 19:09:51.150962 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.150946 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 19:09:51.151533 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.151521 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 19:09:51.152797 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.152785 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 03 19:09:51.155665 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.155650 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 03 19:09:51.155805 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.155793 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 03 19:09:51.155863 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.155833 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 03 19:09:51.155863 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.155847 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 03 19:09:51.155975 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.155865 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 03 19:09:51.155975 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.155895 2580 kubelet.go:398] "Adding apiserver pod source" Jul 03 19:09:51.155975 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.155909 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 03 19:09:51.156310 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.156296 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 19:09:51.156374 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.156320 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 19:09:51.158619 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.158605 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 03 19:09:51.160949 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.160933 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 03 19:09:51.161037 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.160972 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 03 19:09:51.162508 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162493 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 03 19:09:51.162601 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162521 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 03 19:09:51.162601 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162534 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 03 19:09:51.162601 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162553 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 03 19:09:51.162601 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162565 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 03 19:09:51.162601 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162573 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 03 19:09:51.162601 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162585 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 03 19:09:51.162601 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162593 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 03 19:09:51.162940 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162611 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 03 19:09:51.162940 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162620 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 03 19:09:51.162940 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162635 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 03 19:09:51.162940 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162645 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 03 19:09:51.162940 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162733 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 03 19:09:51.162940 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.162742 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 03 19:09:51.166066 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.166051 2580 server.go:1268] "Started kubelet" Jul 03 19:09:51.166184 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.166129 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 03 19:09:51.166766 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.166702 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 03 19:09:51.166850 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.166826 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 03 19:09:51.166971 ip-10-0-131-31 systemd[1]: Started Kubernetes Kubelet. Jul 03 19:09:51.167783 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.167737 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-31.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 03 19:09:51.167783 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.167737 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 03 19:09:51.167783 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.167746 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 03 19:09:51.168560 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.168545 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 03 19:09:51.169977 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.169959 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 03 19:09:51.171133 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.170257 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-31.ec2.internal.18bedd450f61eec3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-31.ec2.internal,UID:ip-10-0-131-31.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-31.ec2.internal,},FirstTimestamp:2026-07-03 19:09:51.165853379 +0000 UTC m=+0.387597807,LastTimestamp:2026-07-03 19:09:51.165853379 +0000 UTC m=+0.387597807,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-31.ec2.internal,}" Jul 03 19:09:51.172863 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.172829 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 03 19:09:51.175729 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.175710 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 03 19:09:51.175821 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.175728 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 03 19:09:51.175940 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.175921 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-31.ec2.internal\" not found" Jul 03 19:09:51.176908 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.176892 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 03 19:09:51.176999 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.176913 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 03 19:09:51.176999 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.176894 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 03 19:09:51.177082 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.177042 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 03 19:09:51.177082 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.177051 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 03 19:09:51.178570 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.178543 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 03 19:09:51.178666 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.178547 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 03 19:09:51.178666 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.178586 2580 factory.go:55] Registering systemd factory Jul 03 19:09:51.178666 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.178603 2580 factory.go:223] Registration of the systemd container factory successfully Jul 03 19:09:51.179092 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.179079 2580 factory.go:153] Registering CRI-O factory Jul 03 19:09:51.179139 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.179096 2580 factory.go:223] Registration of the crio container factory successfully Jul 03 19:09:51.179185 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.179147 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 03 19:09:51.179185 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.179168 2580 factory.go:103] Registering Raw factory Jul 03 19:09:51.179185 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.179178 2580 manager.go:1196] Started watching for new ooms in manager Jul 03 19:09:51.179802 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.179781 2580 manager.go:349] Starting recovery of all containers Jul 03 19:09:51.192233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.192216 2580 manager.go:354] Recovery completed Jul 03 19:09:51.196202 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.196185 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:51.198184 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.198167 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:51.198274 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.198203 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:51.198274 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.198218 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:51.198762 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.198745 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 03 19:09:51.198762 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.198763 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 03 19:09:51.198869 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.198767 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:51.198869 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.198782 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 03 19:09:51.199069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.199053 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wlmt9" Jul 03 19:09:51.199564 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.199547 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:51.199632 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.199573 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:51.199632 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.199583 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:51.199972 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.199959 2580 policy_none.go:49] "None policy: Start" Jul 03 19:09:51.200024 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.199978 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 03 19:09:51.200024 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.199992 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 03 19:09:51.200987 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.200975 2580 policy_none.go:47] "Start" Jul 03 19:09:51.207421 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.207402 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wlmt9" Jul 03 19:09:51.209288 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.209204 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-31.ec2.internal.18bedd45114f4877 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-31.ec2.internal,UID:ip-10-0-131-31.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-31.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-31.ec2.internal,},FirstTimestamp:2026-07-03 19:09:51.198185591 +0000 UTC m=+0.419930025,LastTimestamp:2026-07-03 19:09:51.198185591 +0000 UTC m=+0.419930025,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-31.ec2.internal,}" Jul 03 19:09:51.248558 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.248544 2580 manager.go:337] "Starting Device Plugin manager" Jul 03 19:09:51.248716 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.248583 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 03 19:09:51.248716 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.248597 2580 server.go:87] "Starting device plugin registration server" Jul 03 19:09:51.248911 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.248897 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 03 19:09:51.248978 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.248917 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 03 19:09:51.249087 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.249068 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 03 19:09:51.249185 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.249173 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 03 19:09:51.249233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.249187 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 03 19:09:51.249684 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.249664 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 03 19:09:51.249780 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.249717 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-31.ec2.internal\" not found" Jul 03 19:09:51.277780 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.277740 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 03 19:09:51.278968 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.278946 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 03 19:09:51.279060 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.278991 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 03 19:09:51.279060 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.279018 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 03 19:09:51.279142 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.279057 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 03 19:09:51.281259 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.281242 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:09:51.349121 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.349013 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:51.349979 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.349961 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:51.350064 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.349995 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:51.350064 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.350006 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:51.350064 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.350033 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.356960 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.356941 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.357047 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.356969 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-31.ec2.internal\": node \"ip-10-0-131-31.ec2.internal\" not found" Jul 03 19:09:51.380051 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.379869 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-31.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal"] Jul 03 19:09:51.380165 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.380086 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:51.381017 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.381000 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:51.381098 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.381031 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:51.381098 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.381044 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:51.382287 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.382274 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:51.382383 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.382368 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.382425 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.382397 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:51.382989 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.382971 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:51.382989 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.382980 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:51.383145 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.383000 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:51.383145 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.383001 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:51.383145 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.383013 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:51.383145 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.383022 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:51.384215 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.384202 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.384278 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.384226 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:51.384865 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.384847 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:51.384957 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.384891 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:51.384957 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.384910 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:51.392162 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.392145 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-31.ec2.internal\" not found" Jul 03 19:09:51.406583 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.406561 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-31.ec2.internal\" not found" node="ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.411245 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.411229 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-31.ec2.internal\" not found" node="ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.478653 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.478622 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eea71dadc75afc88f8ed3c86908d6173-config\") pod \"kube-apiserver-proxy-ip-10-0-131-31.ec2.internal\" (UID: \"eea71dadc75afc88f8ed3c86908d6173\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.478788 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.478656 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/275431b1d65f2616b5c21bf4e4bc857e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal\" (UID: \"275431b1d65f2616b5c21bf4e4bc857e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.478788 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.478698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/275431b1d65f2616b5c21bf4e4bc857e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal\" (UID: \"275431b1d65f2616b5c21bf4e4bc857e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.493215 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.493187 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-31.ec2.internal\" not found" Jul 03 19:09:51.579728 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.579698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eea71dadc75afc88f8ed3c86908d6173-config\") pod \"kube-apiserver-proxy-ip-10-0-131-31.ec2.internal\" (UID: \"eea71dadc75afc88f8ed3c86908d6173\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.579790 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.579734 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/275431b1d65f2616b5c21bf4e4bc857e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal\" (UID: \"275431b1d65f2616b5c21bf4e4bc857e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.579790 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.579758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/275431b1d65f2616b5c21bf4e4bc857e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal\" (UID: \"275431b1d65f2616b5c21bf4e4bc857e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.579870 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.579808 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eea71dadc75afc88f8ed3c86908d6173-config\") pod \"kube-apiserver-proxy-ip-10-0-131-31.ec2.internal\" (UID: \"eea71dadc75afc88f8ed3c86908d6173\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.579870 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.579836 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/275431b1d65f2616b5c21bf4e4bc857e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal\" (UID: \"275431b1d65f2616b5c21bf4e4bc857e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.579968 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.579912 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/275431b1d65f2616b5c21bf4e4bc857e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal\" (UID: \"275431b1d65f2616b5c21bf4e4bc857e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.593801 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.593771 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-31.ec2.internal\" not found" Jul 03 19:09:51.694718 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.694647 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-31.ec2.internal\" not found" Jul 03 19:09:51.709839 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.709816 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.714690 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:51.714371 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal" Jul 03 19:09:51.795313 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:51.795273 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-31.ec2.internal\" not found" Jul 03 19:09:53.480889 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:53.480850 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-31.ec2.internal\" not found" Jul 03 19:09:53.581492 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:53.581397 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-31.ec2.internal\" not found" Jul 03 19:09:53.682000 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:53.681963 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-31.ec2.internal\" not found" Jul 03 19:09:53.703125 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.703101 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 03 19:09:53.703302 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.703284 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 03 19:09:53.782493 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:53.782460 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-31.ec2.internal\" not found" Jul 03 19:09:53.794687 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.794626 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 19:04:52 +0000 UTC" deadline="2028-02-29 02:50:19.042066166 +0000 UTC" Jul 03 19:09:53.794687 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.794683 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14527h40m25.247387121s" Jul 03 19:09:53.876511 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.876456 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:09:53.877435 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.877413 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:09:53.877530 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.877454 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:09:53.877530 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.877473 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:09:53.882537 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:53.882514 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-31.ec2.internal\" not found" Jul 03 19:09:53.887080 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.887057 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:09:53.894531 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:53.894500 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod275431b1d65f2616b5c21bf4e4bc857e.slice/crio-b2c58bb51463f7a4bb2530ee29675d24b18de89d70dd0b3ad0eb41cff225d9fd WatchSource:0}: Error finding container b2c58bb51463f7a4bb2530ee29675d24b18de89d70dd0b3ad0eb41cff225d9fd: Status 404 returned error can't find the container with id b2c58bb51463f7a4bb2530ee29675d24b18de89d70dd0b3ad0eb41cff225d9fd Jul 03 19:09:53.894860 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:53.894840 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea71dadc75afc88f8ed3c86908d6173.slice/crio-2ecd6b4dbc02dcd159ffa39caea92b6bf59d8a78272a90490046503cfba7ba89 WatchSource:0}: Error finding container 2ecd6b4dbc02dcd159ffa39caea92b6bf59d8a78272a90490046503cfba7ba89: Status 404 returned error can't find the container with id 2ecd6b4dbc02dcd159ffa39caea92b6bf59d8a78272a90490046503cfba7ba89 Jul 03 19:09:53.899074 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.899060 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 19:09:53.918544 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.918515 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:09:53.961373 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.961341 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-31.ec2.internal" Jul 03 19:09:53.971780 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.971758 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 19:09:53.972730 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.972716 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal" Jul 03 19:09:53.985851 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.985831 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 19:09:53.988172 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:53.988152 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:09:54.752322 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.752288 2580 apiserver.go:52] "Watching apiserver" Jul 03 19:09:54.759888 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.759848 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 03 19:09:54.760999 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.760969 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-gbw2p","kube-system/kube-apiserver-proxy-ip-10-0-131-31.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd","openshift-dns/node-resolver-j7gdj","openshift-image-registry/node-ca-2lkpp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal","openshift-multus/network-metrics-daemon-qppqv","openshift-network-diagnostics/network-check-target-dhhtp","kube-system/global-pull-secret-syncer-9nssv","openshift-cluster-node-tuning-operator/tuned-2w26l","openshift-multus/multus-additional-cni-plugins-nrgtv","openshift-multus/multus-zmtrs","openshift-network-operator/iptables-alerter-fljc6","openshift-ovn-kubernetes/ovnkube-node-bc7lt"] Jul 03 19:09:54.761727 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.761704 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 03 19:09:54.762590 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.762556 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:09:54.762691 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:54.762649 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:09:54.763787 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.763769 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.765119 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.765099 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:09:54.765205 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:54.765171 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:09:54.766108 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.766088 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 03 19:09:54.766420 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.766398 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6sbfv\"" Jul 03 19:09:54.766640 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.766624 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 03 19:09:54.767099 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.767072 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 03 19:09:54.767183 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.767173 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 03 19:09:54.767508 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.767428 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 03 19:09:54.767915 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.767748 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7gdj" Jul 03 19:09:54.769399 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.768987 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2lkpp" Jul 03 19:09:54.770387 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.770026 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 03 19:09:54.770387 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.770087 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8zrnv\"" Jul 03 19:09:54.770387 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.770189 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 03 19:09:54.771544 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.771525 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gbw2p" Jul 03 19:09:54.772477 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.772410 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c6v78\"" Jul 03 19:09:54.772702 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.772616 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 03 19:09:54.774653 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.772899 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 03 19:09:54.774653 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.772919 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.774653 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.773083 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 03 19:09:54.774653 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.773552 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:54.774653 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:54.773621 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:09:54.774653 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.773692 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 03 19:09:54.774653 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.773708 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crprp\" (UniqueName: \"kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp\") pod \"network-check-target-dhhtp\" (UID: \"d60e930c-bc67-4956-b696-f6a25f673c7a\") " pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:09:54.774653 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.773963 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g74fj\"" Jul 03 19:09:54.774653 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.774503 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 03 19:09:54.775394 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.775026 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.775891 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.775711 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 03 19:09:54.775891 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.775729 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 03 19:09:54.776027 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.775963 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 03 19:09:54.776468 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.776177 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bhgpv\"" Jul 03 19:09:54.776468 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.776269 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.776993 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.776962 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 19:09:54.777767 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.777312 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:09:54.777767 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.777368 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s8n75\"" Jul 03 19:09:54.777767 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.777744 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 03 19:09:54.778041 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.777827 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fljc6" Jul 03 19:09:54.778427 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.778410 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 03 19:09:54.778543 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.778483 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hqt62\"" Jul 03 19:09:54.779781 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.778929 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.781342 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.780130 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:09:54.781342 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.780544 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 03 19:09:54.781342 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.780719 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 03 19:09:54.781342 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.780933 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xvcx6\"" Jul 03 19:09:54.781594 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.781379 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 03 19:09:54.786415 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.784191 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 03 19:09:54.786415 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.784578 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 03 19:09:54.786415 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.785154 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 03 19:09:54.786415 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.785501 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4tfbh\"" Jul 03 19:09:54.786415 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.786071 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 03 19:09:54.786784 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.786760 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 03 19:09:54.794454 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.794433 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sbbjt" Jul 03 19:09:54.801850 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.801829 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sbbjt" Jul 03 19:09:54.863768 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.863743 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 03 19:09:54.868436 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.868380 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-31.ec2.internal" event={"ID":"eea71dadc75afc88f8ed3c86908d6173","Type":"ContainerStarted","Data":"2ecd6b4dbc02dcd159ffa39caea92b6bf59d8a78272a90490046503cfba7ba89"} Jul 03 19:09:54.869411 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.869388 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal" event={"ID":"275431b1d65f2616b5c21bf4e4bc857e","Type":"ContainerStarted","Data":"b2c58bb51463f7a4bb2530ee29675d24b18de89d70dd0b3ad0eb41cff225d9fd"} Jul 03 19:09:54.874155 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874129 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-sys-fs\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.874262 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874168 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-sysconfig\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.874262 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874202 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-systemd\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.874262 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-lib-modules\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.874262 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874253 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69d5b1af-238d-4ade-b2d8-ce7c9984194a-tmp\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.874470 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874278 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:09:54.874470 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874302 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlj2j\" (UniqueName: \"kubernetes.io/projected/1a93ef31-a568-4c2d-8dbd-4327453115de-kube-api-access-qlj2j\") pod \"node-ca-2lkpp\" (UID: \"1a93ef31-a568-4c2d-8dbd-4327453115de\") " pod="openshift-image-registry/node-ca-2lkpp" Jul 03 19:09:54.874470 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874337 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-device-dir\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.874470 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874358 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-run\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.874470 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-host\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.874470 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-tuned\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.874470 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874441 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjv2v\" (UniqueName: \"kubernetes.io/projected/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-kube-api-access-zjv2v\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874479 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-run-netns\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874503 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw78w\" (UniqueName: \"kubernetes.io/projected/4a999727-989f-455a-97a2-5d22457d4ec2-kube-api-access-cw78w\") pod \"iptables-alerter-fljc6\" (UID: \"4a999727-989f-455a-97a2-5d22457d4ec2\") " pod="openshift-network-operator/iptables-alerter-fljc6" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874528 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6457dab1-5787-4473-b0e1-83aee66283ad-os-release\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874551 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-kubelet-config\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874572 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-sysctl-conf\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-os-release\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874617 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/29e493de-b3a6-478c-bbce-3e91a048d7c5-multus-daemon-config\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874639 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j7md\" (UniqueName: \"kubernetes.io/projected/29e493de-b3a6-478c-bbce-3e91a048d7c5-kube-api-access-2j7md\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874669 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-run-netns\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e29883ca-7474-4677-823b-0a5cbc393c29-ovn-node-metrics-cert\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874718 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6457dab1-5787-4473-b0e1-83aee66283ad-system-cni-dir\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874768 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-run-ovn\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckjmv\" (UniqueName: \"kubernetes.io/projected/1f84c8db-09a4-4159-af48-b3eeeb85a717-kube-api-access-ckjmv\") pod \"node-resolver-j7gdj\" (UID: \"1f84c8db-09a4-4159-af48-b3eeeb85a717\") " pod="openshift-dns/node-resolver-j7gdj" Jul 03 19:09:54.874843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874851 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874904 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-socket-dir\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-run-k8s-cni-cncf-io\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.874967 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-var-lib-kubelet\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-multus-conf-dir\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875024 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-etc-kubernetes\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-kubelet\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-etc-openvswitch\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-multus-socket-dir-parent\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875141 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-var-lib-cni-bin\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875168 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e29883ca-7474-4677-823b-0a5cbc393c29-env-overrides\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875191 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcfqs\" (UniqueName: \"kubernetes.io/projected/e29883ca-7474-4677-823b-0a5cbc393c29-kube-api-access-gcfqs\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875220 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-cni-bin\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875255 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6457dab1-5787-4473-b0e1-83aee66283ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875294 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-registration-dir\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875326 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-systemd-units\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.875561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-cni-netd\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a93ef31-a568-4c2d-8dbd-4327453115de-host\") pod \"node-ca-2lkpp\" (UID: \"1a93ef31-a568-4c2d-8dbd-4327453115de\") " pod="openshift-image-registry/node-ca-2lkpp" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-hostroot\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875440 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-etc-selinux\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875469 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-modprobe-d\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875498 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99gck\" (UniqueName: \"kubernetes.io/projected/69d5b1af-238d-4ade-b2d8-ce7c9984194a-kube-api-access-99gck\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-multus-cni-dir\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875540 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a999727-989f-455a-97a2-5d22457d4ec2-host-slash\") pod \"iptables-alerter-fljc6\" (UID: \"4a999727-989f-455a-97a2-5d22457d4ec2\") " pod="openshift-network-operator/iptables-alerter-fljc6" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875569 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0ef4969-336c-4a67-a4ab-58614ca9931a-konnectivity-ca\") pod \"konnectivity-agent-gbw2p\" (UID: \"b0ef4969-336c-4a67-a4ab-58614ca9931a\") " pod="kube-system/konnectivity-agent-gbw2p" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875597 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-sysctl-d\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29e493de-b3a6-478c-bbce-3e91a048d7c5-cni-binary-copy\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-run-multus-certs\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875674 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f84c8db-09a4-4159-af48-b3eeeb85a717-tmp-dir\") pod \"node-resolver-j7gdj\" (UID: \"1f84c8db-09a4-4159-af48-b3eeeb85a717\") " pod="openshift-dns/node-resolver-j7gdj" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875695 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-dbus\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875716 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-system-cni-dir\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875748 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a999727-989f-455a-97a2-5d22457d4ec2-iptables-alerter-script\") pod \"iptables-alerter-fljc6\" (UID: \"4a999727-989f-455a-97a2-5d22457d4ec2\") " pod="openshift-network-operator/iptables-alerter-fljc6" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-run-openvswitch\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.876233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-kubernetes\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875837 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-sys\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-var-lib-kubelet\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crprp\" (UniqueName: \"kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp\") pod \"network-check-target-dhhtp\" (UID: \"d60e930c-bc67-4956-b696-f6a25f673c7a\") " pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875947 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-run-systemd\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875971 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6457dab1-5787-4473-b0e1-83aee66283ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.875995 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6457dab1-5787-4473-b0e1-83aee66283ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876029 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-cnibin\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876066 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-slash\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876090 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-var-lib-openvswitch\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876112 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-log-socket\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876135 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876160 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6457dab1-5787-4473-b0e1-83aee66283ad-cnibin\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0ef4969-336c-4a67-a4ab-58614ca9931a-agent-certs\") pod \"konnectivity-agent-gbw2p\" (UID: \"b0ef4969-336c-4a67-a4ab-58614ca9931a\") " pod="kube-system/konnectivity-agent-gbw2p" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-var-lib-cni-multus\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876290 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-node-log\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.877069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876316 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e29883ca-7474-4677-823b-0a5cbc393c29-ovnkube-config\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.877760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876359 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6457dab1-5787-4473-b0e1-83aee66283ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.877760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876409 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxln2\" (UniqueName: \"kubernetes.io/projected/6457dab1-5787-4473-b0e1-83aee66283ad-kube-api-access-jxln2\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.877760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f84c8db-09a4-4159-af48-b3eeeb85a717-hosts-file\") pod \"node-resolver-j7gdj\" (UID: \"1f84c8db-09a4-4159-af48-b3eeeb85a717\") " pod="openshift-dns/node-resolver-j7gdj" Jul 03 19:09:54.877760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876476 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1a93ef31-a568-4c2d-8dbd-4327453115de-serviceca\") pod \"node-ca-2lkpp\" (UID: \"1a93ef31-a568-4c2d-8dbd-4327453115de\") " pod="openshift-image-registry/node-ca-2lkpp" Jul 03 19:09:54.877760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876504 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx6j9\" (UniqueName: \"kubernetes.io/projected/4677acb4-5880-4d3d-a5d0-6568e6e5be81-kube-api-access-bx6j9\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.877760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-run-ovn-kubernetes\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.877760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.876562 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e29883ca-7474-4677-823b-0a5cbc393c29-ovnkube-script-lib\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.882493 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:54.882178 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:09:54.882493 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:54.882207 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:09:54.882493 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:54.882222 2580 projected.go:196] Error preparing data for projected volume kube-api-access-crprp for pod openshift-network-diagnostics/network-check-target-dhhtp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:54.882493 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:54.882463 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp podName:d60e930c-bc67-4956-b696-f6a25f673c7a nodeName:}" failed. No retries permitted until 2026-07-03 19:09:55.382290403 +0000 UTC m=+3.019036076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-crprp" (UniqueName: "kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp") pod "network-check-target-dhhtp" (UID: "d60e930c-bc67-4956-b696-f6a25f673c7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:54.977270 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcfqs\" (UniqueName: \"kubernetes.io/projected/e29883ca-7474-4677-823b-0a5cbc393c29-kube-api-access-gcfqs\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.977270 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-cni-bin\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977335 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-cni-bin\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6457dab1-5787-4473-b0e1-83aee66283ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-registration-dir\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-systemd-units\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977408 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-cni-netd\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977430 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a93ef31-a568-4c2d-8dbd-4327453115de-host\") pod \"node-ca-2lkpp\" (UID: \"1a93ef31-a568-4c2d-8dbd-4327453115de\") " pod="openshift-image-registry/node-ca-2lkpp" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-hostroot\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-etc-selinux\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-modprobe-d\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977530 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99gck\" (UniqueName: \"kubernetes.io/projected/69d5b1af-238d-4ade-b2d8-ce7c9984194a-kube-api-access-99gck\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-multus-cni-dir\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977576 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a999727-989f-455a-97a2-5d22457d4ec2-host-slash\") pod \"iptables-alerter-fljc6\" (UID: \"4a999727-989f-455a-97a2-5d22457d4ec2\") " pod="openshift-network-operator/iptables-alerter-fljc6" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0ef4969-336c-4a67-a4ab-58614ca9931a-konnectivity-ca\") pod \"konnectivity-agent-gbw2p\" (UID: \"b0ef4969-336c-4a67-a4ab-58614ca9931a\") " pod="kube-system/konnectivity-agent-gbw2p" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-sysctl-d\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29e493de-b3a6-478c-bbce-3e91a048d7c5-cni-binary-copy\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-run-multus-certs\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.977733 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f84c8db-09a4-4159-af48-b3eeeb85a717-tmp-dir\") pod \"node-resolver-j7gdj\" (UID: \"1f84c8db-09a4-4159-af48-b3eeeb85a717\") " pod="openshift-dns/node-resolver-j7gdj" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977724 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-dbus\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977747 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-system-cni-dir\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a999727-989f-455a-97a2-5d22457d4ec2-iptables-alerter-script\") pod \"iptables-alerter-fljc6\" (UID: \"4a999727-989f-455a-97a2-5d22457d4ec2\") " pod="openshift-network-operator/iptables-alerter-fljc6" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-run-openvswitch\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977825 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-kubernetes\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977848 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-sys\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977930 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-sys\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977929 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a999727-989f-455a-97a2-5d22457d4ec2-host-slash\") pod \"iptables-alerter-fljc6\" (UID: \"4a999727-989f-455a-97a2-5d22457d4ec2\") " pod="openshift-network-operator/iptables-alerter-fljc6" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977947 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6457dab1-5787-4473-b0e1-83aee66283ad-cni-binary-copy\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.977978 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-var-lib-kubelet\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-run-systemd\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978048 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6457dab1-5787-4473-b0e1-83aee66283ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6457dab1-5787-4473-b0e1-83aee66283ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978091 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-sysctl-d\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978100 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-cnibin\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-slash\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978150 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-cnibin\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.978760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-var-lib-openvswitch\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978196 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-log-socket\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6457dab1-5787-4473-b0e1-83aee66283ad-cnibin\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0ef4969-336c-4a67-a4ab-58614ca9931a-agent-certs\") pod \"konnectivity-agent-gbw2p\" (UID: \"b0ef4969-336c-4a67-a4ab-58614ca9931a\") " pod="kube-system/konnectivity-agent-gbw2p" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-var-lib-cni-multus\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-node-log\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e29883ca-7474-4677-823b-0a5cbc393c29-ovnkube-config\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6457dab1-5787-4473-b0e1-83aee66283ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978408 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxln2\" (UniqueName: \"kubernetes.io/projected/6457dab1-5787-4473-b0e1-83aee66283ad-kube-api-access-jxln2\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978415 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-registration-dir\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f84c8db-09a4-4159-af48-b3eeeb85a717-hosts-file\") pod \"node-resolver-j7gdj\" (UID: \"1f84c8db-09a4-4159-af48-b3eeeb85a717\") " pod="openshift-dns/node-resolver-j7gdj" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978438 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0ef4969-336c-4a67-a4ab-58614ca9931a-konnectivity-ca\") pod \"konnectivity-agent-gbw2p\" (UID: \"b0ef4969-336c-4a67-a4ab-58614ca9931a\") " pod="kube-system/konnectivity-agent-gbw2p" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978452 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-systemd-units\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1a93ef31-a568-4c2d-8dbd-4327453115de-serviceca\") pod \"node-ca-2lkpp\" (UID: \"1a93ef31-a568-4c2d-8dbd-4327453115de\") " pod="openshift-image-registry/node-ca-2lkpp" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978482 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-cni-netd\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx6j9\" (UniqueName: \"kubernetes.io/projected/4677acb4-5880-4d3d-a5d0-6568e6e5be81-kube-api-access-bx6j9\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.979918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978527 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-run-ovn-kubernetes\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978534 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-hostroot\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978553 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e29883ca-7474-4677-823b-0a5cbc393c29-ovnkube-script-lib\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-sys-fs\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-sysconfig\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-systemd\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978635 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-etc-selinux\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-lib-modules\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69d5b1af-238d-4ade-b2d8-ce7c9984194a-tmp\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978691 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-multus-cni-dir\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978703 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978721 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-modprobe-d\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978742 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a93ef31-a568-4c2d-8dbd-4327453115de-host\") pod \"node-ca-2lkpp\" (UID: \"1a93ef31-a568-4c2d-8dbd-4327453115de\") " pod="openshift-image-registry/node-ca-2lkpp" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlj2j\" (UniqueName: \"kubernetes.io/projected/1a93ef31-a568-4c2d-8dbd-4327453115de-kube-api-access-qlj2j\") pod \"node-ca-2lkpp\" (UID: \"1a93ef31-a568-4c2d-8dbd-4327453115de\") " pod="openshift-image-registry/node-ca-2lkpp" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978789 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-var-lib-kubelet\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:54.978806 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978819 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6457dab1-5787-4473-b0e1-83aee66283ad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-device-dir\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.981036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.978838 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-node-log\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979023 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-device-dir\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979054 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-run\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979079 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-host\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979103 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-tuned\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjv2v\" (UniqueName: \"kubernetes.io/projected/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-kube-api-access-zjv2v\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979154 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-run-netns\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979184 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw78w\" (UniqueName: \"kubernetes.io/projected/4a999727-989f-455a-97a2-5d22457d4ec2-kube-api-access-cw78w\") pod \"iptables-alerter-fljc6\" (UID: \"4a999727-989f-455a-97a2-5d22457d4ec2\") " pod="openshift-network-operator/iptables-alerter-fljc6" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6457dab1-5787-4473-b0e1-83aee66283ad-os-release\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-kubelet-config\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979257 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-sysctl-conf\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979281 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-os-release\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/29e493de-b3a6-478c-bbce-3e91a048d7c5-multus-daemon-config\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j7md\" (UniqueName: \"kubernetes.io/projected/29e493de-b3a6-478c-bbce-3e91a048d7c5-kube-api-access-2j7md\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979338 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6457dab1-5787-4473-b0e1-83aee66283ad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-run-netns\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979378 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e29883ca-7474-4677-823b-0a5cbc393c29-ovn-node-metrics-cert\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.982244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979397 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29e493de-b3a6-478c-bbce-3e91a048d7c5-cni-binary-copy\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979405 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6457dab1-5787-4473-b0e1-83aee66283ad-system-cni-dir\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979430 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979454 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-run-ovn\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979457 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-run-multus-certs\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckjmv\" (UniqueName: \"kubernetes.io/projected/1f84c8db-09a4-4159-af48-b3eeeb85a717-kube-api-access-ckjmv\") pod \"node-resolver-j7gdj\" (UID: \"1f84c8db-09a4-4159-af48-b3eeeb85a717\") " pod="openshift-dns/node-resolver-j7gdj" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979503 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979527 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-socket-dir\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-run-k8s-cni-cncf-io\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979583 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-var-lib-kubelet\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979606 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-multus-conf-dir\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-etc-kubernetes\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979639 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e29883ca-7474-4677-823b-0a5cbc393c29-ovnkube-config\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979662 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-kubelet\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979711 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-kubelet\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979714 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f84c8db-09a4-4159-af48-b3eeeb85a717-tmp-dir\") pod \"node-resolver-j7gdj\" (UID: \"1f84c8db-09a4-4159-af48-b3eeeb85a717\") " pod="openshift-dns/node-resolver-j7gdj" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979719 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-sys-fs\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.983382 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-etc-openvswitch\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979769 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-host\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979777 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-multus-socket-dir-parent\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979789 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-dbus\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-var-lib-cni-bin\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979810 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e29883ca-7474-4677-823b-0a5cbc393c29-ovnkube-script-lib\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e29883ca-7474-4677-823b-0a5cbc393c29-env-overrides\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979839 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-system-cni-dir\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979930 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979938 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-log-socket\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979974 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6457dab1-5787-4473-b0e1-83aee66283ad-cnibin\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.979992 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-sysconfig\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.980044 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-systemd\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.980054 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.980130 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-lib-modules\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.980170 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-run-systemd\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.980209 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-run\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.980233 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6457dab1-5787-4473-b0e1-83aee66283ad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.984414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.980275 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-var-lib-cni-multus\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.980446 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f84c8db-09a4-4159-af48-b3eeeb85a717-hosts-file\") pod \"node-resolver-j7gdj\" (UID: \"1f84c8db-09a4-4159-af48-b3eeeb85a717\") " pod="openshift-dns/node-resolver-j7gdj" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:54.980516 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:54.980568 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret podName:c62e02f4-4e83-4acd-aea5-6a54a58b87aa nodeName:}" failed. No retries permitted until 2026-07-03 19:09:55.48055003 +0000 UTC m=+3.117295692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret") pod "global-pull-secret-syncer-9nssv" (UID: "c62e02f4-4e83-4acd-aea5-6a54a58b87aa") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.980613 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-run-ovn\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.980780 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1a93ef31-a568-4c2d-8dbd-4327453115de-serviceca\") pod \"node-ca-2lkpp\" (UID: \"1a93ef31-a568-4c2d-8dbd-4327453115de\") " pod="openshift-image-registry/node-ca-2lkpp" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.980823 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981066 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4677acb4-5880-4d3d-a5d0-6568e6e5be81-socket-dir\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981101 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-run-k8s-cni-cncf-io\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981114 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-os-release\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981131 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-var-lib-kubelet\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981157 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-multus-conf-dir\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981175 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-run-netns\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981185 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-etc-kubernetes\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981224 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-kubelet-config\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981233 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6457dab1-5787-4473-b0e1-83aee66283ad-os-release\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981259 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-run-ovn-kubernetes\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.985220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981290 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6457dab1-5787-4473-b0e1-83aee66283ad-system-cni-dir\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981332 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-run-netns\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981347 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-sysctl-conf\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981394 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-host-var-lib-cni-bin\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981536 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-run-openvswitch\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981698 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/29e493de-b3a6-478c-bbce-3e91a048d7c5-multus-daemon-config\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981758 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-etc-openvswitch\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981806 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-host-slash\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981858 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-kubernetes\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981922 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e29883ca-7474-4677-823b-0a5cbc393c29-env-overrides\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.981977 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e29883ca-7474-4677-823b-0a5cbc393c29-var-lib-openvswitch\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:54.982142 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs podName:824d4565-f8d2-4099-adfb-e97ef0c6dcc2 nodeName:}" failed. No retries permitted until 2026-07-03 19:09:55.48211066 +0000 UTC m=+3.118856329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs") pod "network-metrics-daemon-qppqv" (UID: "824d4565-f8d2-4099-adfb-e97ef0c6dcc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.982161 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/29e493de-b3a6-478c-bbce-3e91a048d7c5-multus-socket-dir-parent\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.982336 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a999727-989f-455a-97a2-5d22457d4ec2-iptables-alerter-script\") pod \"iptables-alerter-fljc6\" (UID: \"4a999727-989f-455a-97a2-5d22457d4ec2\") " pod="openshift-network-operator/iptables-alerter-fljc6" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.984594 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69d5b1af-238d-4ade-b2d8-ce7c9984194a-tmp\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.984703 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e29883ca-7474-4677-823b-0a5cbc393c29-ovn-node-metrics-cert\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.984730 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69d5b1af-238d-4ade-b2d8-ce7c9984194a-etc-tuned\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.985932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.984898 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0ef4969-336c-4a67-a4ab-58614ca9931a-agent-certs\") pod \"konnectivity-agent-gbw2p\" (UID: \"b0ef4969-336c-4a67-a4ab-58614ca9931a\") " pod="kube-system/konnectivity-agent-gbw2p" Jul 03 19:09:54.994692 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.994666 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjv2v\" (UniqueName: \"kubernetes.io/projected/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-kube-api-access-zjv2v\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:09:54.995109 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.995091 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlj2j\" (UniqueName: \"kubernetes.io/projected/1a93ef31-a568-4c2d-8dbd-4327453115de-kube-api-access-qlj2j\") pod \"node-ca-2lkpp\" (UID: \"1a93ef31-a568-4c2d-8dbd-4327453115de\") " pod="openshift-image-registry/node-ca-2lkpp" Jul 03 19:09:54.996972 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.996510 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99gck\" (UniqueName: \"kubernetes.io/projected/69d5b1af-238d-4ade-b2d8-ce7c9984194a-kube-api-access-99gck\") pod \"tuned-2w26l\" (UID: \"69d5b1af-238d-4ade-b2d8-ce7c9984194a\") " pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:54.996972 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.996936 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw78w\" (UniqueName: \"kubernetes.io/projected/4a999727-989f-455a-97a2-5d22457d4ec2-kube-api-access-cw78w\") pod \"iptables-alerter-fljc6\" (UID: \"4a999727-989f-455a-97a2-5d22457d4ec2\") " pod="openshift-network-operator/iptables-alerter-fljc6" Jul 03 19:09:54.996972 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.996939 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j7md\" (UniqueName: \"kubernetes.io/projected/29e493de-b3a6-478c-bbce-3e91a048d7c5-kube-api-access-2j7md\") pod \"multus-zmtrs\" (UID: \"29e493de-b3a6-478c-bbce-3e91a048d7c5\") " pod="openshift-multus/multus-zmtrs" Jul 03 19:09:54.996972 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.996952 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckjmv\" (UniqueName: \"kubernetes.io/projected/1f84c8db-09a4-4159-af48-b3eeeb85a717-kube-api-access-ckjmv\") pod \"node-resolver-j7gdj\" (UID: \"1f84c8db-09a4-4159-af48-b3eeeb85a717\") " pod="openshift-dns/node-resolver-j7gdj" Jul 03 19:09:54.997379 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.997355 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx6j9\" (UniqueName: \"kubernetes.io/projected/4677acb4-5880-4d3d-a5d0-6568e6e5be81-kube-api-access-bx6j9\") pod \"aws-ebs-csi-driver-node-fb4hd\" (UID: \"4677acb4-5880-4d3d-a5d0-6568e6e5be81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:54.997981 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.997953 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxln2\" (UniqueName: \"kubernetes.io/projected/6457dab1-5787-4473-b0e1-83aee66283ad-kube-api-access-jxln2\") pod \"multus-additional-cni-plugins-nrgtv\" (UID: \"6457dab1-5787-4473-b0e1-83aee66283ad\") " pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:54.998641 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:54.998552 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcfqs\" (UniqueName: \"kubernetes.io/projected/e29883ca-7474-4677-823b-0a5cbc393c29-kube-api-access-gcfqs\") pod \"ovnkube-node-bc7lt\" (UID: \"e29883ca-7474-4677-823b-0a5cbc393c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:55.034619 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.034549 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:09:55.078596 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.078558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nrgtv" Jul 03 19:09:55.096647 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.096614 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7gdj" Jul 03 19:09:55.107487 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.107458 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2lkpp" Jul 03 19:09:55.114325 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.114302 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gbw2p" Jul 03 19:09:55.122181 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.122155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" Jul 03 19:09:55.130902 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.130869 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2w26l" Jul 03 19:09:55.139806 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.139786 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zmtrs" Jul 03 19:09:55.147577 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.147560 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fljc6" Jul 03 19:09:55.154413 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.154390 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:09:55.382907 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.382807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crprp\" (UniqueName: \"kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp\") pod \"network-check-target-dhhtp\" (UID: \"d60e930c-bc67-4956-b696-f6a25f673c7a\") " pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:09:55.383053 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:55.382993 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:09:55.383053 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:55.383018 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:09:55.383053 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:55.383028 2580 projected.go:196] Error preparing data for projected volume kube-api-access-crprp for pod openshift-network-diagnostics/network-check-target-dhhtp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:55.383163 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:55.383079 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp podName:d60e930c-bc67-4956-b696-f6a25f673c7a nodeName:}" failed. No retries permitted until 2026-07-03 19:09:56.383065148 +0000 UTC m=+4.019810806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-crprp" (UniqueName: "kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp") pod "network-check-target-dhhtp" (UID: "d60e930c-bc67-4956-b696-f6a25f673c7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:55.483858 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.483813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:09:55.484048 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.483912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:55.484048 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:55.484018 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:55.484157 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:55.484053 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:55.484157 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:55.484088 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs podName:824d4565-f8d2-4099-adfb-e97ef0c6dcc2 nodeName:}" failed. No retries permitted until 2026-07-03 19:09:56.484072653 +0000 UTC m=+4.120818316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs") pod "network-metrics-daemon-qppqv" (UID: "824d4565-f8d2-4099-adfb-e97ef0c6dcc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:55.484157 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:55.484103 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret podName:c62e02f4-4e83-4acd-aea5-6a54a58b87aa nodeName:}" failed. No retries permitted until 2026-07-03 19:09:56.48409717 +0000 UTC m=+4.120842831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret") pod "global-pull-secret-syncer-9nssv" (UID: "c62e02f4-4e83-4acd-aea5-6a54a58b87aa") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:55.804609 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.804503 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 19:04:54 +0000 UTC" deadline="2028-04-01 01:41:32.952653514 +0000 UTC" Jul 03 19:09:55.804609 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:55.804550 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15294h31m37.148111777s" Jul 03 19:09:55.911560 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:55.911528 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d5b1af_238d_4ade_b2d8_ce7c9984194a.slice/crio-3bb943604e5efa938a25df5336537bc02a93696b1a1d92c1ff6e3da3f5e3180e WatchSource:0}: Error finding container 3bb943604e5efa938a25df5336537bc02a93696b1a1d92c1ff6e3da3f5e3180e: Status 404 returned error can't find the container with id 3bb943604e5efa938a25df5336537bc02a93696b1a1d92c1ff6e3da3f5e3180e Jul 03 19:09:55.915313 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:55.915277 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode29883ca_7474_4677_823b_0a5cbc393c29.slice/crio-e0e99cbaa4b3465d3b21db388dd7439f50fd4cca645fa583af124f59ca12dee0 WatchSource:0}: Error finding container e0e99cbaa4b3465d3b21db388dd7439f50fd4cca645fa583af124f59ca12dee0: Status 404 returned error can't find the container with id e0e99cbaa4b3465d3b21db388dd7439f50fd4cca645fa583af124f59ca12dee0 Jul 03 19:09:55.916778 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:55.916749 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a93ef31_a568_4c2d_8dbd_4327453115de.slice/crio-ea185f9917b8905f32468c5b94d8e29106bfa649cfed2041bdf3e030893fba14 WatchSource:0}: Error finding container ea185f9917b8905f32468c5b94d8e29106bfa649cfed2041bdf3e030893fba14: Status 404 returned error can't find the container with id ea185f9917b8905f32468c5b94d8e29106bfa649cfed2041bdf3e030893fba14 Jul 03 19:09:55.919029 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:55.918992 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ef4969_336c_4a67_a4ab_58614ca9931a.slice/crio-7c8ed13654654b39595e82ec57b5bd023292091afaf6ebee9ada830c93b3d897 WatchSource:0}: Error finding container 7c8ed13654654b39595e82ec57b5bd023292091afaf6ebee9ada830c93b3d897: Status 404 returned error can't find the container with id 7c8ed13654654b39595e82ec57b5bd023292091afaf6ebee9ada830c93b3d897 Jul 03 19:09:55.919737 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:55.919713 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f84c8db_09a4_4159_af48_b3eeeb85a717.slice/crio-a09852141c28a8b759d78c9406e1e5badea518f976155c1464c7631377c50194 WatchSource:0}: Error finding container a09852141c28a8b759d78c9406e1e5badea518f976155c1464c7631377c50194: Status 404 returned error can't find the container with id a09852141c28a8b759d78c9406e1e5badea518f976155c1464c7631377c50194 Jul 03 19:09:55.921529 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:55.921236 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4677acb4_5880_4d3d_a5d0_6568e6e5be81.slice/crio-ee00a2c6985832b2adb5d195b952d11c4917141da61e86bdb804ecef62dd4f1f WatchSource:0}: Error finding container ee00a2c6985832b2adb5d195b952d11c4917141da61e86bdb804ecef62dd4f1f: Status 404 returned error can't find the container with id ee00a2c6985832b2adb5d195b952d11c4917141da61e86bdb804ecef62dd4f1f Jul 03 19:09:55.923251 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:55.923200 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e493de_b3a6_478c_bbce_3e91a048d7c5.slice/crio-bdfe70363837a6c49e502186744cda07c17ad934598fc87dcc5b3e9da776a276 WatchSource:0}: Error finding container bdfe70363837a6c49e502186744cda07c17ad934598fc87dcc5b3e9da776a276: Status 404 returned error can't find the container with id bdfe70363837a6c49e502186744cda07c17ad934598fc87dcc5b3e9da776a276 Jul 03 19:09:55.924319 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:55.924295 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6457dab1_5787_4473_b0e1_83aee66283ad.slice/crio-9cba2517012fcdfdfe0076b4b9a678e62f8cb9e2fced286806265d0ccc678292 WatchSource:0}: Error finding container 9cba2517012fcdfdfe0076b4b9a678e62f8cb9e2fced286806265d0ccc678292: Status 404 returned error can't find the container with id 9cba2517012fcdfdfe0076b4b9a678e62f8cb9e2fced286806265d0ccc678292 Jul 03 19:09:55.926700 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:09:55.926395 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a999727_989f_455a_97a2_5d22457d4ec2.slice/crio-84418c28b279aa0f6f21306b846b400f9cd66ee00fd47734fc35bd466898dc55 WatchSource:0}: Error finding container 84418c28b279aa0f6f21306b846b400f9cd66ee00fd47734fc35bd466898dc55: Status 404 returned error can't find the container with id 84418c28b279aa0f6f21306b846b400f9cd66ee00fd47734fc35bd466898dc55 Jul 03 19:09:56.390798 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.390488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crprp\" (UniqueName: \"kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp\") pod \"network-check-target-dhhtp\" (UID: \"d60e930c-bc67-4956-b696-f6a25f673c7a\") " pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:09:56.390798 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:56.390673 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:09:56.390798 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:56.390795 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:09:56.391073 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:56.390812 2580 projected.go:196] Error preparing data for projected volume kube-api-access-crprp for pod openshift-network-diagnostics/network-check-target-dhhtp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:56.391073 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:56.390903 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp podName:d60e930c-bc67-4956-b696-f6a25f673c7a nodeName:}" failed. No retries permitted until 2026-07-03 19:09:58.390864304 +0000 UTC m=+6.027609986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-crprp" (UniqueName: "kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp") pod "network-check-target-dhhtp" (UID: "d60e930c-bc67-4956-b696-f6a25f673c7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:56.492377 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.491606 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:09:56.492377 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.491665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:56.492377 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:56.491813 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:56.492377 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:56.491897 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret podName:c62e02f4-4e83-4acd-aea5-6a54a58b87aa nodeName:}" failed. No retries permitted until 2026-07-03 19:09:58.491861813 +0000 UTC m=+6.128607485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret") pod "global-pull-secret-syncer-9nssv" (UID: "c62e02f4-4e83-4acd-aea5-6a54a58b87aa") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:56.492377 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:56.492288 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:56.492377 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:56.492337 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs podName:824d4565-f8d2-4099-adfb-e97ef0c6dcc2 nodeName:}" failed. No retries permitted until 2026-07-03 19:09:58.492320507 +0000 UTC m=+6.129066184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs") pod "network-metrics-daemon-qppqv" (UID: "824d4565-f8d2-4099-adfb-e97ef0c6dcc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:56.805500 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.805357 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 19:04:54 +0000 UTC" deadline="2027-12-02 18:03:44.216434327 +0000 UTC" Jul 03 19:09:56.805500 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.805420 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12406h53m47.411018761s" Jul 03 19:09:56.872972 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.872944 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:56.873131 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:56.873064 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:09:56.873467 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.873445 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:09:56.873576 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:56.873556 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:09:56.873647 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.873620 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:09:56.873699 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:56.873684 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:09:56.882180 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.882101 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nrgtv" event={"ID":"6457dab1-5787-4473-b0e1-83aee66283ad","Type":"ContainerStarted","Data":"9cba2517012fcdfdfe0076b4b9a678e62f8cb9e2fced286806265d0ccc678292"} Jul 03 19:09:56.899142 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.899106 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zmtrs" event={"ID":"29e493de-b3a6-478c-bbce-3e91a048d7c5","Type":"ContainerStarted","Data":"bdfe70363837a6c49e502186744cda07c17ad934598fc87dcc5b3e9da776a276"} Jul 03 19:09:56.909137 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.909104 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" event={"ID":"4677acb4-5880-4d3d-a5d0-6568e6e5be81","Type":"ContainerStarted","Data":"ee00a2c6985832b2adb5d195b952d11c4917141da61e86bdb804ecef62dd4f1f"} Jul 03 19:09:56.912025 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.911945 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7gdj" event={"ID":"1f84c8db-09a4-4159-af48-b3eeeb85a717","Type":"ContainerStarted","Data":"a09852141c28a8b759d78c9406e1e5badea518f976155c1464c7631377c50194"} Jul 03 19:09:56.922180 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.922111 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2lkpp" event={"ID":"1a93ef31-a568-4c2d-8dbd-4327453115de","Type":"ContainerStarted","Data":"ea185f9917b8905f32468c5b94d8e29106bfa649cfed2041bdf3e030893fba14"} Jul 03 19:09:56.935729 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.935694 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2w26l" event={"ID":"69d5b1af-238d-4ade-b2d8-ce7c9984194a","Type":"ContainerStarted","Data":"3bb943604e5efa938a25df5336537bc02a93696b1a1d92c1ff6e3da3f5e3180e"} Jul 03 19:09:56.943356 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.943322 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-31.ec2.internal" event={"ID":"eea71dadc75afc88f8ed3c86908d6173","Type":"ContainerStarted","Data":"5022f1b6556714c7b952787600e5fd841ce68b260f4ae692ab91c4b7618c4093"} Jul 03 19:09:56.951646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.951031 2580 generic.go:356] "Generic (PLEG): container finished" podID="275431b1d65f2616b5c21bf4e4bc857e" containerID="958fba4ba506aacd5afa06f4e71eab521e73faf282e493c319c7ccc3b722addf" exitCode=0 Jul 03 19:09:56.951646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.951112 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal" event={"ID":"275431b1d65f2616b5c21bf4e4bc857e","Type":"ContainerDied","Data":"958fba4ba506aacd5afa06f4e71eab521e73faf282e493c319c7ccc3b722addf"} Jul 03 19:09:56.960153 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.960124 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fljc6" event={"ID":"4a999727-989f-455a-97a2-5d22457d4ec2","Type":"ContainerStarted","Data":"84418c28b279aa0f6f21306b846b400f9cd66ee00fd47734fc35bd466898dc55"} Jul 03 19:09:56.977155 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.976844 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gbw2p" event={"ID":"b0ef4969-336c-4a67-a4ab-58614ca9931a","Type":"ContainerStarted","Data":"7c8ed13654654b39595e82ec57b5bd023292091afaf6ebee9ada830c93b3d897"} Jul 03 19:09:56.980296 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.979854 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-31.ec2.internal" podStartSLOduration=3.979834992 podStartE2EDuration="3.979834992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:09:56.963771011 +0000 UTC m=+4.600516693" watchObservedRunningTime="2026-07-03 19:09:56.979834992 +0000 UTC m=+4.616580674" Jul 03 19:09:56.982034 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:56.981953 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" event={"ID":"e29883ca-7474-4677-823b-0a5cbc393c29","Type":"ContainerStarted","Data":"e0e99cbaa4b3465d3b21db388dd7439f50fd4cca645fa583af124f59ca12dee0"} Jul 03 19:09:57.998903 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:57.998793 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal" event={"ID":"275431b1d65f2616b5c21bf4e4bc857e","Type":"ContainerStarted","Data":"2044f5fc0b859285ca3eff27ac0e508415feffce104fb4c7723eb4d6acd2c551"} Jul 03 19:09:58.409054 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:58.408962 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crprp\" (UniqueName: \"kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp\") pod \"network-check-target-dhhtp\" (UID: \"d60e930c-bc67-4956-b696-f6a25f673c7a\") " pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:09:58.409224 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:58.409161 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:09:58.409224 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:58.409184 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:09:58.409224 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:58.409196 2580 projected.go:196] Error preparing data for projected volume kube-api-access-crprp for pod openshift-network-diagnostics/network-check-target-dhhtp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:58.409389 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:58.409252 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp podName:d60e930c-bc67-4956-b696-f6a25f673c7a nodeName:}" failed. No retries permitted until 2026-07-03 19:10:02.409234744 +0000 UTC m=+10.045980406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-crprp" (UniqueName: "kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp") pod "network-check-target-dhhtp" (UID: "d60e930c-bc67-4956-b696-f6a25f673c7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:09:58.510198 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:58.509482 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:09:58.510198 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:58.509539 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:58.510198 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:58.509669 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:58.510198 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:58.509730 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret podName:c62e02f4-4e83-4acd-aea5-6a54a58b87aa nodeName:}" failed. No retries permitted until 2026-07-03 19:10:02.509712899 +0000 UTC m=+10.146458571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret") pod "global-pull-secret-syncer-9nssv" (UID: "c62e02f4-4e83-4acd-aea5-6a54a58b87aa") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:09:58.510198 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:58.509798 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:58.510198 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:58.509831 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs podName:824d4565-f8d2-4099-adfb-e97ef0c6dcc2 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:02.509820529 +0000 UTC m=+10.146566202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs") pod "network-metrics-daemon-qppqv" (UID: "824d4565-f8d2-4099-adfb-e97ef0c6dcc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:09:58.865944 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:58.864970 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:09:58.865944 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:58.865100 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:09:58.865944 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:58.865462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:09:58.865944 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:58.865545 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:09:58.865944 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:09:58.865591 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:09:58.865944 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:09:58.865660 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:00.870654 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:00.870287 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:00.870654 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:00.870426 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:00.870654 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:00.870287 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:00.870654 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:00.870482 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:00.870654 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:00.870546 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:00.870654 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:00.870621 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:02.459960 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:02.459608 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crprp\" (UniqueName: \"kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp\") pod \"network-check-target-dhhtp\" (UID: \"d60e930c-bc67-4956-b696-f6a25f673c7a\") " pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:02.460417 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:02.459971 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:02.460417 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:02.459996 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:02.460417 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:02.460012 2580 projected.go:196] Error preparing data for projected volume kube-api-access-crprp for pod openshift-network-diagnostics/network-check-target-dhhtp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:02.460417 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:02.460083 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp podName:d60e930c-bc67-4956-b696-f6a25f673c7a nodeName:}" failed. No retries permitted until 2026-07-03 19:10:10.460064098 +0000 UTC m=+18.096809760 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-crprp" (UniqueName: "kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp") pod "network-check-target-dhhtp" (UID: "d60e930c-bc67-4956-b696-f6a25f673c7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:02.561050 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:02.561004 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:02.561253 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:02.561075 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:02.561253 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:02.561186 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:02.561253 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:02.561199 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:02.561442 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:02.561260 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret podName:c62e02f4-4e83-4acd-aea5-6a54a58b87aa nodeName:}" failed. No retries permitted until 2026-07-03 19:10:10.561241556 +0000 UTC m=+18.197987234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret") pod "global-pull-secret-syncer-9nssv" (UID: "c62e02f4-4e83-4acd-aea5-6a54a58b87aa") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:02.561442 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:02.561279 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs podName:824d4565-f8d2-4099-adfb-e97ef0c6dcc2 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:10.561269979 +0000 UTC m=+18.198015642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs") pod "network-metrics-daemon-qppqv" (UID: "824d4565-f8d2-4099-adfb-e97ef0c6dcc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:02.864324 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:02.864242 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:02.864477 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:02.864243 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:02.864477 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:02.864251 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:02.865470 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:02.865424 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:02.865885 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:02.865852 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:02.866002 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:02.865981 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:04.865795 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:04.864701 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:04.865795 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:04.864750 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:04.865795 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:04.864835 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:04.865795 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:04.864701 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:04.865795 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:04.864916 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:04.865795 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:04.864970 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:06.864965 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:06.864926 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:06.865392 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:06.864926 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:06.865392 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:06.865074 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:06.865392 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:06.865161 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:06.865392 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:06.864926 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:06.865392 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:06.865291 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:08.864429 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:08.864379 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:08.864429 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:08.864409 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:08.864987 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:08.864387 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:08.864987 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:08.864512 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:08.864987 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:08.864604 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:08.864987 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:08.864695 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:10.522518 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:10.522478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crprp\" (UniqueName: \"kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp\") pod \"network-check-target-dhhtp\" (UID: \"d60e930c-bc67-4956-b696-f6a25f673c7a\") " pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:10.522950 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:10.522673 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:10.522950 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:10.522694 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:10.522950 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:10.522707 2580 projected.go:196] Error preparing data for projected volume kube-api-access-crprp for pod openshift-network-diagnostics/network-check-target-dhhtp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:10.522950 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:10.522781 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp podName:d60e930c-bc67-4956-b696-f6a25f673c7a nodeName:}" failed. No retries permitted until 2026-07-03 19:10:26.52275631 +0000 UTC m=+34.159501976 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-crprp" (UniqueName: "kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp") pod "network-check-target-dhhtp" (UID: "d60e930c-bc67-4956-b696-f6a25f673c7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:10.623888 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:10.623838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:10.624066 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:10.623928 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:10.624066 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:10.624026 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:10.624066 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:10.624033 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:10.624198 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:10.624111 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs podName:824d4565-f8d2-4099-adfb-e97ef0c6dcc2 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:26.624087458 +0000 UTC m=+34.260833119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs") pod "network-metrics-daemon-qppqv" (UID: "824d4565-f8d2-4099-adfb-e97ef0c6dcc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:10.624198 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:10.624134 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret podName:c62e02f4-4e83-4acd-aea5-6a54a58b87aa nodeName:}" failed. No retries permitted until 2026-07-03 19:10:26.62412483 +0000 UTC m=+34.260870490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret") pod "global-pull-secret-syncer-9nssv" (UID: "c62e02f4-4e83-4acd-aea5-6a54a58b87aa") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:10.864919 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:10.864816 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:10.864919 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:10.864851 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:10.864919 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:10.864816 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:10.865169 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:10.864973 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:10.865169 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:10.865108 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:10.865252 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:10.865201 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:12.865453 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:12.865421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:12.866000 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:12.865505 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:12.866000 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:12.865525 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:12.866000 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:12.865610 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:12.866000 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:12.865668 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:12.866000 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:12.865751 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:14.864578 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:14.864265 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:14.865387 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:14.864262 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:14.865387 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:14.864680 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:14.865387 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:14.864293 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:14.865387 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:14.864732 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:14.865387 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:14.864837 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:15.033011 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.032983 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gbw2p" event={"ID":"b0ef4969-336c-4a67-a4ab-58614ca9931a","Type":"ContainerStarted","Data":"18a617194aaf1de4a0a5316c410556f77a0b2f9ce33616633153583e550090a7"} Jul 03 19:10:15.035245 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.035217 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" event={"ID":"e29883ca-7474-4677-823b-0a5cbc393c29","Type":"ContainerStarted","Data":"ba154469c6c6a9d88a9a2870e4f5e7ccc1e034776b9403792521752dc519c0d6"} Jul 03 19:10:15.035378 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.035287 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" event={"ID":"e29883ca-7474-4677-823b-0a5cbc393c29","Type":"ContainerStarted","Data":"10c8c2883268d58ad5ece9eb7e48113eb40078b838e4ade9b59b8e34f2204760"} Jul 03 19:10:15.035378 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.035322 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" event={"ID":"e29883ca-7474-4677-823b-0a5cbc393c29","Type":"ContainerStarted","Data":"b0d420892cdfe95fe84e4432935f5118749773af79f2a984183e8118b5de168d"} Jul 03 19:10:15.035378 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.035359 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" event={"ID":"e29883ca-7474-4677-823b-0a5cbc393c29","Type":"ContainerStarted","Data":"a431e56801bea635154b87d78397c88da1ab628166970713fdcfc98312247ca8"} Jul 03 19:10:15.036583 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.036559 2580 generic.go:356] "Generic (PLEG): container finished" podID="6457dab1-5787-4473-b0e1-83aee66283ad" containerID="5c59e77b58e18381102a8efa37a5dce0c0c41eaaa7a2a85b41affff9872184f5" exitCode=0 Jul 03 19:10:15.036691 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.036643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nrgtv" event={"ID":"6457dab1-5787-4473-b0e1-83aee66283ad","Type":"ContainerDied","Data":"5c59e77b58e18381102a8efa37a5dce0c0c41eaaa7a2a85b41affff9872184f5"} Jul 03 19:10:15.038188 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.038167 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zmtrs" event={"ID":"29e493de-b3a6-478c-bbce-3e91a048d7c5","Type":"ContainerStarted","Data":"3d650ab5878cba4a9b201a7d63f6f8d2ef21cc4fa59c6138f0c1de66eb974932"} Jul 03 19:10:15.039990 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.039951 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" event={"ID":"4677acb4-5880-4d3d-a5d0-6568e6e5be81","Type":"ContainerStarted","Data":"e2f4545e5548c1a31bb005383d479cc8f6fa92044d8ff3cb1eeae44379a8ab32"} Jul 03 19:10:15.041351 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.041322 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7gdj" event={"ID":"1f84c8db-09a4-4159-af48-b3eeeb85a717","Type":"ContainerStarted","Data":"86ba9759db36d01eab46f9b770ea6334f194d180ab098447cff4613bde91f624"} Jul 03 19:10:15.042862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.042838 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2lkpp" event={"ID":"1a93ef31-a568-4c2d-8dbd-4327453115de","Type":"ContainerStarted","Data":"c9bb11399b9c67297e32fc5e12e169e15e77de716d1ee4d031dfb136d6a653ba"} Jul 03 19:10:15.044244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.044222 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2w26l" event={"ID":"69d5b1af-238d-4ade-b2d8-ce7c9984194a","Type":"ContainerStarted","Data":"3a7e35d1d7307b3da4bf67fec60bd740325a842924cd0309226999cef4fcabb2"} Jul 03 19:10:15.048428 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.048383 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-31.ec2.internal" podStartSLOduration=22.048372584 podStartE2EDuration="22.048372584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:09:58.013239789 +0000 UTC m=+5.649985472" watchObservedRunningTime="2026-07-03 19:10:15.048372584 +0000 UTC m=+22.685118263" Jul 03 19:10:15.048858 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.048838 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gbw2p" podStartSLOduration=7.962271179 podStartE2EDuration="22.048834178s" totalImagesPullingTime="14.086562999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:15.048283288 +0000 UTC m=+22.685028968" watchObservedRunningTime="2026-07-03 19:10:15.048834178 +0000 UTC m=+22.685579859" Jul 03 19:10:15.110472 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.110427 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2lkpp" podStartSLOduration=3.655197933 podStartE2EDuration="22.110413533s" totalImagesPullingTime="18.4552156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:15.093837326 +0000 UTC m=+22.730583007" watchObservedRunningTime="2026-07-03 19:10:15.110413533 +0000 UTC m=+22.747159213" Jul 03 19:10:15.110633 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.110604 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2w26l" podStartSLOduration=3.647782792 podStartE2EDuration="22.110599222s" totalImagesPullingTime="18.46281643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:15.110257323 +0000 UTC m=+22.747003004" watchObservedRunningTime="2026-07-03 19:10:15.110599222 +0000 UTC m=+22.747344903" Jul 03 19:10:15.147723 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.147673 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zmtrs" podStartSLOduration=3.629650656 podStartE2EDuration="22.147657765s" totalImagesPullingTime="18.518007109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:15.147384227 +0000 UTC m=+22.784129908" watchObservedRunningTime="2026-07-03 19:10:15.147657765 +0000 UTC m=+22.784403445" Jul 03 19:10:15.148079 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:15.148043 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j7gdj" podStartSLOduration=3.698235279 podStartE2EDuration="22.148035669s" totalImagesPullingTime="18.44980039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:15.123944585 +0000 UTC m=+22.760690265" watchObservedRunningTime="2026-07-03 19:10:15.148035669 +0000 UTC m=+22.784781350" Jul 03 19:10:16.048465 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:16.048436 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fljc6" event={"ID":"4a999727-989f-455a-97a2-5d22457d4ec2","Type":"ContainerStarted","Data":"c85e962e57c8ce5730d31d2fd7452f00396a7bc9f6f7d9bc87c02d698213e35a"} Jul 03 19:10:16.051261 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:16.051237 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" event={"ID":"e29883ca-7474-4677-823b-0a5cbc393c29","Type":"ContainerStarted","Data":"7ab1b1efeaff45789b31f061c4fd5dbcd833bb48bc41660389ad626b4a8502b7"} Jul 03 19:10:16.051450 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:16.051298 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" event={"ID":"e29883ca-7474-4677-823b-0a5cbc393c29","Type":"ContainerStarted","Data":"d7ff75e04bf74ca68231ff27a0ff05311d20cd76faf10da01550d03b777f4d79"} Jul 03 19:10:16.062091 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:16.062052 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fljc6" podStartSLOduration=4.617714109 podStartE2EDuration="23.062038967s" totalImagesPullingTime="18.444324858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:16.061995915 +0000 UTC m=+23.698741596" watchObservedRunningTime="2026-07-03 19:10:16.062038967 +0000 UTC m=+23.698784647" Jul 03 19:10:16.085424 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:16.085401 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 03 19:10:16.850381 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:16.850271 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T19:10:16.085418225Z","UUID":"66ed5c6f-494a-4df3-9602-c26b94ceee52","Handler":null,"Name":"","Endpoint":""} Jul 03 19:10:16.855192 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:16.855167 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 03 19:10:16.855370 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:16.855215 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 03 19:10:16.864975 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:16.864949 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:16.865110 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:16.864958 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:16.865110 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:16.865052 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:16.865196 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:16.865136 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:16.865196 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:16.864958 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:16.865265 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:16.865216 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:17.055763 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:17.055722 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" event={"ID":"4677acb4-5880-4d3d-a5d0-6568e6e5be81","Type":"ContainerStarted","Data":"8a75132f515b2de4664b59fe8185a5c4d5a2eb66a1ec6be8bd47feb7000aae48"} Jul 03 19:10:18.061022 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:18.060797 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" event={"ID":"e29883ca-7474-4677-823b-0a5cbc393c29","Type":"ContainerStarted","Data":"67432ce33b7524f646b7b1513327e7d3553f73c5d576aefc16fae7c81e6e4d4c"} Jul 03 19:10:18.062810 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:18.062784 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" event={"ID":"4677acb4-5880-4d3d-a5d0-6568e6e5be81","Type":"ContainerStarted","Data":"584cf80140fd57c82e6652af4a1a11897ee4674d08a1ab1204a3774323706e8c"} Jul 03 19:10:18.082999 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:18.082949 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fb4hd" podStartSLOduration=3.896709853 podStartE2EDuration="25.082935144s" totalImagesPullingTime="21.186225291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:18.081932133 +0000 UTC m=+25.718677814" watchObservedRunningTime="2026-07-03 19:10:18.082935144 +0000 UTC m=+25.719680825" Jul 03 19:10:18.865120 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:18.865085 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:18.865324 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:18.865205 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:18.865324 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:18.865214 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:18.865324 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:18.865233 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:18.865504 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:18.865328 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:18.865504 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:18.865428 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:18.902565 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:18.902529 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gbw2p" Jul 03 19:10:18.903131 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:18.903116 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gbw2p" Jul 03 19:10:20.318445 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:20.318409 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gbw2p" Jul 03 19:10:20.318941 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:20.318543 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 03 19:10:20.319119 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:20.319101 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gbw2p" Jul 03 19:10:20.864485 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:20.864462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:20.864485 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:20.864473 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:20.864663 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:20.864587 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:20.864663 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:20.864631 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:20.864761 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:20.864666 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:20.864814 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:20.864762 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:21.071610 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:21.071420 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nrgtv" event={"ID":"6457dab1-5787-4473-b0e1-83aee66283ad","Type":"ContainerStarted","Data":"4c794ce140b460a0a3c9fce935b47a6204a1713c20b93aa542df4cec4d27e833"} Jul 03 19:10:21.075994 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:21.075963 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" event={"ID":"e29883ca-7474-4677-823b-0a5cbc393c29","Type":"ContainerStarted","Data":"aa2502fc490508468054c607f7cafbd25df1a28d1cd526ddf47af64ba967e1d9"} Jul 03 19:10:21.126573 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:21.126505 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" podStartSLOduration=9.601567954 podStartE2EDuration="28.126484884s" totalImagesPullingTime="18.52491693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:21.125981566 +0000 UTC m=+28.762727247" watchObservedRunningTime="2026-07-03 19:10:21.126484884 +0000 UTC m=+28.763230564" Jul 03 19:10:22.079561 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:22.079528 2580 generic.go:356] "Generic (PLEG): container finished" podID="6457dab1-5787-4473-b0e1-83aee66283ad" containerID="4c794ce140b460a0a3c9fce935b47a6204a1713c20b93aa542df4cec4d27e833" exitCode=0 Jul 03 19:10:22.080202 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:22.079611 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nrgtv" event={"ID":"6457dab1-5787-4473-b0e1-83aee66283ad","Type":"ContainerDied","Data":"4c794ce140b460a0a3c9fce935b47a6204a1713c20b93aa542df4cec4d27e833"} Jul 03 19:10:22.080202 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:22.080038 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:10:22.080202 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:22.080098 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:10:22.080202 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:22.080143 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:10:22.096910 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:22.096868 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:10:22.097061 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:22.097018 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:10:22.864944 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:22.864900 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:22.864944 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:22.864913 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:22.871783 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:22.871752 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:22.871945 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:22.871756 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:22.871945 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:22.871902 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:22.872062 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:22.871968 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:23.253523 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:23.253336 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9nssv"] Jul 03 19:10:23.253933 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:23.253598 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:23.253933 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:23.253677 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:23.256019 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:23.255995 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dhhtp"] Jul 03 19:10:23.256129 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:23.256065 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:23.256201 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:23.256143 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:23.268543 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:23.268517 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qppqv"] Jul 03 19:10:23.268672 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:23.268616 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:23.268722 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:23.268704 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:24.085902 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:24.085802 2580 generic.go:356] "Generic (PLEG): container finished" podID="6457dab1-5787-4473-b0e1-83aee66283ad" containerID="438fb9c9fc2ab9a3bbfc6230b66e3b01bb66b187a008e1d54ea1929d6e520a25" exitCode=0 Jul 03 19:10:24.086069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:24.085914 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nrgtv" event={"ID":"6457dab1-5787-4473-b0e1-83aee66283ad","Type":"ContainerDied","Data":"438fb9c9fc2ab9a3bbfc6230b66e3b01bb66b187a008e1d54ea1929d6e520a25"} Jul 03 19:10:24.864807 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:24.864770 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:24.865509 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:24.864822 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:24.865509 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:24.864772 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:24.865509 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:24.864934 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:24.865509 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:24.865067 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:24.865509 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:24.865180 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:25.090620 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:25.090530 2580 generic.go:356] "Generic (PLEG): container finished" podID="6457dab1-5787-4473-b0e1-83aee66283ad" containerID="5da874405104db45beb9352916762903be8049d35b9bd5ae1fd907e90c18d7c5" exitCode=0 Jul 03 19:10:25.090620 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:25.090586 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nrgtv" event={"ID":"6457dab1-5787-4473-b0e1-83aee66283ad","Type":"ContainerDied","Data":"5da874405104db45beb9352916762903be8049d35b9bd5ae1fd907e90c18d7c5"} Jul 03 19:10:26.538746 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:26.538706 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crprp\" (UniqueName: \"kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp\") pod \"network-check-target-dhhtp\" (UID: \"d60e930c-bc67-4956-b696-f6a25f673c7a\") " pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:26.539308 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:26.538870 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:26.539308 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:26.538906 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:26.539308 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:26.538919 2580 projected.go:196] Error preparing data for projected volume kube-api-access-crprp for pod openshift-network-diagnostics/network-check-target-dhhtp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:26.539308 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:26.538971 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp podName:d60e930c-bc67-4956-b696-f6a25f673c7a nodeName:}" failed. No retries permitted until 2026-07-03 19:10:58.538957165 +0000 UTC m=+66.175702824 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-crprp" (UniqueName: "kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp") pod "network-check-target-dhhtp" (UID: "d60e930c-bc67-4956-b696-f6a25f673c7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:26.640006 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:26.639945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:26.640006 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:26.640013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:26.640218 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:26.640109 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:26.640218 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:26.640121 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:26.640218 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:26.640164 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret podName:c62e02f4-4e83-4acd-aea5-6a54a58b87aa nodeName:}" failed. No retries permitted until 2026-07-03 19:10:58.640150727 +0000 UTC m=+66.276896386 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret") pod "global-pull-secret-syncer-9nssv" (UID: "c62e02f4-4e83-4acd-aea5-6a54a58b87aa") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:26.640218 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:26.640177 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs podName:824d4565-f8d2-4099-adfb-e97ef0c6dcc2 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:58.640171792 +0000 UTC m=+66.276917450 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs") pod "network-metrics-daemon-qppqv" (UID: "824d4565-f8d2-4099-adfb-e97ef0c6dcc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:26.864722 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:26.864637 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:26.864854 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:26.864641 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:26.864854 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:26.864748 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhhtp" podUID="d60e930c-bc67-4956-b696-f6a25f673c7a" Jul 03 19:10:26.864854 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:26.864641 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:26.864854 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:26.864821 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9nssv" podUID="c62e02f4-4e83-4acd-aea5-6a54a58b87aa" Jul 03 19:10:26.865030 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:26.864915 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qppqv" podUID="824d4565-f8d2-4099-adfb-e97ef0c6dcc2" Jul 03 19:10:28.157271 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.157180 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-31.ec2.internal" event="NodeReady" Jul 03 19:10:28.157712 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.157366 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 03 19:10:28.210253 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.210031 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bccc7b79d-cjs5b"] Jul 03 19:10:28.212590 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.212563 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.216335 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.216296 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 03 19:10:28.216536 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.216513 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 03 19:10:28.216896 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.216857 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 03 19:10:28.218316 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.218057 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4z568\"" Jul 03 19:10:28.229760 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.229734 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bqptn"] Jul 03 19:10:28.230128 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.230108 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 03 19:10:28.232811 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.232788 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bqptn" Jul 03 19:10:28.235307 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.235289 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lrnd6"] Jul 03 19:10:28.238665 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.238647 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:28.239207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.239092 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 03 19:10:28.239315 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.239226 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 03 19:10:28.239373 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.239340 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 03 19:10:28.239373 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.239357 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ghd46\"" Jul 03 19:10:28.240254 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.240205 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bccc7b79d-cjs5b"] Jul 03 19:10:28.247191 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.246984 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8lvgc\"" Jul 03 19:10:28.247191 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.246984 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 03 19:10:28.247191 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.246985 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 03 19:10:28.258025 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.258002 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bqptn"] Jul 03 19:10:28.262051 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.262016 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lrnd6"] Jul 03 19:10:28.354101 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354064 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtg9d\" (UniqueName: \"kubernetes.io/projected/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-kube-api-access-wtg9d\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:28.354363 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-config-volume\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:28.354363 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354228 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-certificates\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.354363 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354271 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-installation-pull-secrets\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.354363 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3c305ed-06b4-430f-8f40-ff3d84434342-cert\") pod \"ingress-canary-bqptn\" (UID: \"e3c305ed-06b4-430f-8f40-ff3d84434342\") " pod="openshift-ingress-canary/ingress-canary-bqptn" Jul 03 19:10:28.354579 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-bound-sa-token\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.354579 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354415 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrvcv\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-kube-api-access-qrvcv\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.354579 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354451 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-trusted-ca\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.354579 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvsjx\" (UniqueName: \"kubernetes.io/projected/e3c305ed-06b4-430f-8f40-ff3d84434342-kube-api-access-hvsjx\") pod \"ingress-canary-bqptn\" (UID: \"e3c305ed-06b4-430f-8f40-ff3d84434342\") " pod="openshift-ingress-canary/ingress-canary-bqptn" Jul 03 19:10:28.354579 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:28.354579 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-tmp-dir\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:28.354579 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354564 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-image-registry-private-configuration\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.355033 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354589 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-ca-trust-extracted\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.355033 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.354616 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.455940 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.455830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-trusted-ca\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.455940 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.455890 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvsjx\" (UniqueName: \"kubernetes.io/projected/e3c305ed-06b4-430f-8f40-ff3d84434342-kube-api-access-hvsjx\") pod \"ingress-canary-bqptn\" (UID: \"e3c305ed-06b4-430f-8f40-ff3d84434342\") " pod="openshift-ingress-canary/ingress-canary-bqptn" Jul 03 19:10:28.455940 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.455912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:28.455940 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.455927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-tmp-dir\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:28.456249 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.455952 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-image-registry-private-configuration\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.456249 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.455975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-ca-trust-extracted\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.456249 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.455999 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.456249 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.456021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtg9d\" (UniqueName: \"kubernetes.io/projected/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-kube-api-access-wtg9d\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:28.456249 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.456063 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-config-volume\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:28.456249 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.456118 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-certificates\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.456249 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.456148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-installation-pull-secrets\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.456249 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.456187 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3c305ed-06b4-430f-8f40-ff3d84434342-cert\") pod \"ingress-canary-bqptn\" (UID: \"e3c305ed-06b4-430f-8f40-ff3d84434342\") " pod="openshift-ingress-canary/ingress-canary-bqptn" Jul 03 19:10:28.456249 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.456213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-bound-sa-token\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.456249 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:28.456116 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:28.456249 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.456240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrvcv\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-kube-api-access-qrvcv\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.456833 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:28.456291 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls podName:6a5b0d08-0add-40ba-b8d2-44761b1e54d7 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:28.956268754 +0000 UTC m=+36.593014428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls") pod "dns-default-lrnd6" (UID: "6a5b0d08-0add-40ba-b8d2-44761b1e54d7") : secret "dns-default-metrics-tls" not found Jul 03 19:10:28.456833 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.456325 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-tmp-dir\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:28.456833 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:28.456223 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 19:10:28.456833 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:28.456367 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bccc7b79d-cjs5b: secret "image-registry-tls" not found Jul 03 19:10:28.456833 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:28.456409 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls podName:c77f11c0-482b-46d6-9b01-5ba84b1fdd8c nodeName:}" failed. No retries permitted until 2026-07-03 19:10:28.956395248 +0000 UTC m=+36.593140916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls") pod "image-registry-7bccc7b79d-cjs5b" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c") : secret "image-registry-tls" not found Jul 03 19:10:28.456833 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.456582 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-ca-trust-extracted\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.456833 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.456769 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-config-volume\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:28.457205 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.456927 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-certificates\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.457205 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.457039 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-trusted-ca\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.461138 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.461115 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-image-registry-private-configuration\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.461299 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.461114 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-installation-pull-secrets\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.461299 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.461188 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3c305ed-06b4-430f-8f40-ff3d84434342-cert\") pod \"ingress-canary-bqptn\" (UID: \"e3c305ed-06b4-430f-8f40-ff3d84434342\") " pod="openshift-ingress-canary/ingress-canary-bqptn" Jul 03 19:10:28.467157 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.467069 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtg9d\" (UniqueName: \"kubernetes.io/projected/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-kube-api-access-wtg9d\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:28.467305 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.467208 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-bound-sa-token\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.467369 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.467316 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvsjx\" (UniqueName: \"kubernetes.io/projected/e3c305ed-06b4-430f-8f40-ff3d84434342-kube-api-access-hvsjx\") pod \"ingress-canary-bqptn\" (UID: \"e3c305ed-06b4-430f-8f40-ff3d84434342\") " pod="openshift-ingress-canary/ingress-canary-bqptn" Jul 03 19:10:28.467678 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.467662 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrvcv\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-kube-api-access-qrvcv\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.544308 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.544269 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bqptn" Jul 03 19:10:28.864937 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.864836 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:28.865108 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.864836 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:28.865108 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.864836 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:28.867404 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.867358 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wwb25\"" Jul 03 19:10:28.867404 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.867381 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 19:10:28.867404 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.867405 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g8gc2\"" Jul 03 19:10:28.867628 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.867358 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 19:10:28.867628 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.867528 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 19:10:28.867740 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.867724 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 19:10:28.961149 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.961114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:28.961149 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:28.961156 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:28.961369 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:28.961293 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:28.961369 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:28.961307 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 19:10:28.961369 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:28.961323 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bccc7b79d-cjs5b: secret "image-registry-tls" not found Jul 03 19:10:28.961489 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:28.961389 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls podName:6a5b0d08-0add-40ba-b8d2-44761b1e54d7 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:29.961366095 +0000 UTC m=+37.598111756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls") pod "dns-default-lrnd6" (UID: "6a5b0d08-0add-40ba-b8d2-44761b1e54d7") : secret "dns-default-metrics-tls" not found Jul 03 19:10:28.961489 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:28.961416 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls podName:c77f11c0-482b-46d6-9b01-5ba84b1fdd8c nodeName:}" failed. No retries permitted until 2026-07-03 19:10:29.961404525 +0000 UTC m=+37.598150202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls") pod "image-registry-7bccc7b79d-cjs5b" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c") : secret "image-registry-tls" not found Jul 03 19:10:29.970943 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:29.970622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:29.970943 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:29.970796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:29.971527 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:29.971423 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 19:10:29.971527 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:29.971446 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bccc7b79d-cjs5b: secret "image-registry-tls" not found Jul 03 19:10:29.971527 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:29.971518 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls podName:c77f11c0-482b-46d6-9b01-5ba84b1fdd8c nodeName:}" failed. No retries permitted until 2026-07-03 19:10:31.97149526 +0000 UTC m=+39.608240941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls") pod "image-registry-7bccc7b79d-cjs5b" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c") : secret "image-registry-tls" not found Jul 03 19:10:29.971950 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:29.971823 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:29.971950 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:29.971904 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls podName:6a5b0d08-0add-40ba-b8d2-44761b1e54d7 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:31.971885911 +0000 UTC m=+39.608631585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls") pod "dns-default-lrnd6" (UID: "6a5b0d08-0add-40ba-b8d2-44761b1e54d7") : secret "dns-default-metrics-tls" not found Jul 03 19:10:30.033499 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:30.033459 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bqptn"] Jul 03 19:10:30.053462 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:10:30.053432 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c305ed_06b4_430f_8f40_ff3d84434342.slice/crio-6a4226903e0ad248b734702b2967947d08af4e39f4c20f9792b7a0fe65ee712f WatchSource:0}: Error finding container 6a4226903e0ad248b734702b2967947d08af4e39f4c20f9792b7a0fe65ee712f: Status 404 returned error can't find the container with id 6a4226903e0ad248b734702b2967947d08af4e39f4c20f9792b7a0fe65ee712f Jul 03 19:10:30.105732 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:30.105703 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bqptn" event={"ID":"e3c305ed-06b4-430f-8f40-ff3d84434342","Type":"ContainerStarted","Data":"6a4226903e0ad248b734702b2967947d08af4e39f4c20f9792b7a0fe65ee712f"} Jul 03 19:10:30.456129 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:30.456046 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbw2p_b0ef4969-336c-4a67-a4ab-58614ca9931a/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:31.111663 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:31.111619 2580 generic.go:356] "Generic (PLEG): container finished" podID="6457dab1-5787-4473-b0e1-83aee66283ad" containerID="2dc2a748ec57b889c372020a01a602430e1e2ece9246e72300086f103f7bb6fc" exitCode=0 Jul 03 19:10:31.112144 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:31.111660 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nrgtv" event={"ID":"6457dab1-5787-4473-b0e1-83aee66283ad","Type":"ContainerDied","Data":"2dc2a748ec57b889c372020a01a602430e1e2ece9246e72300086f103f7bb6fc"} Jul 03 19:10:31.654583 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:31.654553 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbw2p_b0ef4969-336c-4a67-a4ab-58614ca9931a/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:31.986740 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:31.986658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:31.986740 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:31.986703 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:31.986986 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:31.986866 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:31.986986 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:31.986967 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls podName:6a5b0d08-0add-40ba-b8d2-44761b1e54d7 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:35.986944833 +0000 UTC m=+43.623690503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls") pod "dns-default-lrnd6" (UID: "6a5b0d08-0add-40ba-b8d2-44761b1e54d7") : secret "dns-default-metrics-tls" not found Jul 03 19:10:31.986986 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:31.986868 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 19:10:31.987128 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:31.986996 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bccc7b79d-cjs5b: secret "image-registry-tls" not found Jul 03 19:10:31.987128 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:31.987041 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls podName:c77f11c0-482b-46d6-9b01-5ba84b1fdd8c nodeName:}" failed. No retries permitted until 2026-07-03 19:10:35.98702899 +0000 UTC m=+43.623774653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls") pod "image-registry-7bccc7b79d-cjs5b" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c") : secret "image-registry-tls" not found Jul 03 19:10:32.118455 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:32.118418 2580 generic.go:356] "Generic (PLEG): container finished" podID="6457dab1-5787-4473-b0e1-83aee66283ad" containerID="d70f74e31acba1ed7006466f808eba3e782c46334df8b893d1012d6c6e02341e" exitCode=0 Jul 03 19:10:32.118922 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:32.118519 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nrgtv" event={"ID":"6457dab1-5787-4473-b0e1-83aee66283ad","Type":"ContainerDied","Data":"d70f74e31acba1ed7006466f808eba3e782c46334df8b893d1012d6c6e02341e"} Jul 03 19:10:32.353595 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:32.353551 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbw2p_b0ef4969-336c-4a67-a4ab-58614ca9931a/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:32.408713 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:32.408681 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbw2p_b0ef4969-336c-4a67-a4ab-58614ca9931a/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:32.802189 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:32.802000 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbw2p_b0ef4969-336c-4a67-a4ab-58614ca9931a/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:32.901002 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:32.900934 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbw2p_b0ef4969-336c-4a67-a4ab-58614ca9931a/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:33.124227 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:33.124188 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nrgtv" event={"ID":"6457dab1-5787-4473-b0e1-83aee66283ad","Type":"ContainerStarted","Data":"987dd851fc179679163558333ae50fde49569feb3978f59792942cea889cb735"} Jul 03 19:10:33.125571 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:33.125546 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bqptn" event={"ID":"e3c305ed-06b4-430f-8f40-ff3d84434342","Type":"ContainerStarted","Data":"8162a26f0747c54fcd887312935ecb20dc60755c157585fc2dfb106e57919e67"} Jul 03 19:10:33.145195 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:33.145149 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nrgtv" podStartSLOduration=10.075540381 podStartE2EDuration="41.145134495s" totalImagesPullingTime="31.069594114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:33.144024641 +0000 UTC m=+40.780770332" watchObservedRunningTime="2026-07-03 19:10:33.145134495 +0000 UTC m=+40.781880154" Jul 03 19:10:33.159151 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:33.159056 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bqptn" podStartSLOduration=2.422071705 podStartE2EDuration="5.159037548s" totalImagesPullingTime="2.736965843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:33.158831523 +0000 UTC m=+40.795577204" watchObservedRunningTime="2026-07-03 19:10:33.159037548 +0000 UTC m=+40.795783228" Jul 03 19:10:33.232018 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:33.231981 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbw2p_b0ef4969-336c-4a67-a4ab-58614ca9931a/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:33.283203 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:33.283170 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbw2p_b0ef4969-336c-4a67-a4ab-58614ca9931a/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:33.337704 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:33.337673 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbw2p_b0ef4969-336c-4a67-a4ab-58614ca9931a/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:33.440565 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:33.440484 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbw2p_b0ef4969-336c-4a67-a4ab-58614ca9931a/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:33.541559 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:33.541524 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbw2p_b0ef4969-336c-4a67-a4ab-58614ca9931a/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:36.016576 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:36.016532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:36.016576 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:36.016579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:36.017027 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:36.016692 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:36.017027 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:36.016717 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 19:10:36.017027 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:36.016729 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bccc7b79d-cjs5b: secret "image-registry-tls" not found Jul 03 19:10:36.017027 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:36.016764 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls podName:6a5b0d08-0add-40ba-b8d2-44761b1e54d7 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:44.016745272 +0000 UTC m=+51.653490934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls") pod "dns-default-lrnd6" (UID: "6a5b0d08-0add-40ba-b8d2-44761b1e54d7") : secret "dns-default-metrics-tls" not found Jul 03 19:10:36.017027 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:36.016779 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls podName:c77f11c0-482b-46d6-9b01-5ba84b1fdd8c nodeName:}" failed. No retries permitted until 2026-07-03 19:10:44.016772816 +0000 UTC m=+51.653518475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls") pod "image-registry-7bccc7b79d-cjs5b" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c") : secret "image-registry-tls" not found Jul 03 19:10:44.073036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:44.072994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:10:44.073036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:44.073036 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:10:44.073543 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:44.073145 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 19:10:44.073543 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:44.073156 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bccc7b79d-cjs5b: secret "image-registry-tls" not found Jul 03 19:10:44.073543 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:44.073159 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:44.073543 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:44.073203 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls podName:c77f11c0-482b-46d6-9b01-5ba84b1fdd8c nodeName:}" failed. No retries permitted until 2026-07-03 19:11:00.073190366 +0000 UTC m=+67.709936026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls") pod "image-registry-7bccc7b79d-cjs5b" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c") : secret "image-registry-tls" not found Jul 03 19:10:44.073543 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:44.073216 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls podName:6a5b0d08-0add-40ba-b8d2-44761b1e54d7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:00.073210334 +0000 UTC m=+67.709955993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls") pod "dns-default-lrnd6" (UID: "6a5b0d08-0add-40ba-b8d2-44761b1e54d7") : secret "dns-default-metrics-tls" not found Jul 03 19:10:54.106715 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:54.106687 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bc7lt" Jul 03 19:10:58.570065 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:58.570031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crprp\" (UniqueName: \"kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp\") pod \"network-check-target-dhhtp\" (UID: \"d60e930c-bc67-4956-b696-f6a25f673c7a\") " pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:58.572833 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:58.572815 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 19:10:58.583302 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:58.583283 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 19:10:58.595195 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:58.595173 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crprp\" (UniqueName: \"kubernetes.io/projected/d60e930c-bc67-4956-b696-f6a25f673c7a-kube-api-access-crprp\") pod \"network-check-target-dhhtp\" (UID: \"d60e930c-bc67-4956-b696-f6a25f673c7a\") " pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:58.671270 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:58.671233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:10:58.671445 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:58.671281 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:58.673741 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:58.673721 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 19:10:58.673864 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:58.673849 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 19:10:58.682159 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:58.682135 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 03 19:10:58.682285 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:10:58.682209 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs podName:824d4565-f8d2-4099-adfb-e97ef0c6dcc2 nodeName:}" failed. No retries permitted until 2026-07-03 19:12:02.682192556 +0000 UTC m=+130.318938216 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs") pod "network-metrics-daemon-qppqv" (UID: "824d4565-f8d2-4099-adfb-e97ef0c6dcc2") : secret "metrics-daemon-secret" not found Jul 03 19:10:58.684330 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:58.684303 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c62e02f4-4e83-4acd-aea5-6a54a58b87aa-original-pull-secret\") pod \"global-pull-secret-syncer-9nssv\" (UID: \"c62e02f4-4e83-4acd-aea5-6a54a58b87aa\") " pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:58.880795 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:58.880767 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g8gc2\"" Jul 03 19:10:58.885675 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:58.885654 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9nssv" Jul 03 19:10:58.888117 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:58.888099 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:10:59.024968 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:59.024931 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9nssv"] Jul 03 19:10:59.027987 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:10:59.027858 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62e02f4_4e83_4acd_aea5_6a54a58b87aa.slice/crio-12fe5641c3fd832aded7d1530f0fa1e368bede625f263a0157b0b5f9c42ccd81 WatchSource:0}: Error finding container 12fe5641c3fd832aded7d1530f0fa1e368bede625f263a0157b0b5f9c42ccd81: Status 404 returned error can't find the container with id 12fe5641c3fd832aded7d1530f0fa1e368bede625f263a0157b0b5f9c42ccd81 Jul 03 19:10:59.040323 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:59.040301 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dhhtp"] Jul 03 19:10:59.043364 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:10:59.043342 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60e930c_bc67_4956_b696_f6a25f673c7a.slice/crio-cc63bed04a997b313015460b39b73f1cf394deb75732412ff7d27a59e27baf1e WatchSource:0}: Error finding container cc63bed04a997b313015460b39b73f1cf394deb75732412ff7d27a59e27baf1e: Status 404 returned error can't find the container with id cc63bed04a997b313015460b39b73f1cf394deb75732412ff7d27a59e27baf1e Jul 03 19:10:59.186075 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:59.185982 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dhhtp" event={"ID":"d60e930c-bc67-4956-b696-f6a25f673c7a","Type":"ContainerStarted","Data":"cc63bed04a997b313015460b39b73f1cf394deb75732412ff7d27a59e27baf1e"} Jul 03 19:10:59.187093 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:10:59.187066 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9nssv" event={"ID":"c62e02f4-4e83-4acd-aea5-6a54a58b87aa","Type":"ContainerStarted","Data":"12fe5641c3fd832aded7d1530f0fa1e368bede625f263a0157b0b5f9c42ccd81"} Jul 03 19:11:00.083265 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:00.083230 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:11:00.083719 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:00.083326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:11:00.083719 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:00.083408 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 19:11:00.083719 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:00.083426 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:11:00.083719 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:00.083434 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bccc7b79d-cjs5b: secret "image-registry-tls" not found Jul 03 19:11:00.083719 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:00.083487 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls podName:6a5b0d08-0add-40ba-b8d2-44761b1e54d7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:32.08347376 +0000 UTC m=+99.720219418 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls") pod "dns-default-lrnd6" (UID: "6a5b0d08-0add-40ba-b8d2-44761b1e54d7") : secret "dns-default-metrics-tls" not found Jul 03 19:11:00.083719 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:00.083502 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls podName:c77f11c0-482b-46d6-9b01-5ba84b1fdd8c nodeName:}" failed. No retries permitted until 2026-07-03 19:11:32.08349552 +0000 UTC m=+99.720241179 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls") pod "image-registry-7bccc7b79d-cjs5b" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c") : secret "image-registry-tls" not found Jul 03 19:11:04.203191 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:04.203088 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dhhtp" event={"ID":"d60e930c-bc67-4956-b696-f6a25f673c7a","Type":"ContainerStarted","Data":"241f414d1b42f28fa845e81cea8967e9b240e8f8de86a063d94991d5aef6951e"} Jul 03 19:11:04.203191 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:04.203176 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:11:04.204539 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:04.204511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9nssv" event={"ID":"c62e02f4-4e83-4acd-aea5-6a54a58b87aa","Type":"ContainerStarted","Data":"41eb2643702f58847975439ccf326eb3300ed2d4e56a626e5f934e8d5b0111b0"} Jul 03 19:11:04.217026 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:04.216983 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dhhtp" podStartSLOduration=67.38321095 podStartE2EDuration="1m12.216969519s" totalImagesPullingTime="4.833758569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:04.216661018 +0000 UTC m=+71.853406698" watchObservedRunningTime="2026-07-03 19:11:04.216969519 +0000 UTC m=+71.853715199" Jul 03 19:11:04.244047 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:04.243994 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9nssv" podStartSLOduration=66.39119506 podStartE2EDuration="1m11.243975686s" totalImagesPullingTime="4.852780626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:04.243578544 +0000 UTC m=+71.880324224" watchObservedRunningTime="2026-07-03 19:11:04.243975686 +0000 UTC m=+71.880721389" Jul 03 19:11:05.844366 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:05.844328 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-xsn6x"] Jul 03 19:11:05.846371 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:05.846355 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xsn6x" Jul 03 19:11:05.848884 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:05.848852 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-n49hr\"" Jul 03 19:11:05.857249 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:05.857226 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-xsn6x"] Jul 03 19:11:05.930041 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:05.930001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psddb\" (UniqueName: \"kubernetes.io/projected/43cb58fc-109a-4d56-9612-03f0bb8a0a50-kube-api-access-psddb\") pod \"network-check-source-989f8b8dc-xsn6x\" (UID: \"43cb58fc-109a-4d56-9612-03f0bb8a0a50\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xsn6x" Jul 03 19:11:06.031018 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:06.030980 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psddb\" (UniqueName: \"kubernetes.io/projected/43cb58fc-109a-4d56-9612-03f0bb8a0a50-kube-api-access-psddb\") pod \"network-check-source-989f8b8dc-xsn6x\" (UID: \"43cb58fc-109a-4d56-9612-03f0bb8a0a50\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xsn6x" Jul 03 19:11:06.040614 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:06.040591 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psddb\" (UniqueName: \"kubernetes.io/projected/43cb58fc-109a-4d56-9612-03f0bb8a0a50-kube-api-access-psddb\") pod \"network-check-source-989f8b8dc-xsn6x\" (UID: \"43cb58fc-109a-4d56-9612-03f0bb8a0a50\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xsn6x" Jul 03 19:11:06.154677 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:06.154591 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xsn6x" Jul 03 19:11:06.274114 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:06.274080 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-xsn6x"] Jul 03 19:11:06.279527 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:11:06.279500 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43cb58fc_109a_4d56_9612_03f0bb8a0a50.slice/crio-3732c9563f1651e3ac052a817f4b215414e7c610fe8111cf89dcc362be903737 WatchSource:0}: Error finding container 3732c9563f1651e3ac052a817f4b215414e7c610fe8111cf89dcc362be903737: Status 404 returned error can't find the container with id 3732c9563f1651e3ac052a817f4b215414e7c610fe8111cf89dcc362be903737 Jul 03 19:11:07.213483 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:07.213443 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xsn6x" event={"ID":"43cb58fc-109a-4d56-9612-03f0bb8a0a50","Type":"ContainerStarted","Data":"2657ce2adb910a582bc2e44ea4834b5c4e3f4b09d9500f677bc0d68f0074a461"} Jul 03 19:11:07.213867 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:07.213500 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xsn6x" event={"ID":"43cb58fc-109a-4d56-9612-03f0bb8a0a50","Type":"ContainerStarted","Data":"3732c9563f1651e3ac052a817f4b215414e7c610fe8111cf89dcc362be903737"} Jul 03 19:11:07.228062 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:07.228016 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xsn6x" podStartSLOduration=2.227999781 podStartE2EDuration="2.227999781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:07.227477248 +0000 UTC m=+74.864222930" watchObservedRunningTime="2026-07-03 19:11:07.227999781 +0000 UTC m=+74.864745462" Jul 03 19:11:10.053016 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.052976 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jpsg6"] Jul 03 19:11:10.055576 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.055553 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.058159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.058103 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 03 19:11:10.058159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.058122 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 03 19:11:10.058417 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.058388 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 03 19:11:10.059132 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.059118 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 03 19:11:10.059192 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.059131 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lkngf\"" Jul 03 19:11:10.070078 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.070054 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpsg6"] Jul 03 19:11:10.158937 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.158900 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqm6m\" (UniqueName: \"kubernetes.io/projected/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-api-access-vqm6m\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.159116 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.158966 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-data-volume\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.159116 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.158992 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.159116 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.159018 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-crio-socket\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.159116 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.159043 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.260099 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.260055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqm6m\" (UniqueName: \"kubernetes.io/projected/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-api-access-vqm6m\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.260272 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.260129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-data-volume\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.260272 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.260158 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.260272 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.260193 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-crio-socket\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.260272 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.260221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.260430 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.260279 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-crio-socket\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.260430 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:10.260292 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:10.260430 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:10.260321 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:10.260430 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:10.260371 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls podName:9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:10.760355495 +0000 UTC m=+78.397101154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpsg6" (UID: "9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:10.260430 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:10.260386 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm podName:9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:10.760379951 +0000 UTC m=+78.397125609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpsg6" (UID: "9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7") : configmap "kube-rbac-proxy" not found Jul 03 19:11:10.260596 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.260560 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-data-volume\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.269355 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.269328 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqm6m\" (UniqueName: \"kubernetes.io/projected/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-api-access-vqm6m\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.586576 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.586538 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-nl62p"] Jul 03 19:11:10.588641 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.588620 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nl62p" Jul 03 19:11:10.590951 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.590931 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 03 19:11:10.591077 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.590952 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 03 19:11:10.591077 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.590978 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zmv2w\"" Jul 03 19:11:10.596400 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.596376 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-nl62p"] Jul 03 19:11:10.664679 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.664633 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xt9w\" (UniqueName: \"kubernetes.io/projected/50ec8c0d-c135-4e73-b881-f3d366a75eef-kube-api-access-2xt9w\") pod \"migrator-d57d58cc9-nl62p\" (UID: \"50ec8c0d-c135-4e73-b881-f3d366a75eef\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nl62p" Jul 03 19:11:10.765891 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.765832 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.765891 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.765897 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:10.766089 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.765920 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xt9w\" (UniqueName: \"kubernetes.io/projected/50ec8c0d-c135-4e73-b881-f3d366a75eef-kube-api-access-2xt9w\") pod \"migrator-d57d58cc9-nl62p\" (UID: \"50ec8c0d-c135-4e73-b881-f3d366a75eef\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nl62p" Jul 03 19:11:10.766089 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:10.765997 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:10.766089 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:10.766027 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:10.766089 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:10.766078 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls podName:9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:11.766059664 +0000 UTC m=+79.402805325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpsg6" (UID: "9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:10.766222 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:10.766095 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm podName:9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:11.766087999 +0000 UTC m=+79.402833658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpsg6" (UID: "9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7") : configmap "kube-rbac-proxy" not found Jul 03 19:11:10.774215 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.774193 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xt9w\" (UniqueName: \"kubernetes.io/projected/50ec8c0d-c135-4e73-b881-f3d366a75eef-kube-api-access-2xt9w\") pod \"migrator-d57d58cc9-nl62p\" (UID: \"50ec8c0d-c135-4e73-b881-f3d366a75eef\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nl62p" Jul 03 19:11:10.898358 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:10.898255 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nl62p" Jul 03 19:11:11.017409 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:11.017373 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-nl62p"] Jul 03 19:11:11.020182 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:11:11.020154 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ec8c0d_c135_4e73_b881_f3d366a75eef.slice/crio-33e82eddcb057256803287d9732d82ffc96c4a84b9c59c0df031c3678499b5ec WatchSource:0}: Error finding container 33e82eddcb057256803287d9732d82ffc96c4a84b9c59c0df031c3678499b5ec: Status 404 returned error can't find the container with id 33e82eddcb057256803287d9732d82ffc96c4a84b9c59c0df031c3678499b5ec Jul 03 19:11:11.225643 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:11.225564 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nl62p" event={"ID":"50ec8c0d-c135-4e73-b881-f3d366a75eef","Type":"ContainerStarted","Data":"33e82eddcb057256803287d9732d82ffc96c4a84b9c59c0df031c3678499b5ec"} Jul 03 19:11:11.772910 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:11.772852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:11.773104 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:11.773018 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:11.773104 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:11.773029 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:11.773104 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:11.773095 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls podName:9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:13.773079097 +0000 UTC m=+81.409824779 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpsg6" (UID: "9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:11.773256 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:11.773129 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:11.773256 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:11.773183 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm podName:9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:13.773167897 +0000 UTC m=+81.409913557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpsg6" (UID: "9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7") : configmap "kube-rbac-proxy" not found Jul 03 19:11:12.041342 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.041262 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7gdj_1f84c8db-09a4-4159-af48-b3eeeb85a717/dns-node-resolver/0.log" Jul 03 19:11:12.652233 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.652202 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dphbz"] Jul 03 19:11:12.654127 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.654105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-dphbz" Jul 03 19:11:12.656240 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.656216 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 03 19:11:12.656240 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.656233 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 03 19:11:12.656405 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.656294 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 03 19:11:12.657242 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.657227 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gwzbw\"" Jul 03 19:11:12.657321 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.657278 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 03 19:11:12.662655 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.662630 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dphbz"] Jul 03 19:11:12.779616 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.779578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/94d6f844-ab01-484e-b2ba-ae1c632275f4-signing-key\") pod \"service-ca-758f599c5-dphbz\" (UID: \"94d6f844-ab01-484e-b2ba-ae1c632275f4\") " pod="openshift-service-ca/service-ca-758f599c5-dphbz" Jul 03 19:11:12.779802 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.779636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp24s\" (UniqueName: \"kubernetes.io/projected/94d6f844-ab01-484e-b2ba-ae1c632275f4-kube-api-access-lp24s\") pod \"service-ca-758f599c5-dphbz\" (UID: \"94d6f844-ab01-484e-b2ba-ae1c632275f4\") " pod="openshift-service-ca/service-ca-758f599c5-dphbz" Jul 03 19:11:12.779802 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.779663 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/94d6f844-ab01-484e-b2ba-ae1c632275f4-signing-cabundle\") pod \"service-ca-758f599c5-dphbz\" (UID: \"94d6f844-ab01-484e-b2ba-ae1c632275f4\") " pod="openshift-service-ca/service-ca-758f599c5-dphbz" Jul 03 19:11:12.841961 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.841930 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2lkpp_1a93ef31-a568-4c2d-8dbd-4327453115de/node-ca/0.log" Jul 03 19:11:12.880808 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.880776 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp24s\" (UniqueName: \"kubernetes.io/projected/94d6f844-ab01-484e-b2ba-ae1c632275f4-kube-api-access-lp24s\") pod \"service-ca-758f599c5-dphbz\" (UID: \"94d6f844-ab01-484e-b2ba-ae1c632275f4\") " pod="openshift-service-ca/service-ca-758f599c5-dphbz" Jul 03 19:11:12.880999 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.880815 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/94d6f844-ab01-484e-b2ba-ae1c632275f4-signing-cabundle\") pod \"service-ca-758f599c5-dphbz\" (UID: \"94d6f844-ab01-484e-b2ba-ae1c632275f4\") " pod="openshift-service-ca/service-ca-758f599c5-dphbz" Jul 03 19:11:12.880999 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.880934 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/94d6f844-ab01-484e-b2ba-ae1c632275f4-signing-key\") pod \"service-ca-758f599c5-dphbz\" (UID: \"94d6f844-ab01-484e-b2ba-ae1c632275f4\") " pod="openshift-service-ca/service-ca-758f599c5-dphbz" Jul 03 19:11:12.881475 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.881454 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/94d6f844-ab01-484e-b2ba-ae1c632275f4-signing-cabundle\") pod \"service-ca-758f599c5-dphbz\" (UID: \"94d6f844-ab01-484e-b2ba-ae1c632275f4\") " pod="openshift-service-ca/service-ca-758f599c5-dphbz" Jul 03 19:11:12.883244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.883217 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/94d6f844-ab01-484e-b2ba-ae1c632275f4-signing-key\") pod \"service-ca-758f599c5-dphbz\" (UID: \"94d6f844-ab01-484e-b2ba-ae1c632275f4\") " pod="openshift-service-ca/service-ca-758f599c5-dphbz" Jul 03 19:11:12.888681 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.888650 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp24s\" (UniqueName: \"kubernetes.io/projected/94d6f844-ab01-484e-b2ba-ae1c632275f4-kube-api-access-lp24s\") pod \"service-ca-758f599c5-dphbz\" (UID: \"94d6f844-ab01-484e-b2ba-ae1c632275f4\") " pod="openshift-service-ca/service-ca-758f599c5-dphbz" Jul 03 19:11:12.963648 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:12.963558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-dphbz" Jul 03 19:11:13.086741 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:13.086708 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dphbz"] Jul 03 19:11:13.089888 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:11:13.089850 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d6f844_ab01_484e_b2ba_ae1c632275f4.slice/crio-2d8eeddfa8a75dd5430d9fd54e5fc5f693f4c749440aeca9ac27af476b5cc5c4 WatchSource:0}: Error finding container 2d8eeddfa8a75dd5430d9fd54e5fc5f693f4c749440aeca9ac27af476b5cc5c4: Status 404 returned error can't find the container with id 2d8eeddfa8a75dd5430d9fd54e5fc5f693f4c749440aeca9ac27af476b5cc5c4 Jul 03 19:11:13.232431 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:13.232331 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-dphbz" event={"ID":"94d6f844-ab01-484e-b2ba-ae1c632275f4","Type":"ContainerStarted","Data":"2d8eeddfa8a75dd5430d9fd54e5fc5f693f4c749440aeca9ac27af476b5cc5c4"} Jul 03 19:11:13.234044 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:13.234016 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nl62p" event={"ID":"50ec8c0d-c135-4e73-b881-f3d366a75eef","Type":"ContainerStarted","Data":"371f48f405693030cb644d3a0b359d556a5d2f5f7096dfda78396f8fd7419c13"} Jul 03 19:11:13.234183 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:13.234060 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nl62p" event={"ID":"50ec8c0d-c135-4e73-b881-f3d366a75eef","Type":"ContainerStarted","Data":"95c93de7f694b0c7e9281441413fdf0c75b672417094b6c4668970e3cbe0c0b5"} Jul 03 19:11:13.256183 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:13.256143 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-nl62p" podStartSLOduration=2.069710815 podStartE2EDuration="3.256127628s" totalImagesPullingTime="1.186416813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:13.255664531 +0000 UTC m=+80.892410213" watchObservedRunningTime="2026-07-03 19:11:13.256127628 +0000 UTC m=+80.892873309" Jul 03 19:11:13.787258 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:13.787211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:13.787258 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:13.787266 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:13.787682 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:13.787338 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:13.787682 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:13.787365 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:13.787682 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:13.787400 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm podName:9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:17.787384093 +0000 UTC m=+85.424129756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpsg6" (UID: "9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7") : configmap "kube-rbac-proxy" not found Jul 03 19:11:13.787682 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:13.787421 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls podName:9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:17.787406741 +0000 UTC m=+85.424152400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpsg6" (UID: "9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:13.843346 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:13.843321 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bqptn_e3c305ed-06b4-430f-8f40-ff3d84434342/serve-healthcheck-canary/0.log" Jul 03 19:11:16.245789 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:16.245750 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-dphbz" event={"ID":"94d6f844-ab01-484e-b2ba-ae1c632275f4","Type":"ContainerStarted","Data":"415e2b75da7c0219675402d148ffac0918f4c5a4afe537817cccaa4f712cd41e"} Jul 03 19:11:16.262095 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:16.262050 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-dphbz" podStartSLOduration=1.833426306 podStartE2EDuration="4.262032554s" totalImagesPullingTime="2.428606248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:16.261023268 +0000 UTC m=+83.897768950" watchObservedRunningTime="2026-07-03 19:11:16.262032554 +0000 UTC m=+83.898778280" Jul 03 19:11:17.820809 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:17.820751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:17.820809 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:17.820814 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:17.821279 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:17.820914 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:17.821279 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:17.820926 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:17.821279 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:17.820977 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm podName:9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:25.82096037 +0000 UTC m=+93.457706030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpsg6" (UID: "9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7") : configmap "kube-rbac-proxy" not found Jul 03 19:11:17.821279 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:17.820994 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls podName:9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:25.820985941 +0000 UTC m=+93.457731600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpsg6" (UID: "9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:25.884148 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:25.884092 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:25.884560 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:25.884165 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:25.884560 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:25.884251 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:25.884560 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:11:25.884330 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls podName:9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:41.884307148 +0000 UTC m=+109.521052816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpsg6" (UID: "9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:25.884802 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:25.884783 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:31.489745 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.489713 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp"] Jul 03 19:11:31.492319 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.492302 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.494941 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.494909 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 03 19:11:31.495814 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.495794 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 03 19:11:31.496109 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.496085 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 03 19:11:31.496220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.496139 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 03 19:11:31.496220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.496151 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 03 19:11:31.496601 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.496580 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 03 19:11:31.497102 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.497077 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 03 19:11:31.506851 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.506822 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp"] Jul 03 19:11:31.630381 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.630347 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4dd972ad-5ab0-483b-8d74-22c991f76d0b-ca\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.630381 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.630382 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd972ad-5ab0-483b-8d74-22c991f76d0b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.630608 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.630459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4dd972ad-5ab0-483b-8d74-22c991f76d0b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.630608 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.630482 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlsrr\" (UniqueName: \"kubernetes.io/projected/4dd972ad-5ab0-483b-8d74-22c991f76d0b-kube-api-access-xlsrr\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.630608 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.630563 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4dd972ad-5ab0-483b-8d74-22c991f76d0b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.630608 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.630590 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4dd972ad-5ab0-483b-8d74-22c991f76d0b-hub\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.731958 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.731920 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4dd972ad-5ab0-483b-8d74-22c991f76d0b-ca\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.731958 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.731956 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd972ad-5ab0-483b-8d74-22c991f76d0b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.732163 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.731996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4dd972ad-5ab0-483b-8d74-22c991f76d0b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.732207 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.732185 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlsrr\" (UniqueName: \"kubernetes.io/projected/4dd972ad-5ab0-483b-8d74-22c991f76d0b-kube-api-access-xlsrr\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.732250 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.732227 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4dd972ad-5ab0-483b-8d74-22c991f76d0b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.732394 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.732369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4dd972ad-5ab0-483b-8d74-22c991f76d0b-hub\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.732817 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.732791 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd972ad-5ab0-483b-8d74-22c991f76d0b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.734473 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.734448 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4dd972ad-5ab0-483b-8d74-22c991f76d0b-ca\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.734617 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.734597 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4dd972ad-5ab0-483b-8d74-22c991f76d0b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.734939 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.734924 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4dd972ad-5ab0-483b-8d74-22c991f76d0b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.734987 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.734940 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4dd972ad-5ab0-483b-8d74-22c991f76d0b-hub\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.742521 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.742466 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlsrr\" (UniqueName: \"kubernetes.io/projected/4dd972ad-5ab0-483b-8d74-22c991f76d0b-kube-api-access-xlsrr\") pod \"cluster-proxy-proxy-agent-f8f844c57-d42tp\" (UID: \"4dd972ad-5ab0-483b-8d74-22c991f76d0b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.813109 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.813072 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" Jul 03 19:11:31.938903 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:31.938835 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp"] Jul 03 19:11:31.942212 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:11:31.942177 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4dd972ad_5ab0_483b_8d74_22c991f76d0b.slice/crio-99e28f00edb952b6e29247a6c1874dbc8ae31973a36fb1fd7753fbd628d9ad14 WatchSource:0}: Error finding container 99e28f00edb952b6e29247a6c1874dbc8ae31973a36fb1fd7753fbd628d9ad14: Status 404 returned error can't find the container with id 99e28f00edb952b6e29247a6c1874dbc8ae31973a36fb1fd7753fbd628d9ad14 Jul 03 19:11:32.135385 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:32.135348 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:11:32.135560 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:32.135402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:11:32.137613 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:32.137588 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a5b0d08-0add-40ba-b8d2-44761b1e54d7-metrics-tls\") pod \"dns-default-lrnd6\" (UID: \"6a5b0d08-0add-40ba-b8d2-44761b1e54d7\") " pod="openshift-dns/dns-default-lrnd6" Jul 03 19:11:32.137739 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:32.137720 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls\") pod \"image-registry-7bccc7b79d-cjs5b\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:11:32.153401 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:32.153376 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8lvgc\"" Jul 03 19:11:32.162115 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:32.162094 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lrnd6" Jul 03 19:11:32.281146 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:32.281117 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lrnd6"] Jul 03 19:11:32.284857 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:11:32.284825 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5b0d08_0add_40ba_b8d2_44761b1e54d7.slice/crio-16248ff572f8f558971fe9d85f8f1ed07f56980d21ff6be0c46eb0f6b422b4fd WatchSource:0}: Error finding container 16248ff572f8f558971fe9d85f8f1ed07f56980d21ff6be0c46eb0f6b422b4fd: Status 404 returned error can't find the container with id 16248ff572f8f558971fe9d85f8f1ed07f56980d21ff6be0c46eb0f6b422b4fd Jul 03 19:11:32.298508 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:32.298480 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lrnd6" event={"ID":"6a5b0d08-0add-40ba-b8d2-44761b1e54d7","Type":"ContainerStarted","Data":"16248ff572f8f558971fe9d85f8f1ed07f56980d21ff6be0c46eb0f6b422b4fd"} Jul 03 19:11:32.299570 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:32.299547 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" event={"ID":"4dd972ad-5ab0-483b-8d74-22c991f76d0b","Type":"ContainerStarted","Data":"99e28f00edb952b6e29247a6c1874dbc8ae31973a36fb1fd7753fbd628d9ad14"} Jul 03 19:11:32.428399 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:32.428314 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4z568\"" Jul 03 19:11:32.437038 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:32.437007 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:11:32.560814 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:32.560780 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bccc7b79d-cjs5b"] Jul 03 19:11:32.565447 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:11:32.565414 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77f11c0_482b_46d6_9b01_5ba84b1fdd8c.slice/crio-32654fbaa5f9a2e7ed618db7886c79161bfcead142efb1a4755df504594b4544 WatchSource:0}: Error finding container 32654fbaa5f9a2e7ed618db7886c79161bfcead142efb1a4755df504594b4544: Status 404 returned error can't find the container with id 32654fbaa5f9a2e7ed618db7886c79161bfcead142efb1a4755df504594b4544 Jul 03 19:11:33.304972 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:33.304933 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" event={"ID":"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c","Type":"ContainerStarted","Data":"a11d20e51b38daed0c78e5bcdfd425b061e2f7c37e14f0f5983e816f7e167d54"} Jul 03 19:11:33.305162 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:33.304996 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" event={"ID":"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c","Type":"ContainerStarted","Data":"32654fbaa5f9a2e7ed618db7886c79161bfcead142efb1a4755df504594b4544"} Jul 03 19:11:33.305212 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:33.305168 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:11:33.325110 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:33.325042 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" podStartSLOduration=100.325013936 podStartE2EDuration="1m40.325013936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:33.322844404 +0000 UTC m=+100.959590089" watchObservedRunningTime="2026-07-03 19:11:33.325013936 +0000 UTC m=+100.961759618" Jul 03 19:11:35.209982 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:35.209942 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dhhtp" Jul 03 19:11:37.322076 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:37.322032 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lrnd6" event={"ID":"6a5b0d08-0add-40ba-b8d2-44761b1e54d7","Type":"ContainerStarted","Data":"abffe858fe664e853fd9687a70f63a15cd1a1f0baaa4dcfd6edad67a35209054"} Jul 03 19:11:37.322587 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:37.322100 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lrnd6" event={"ID":"6a5b0d08-0add-40ba-b8d2-44761b1e54d7","Type":"ContainerStarted","Data":"cf4be0a84fad37bbe38e03ec994bc2b2e76c42ea1b7df5d722a2df9521ec7525"} Jul 03 19:11:37.322587 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:37.322143 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lrnd6" Jul 03 19:11:37.324575 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:37.324542 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" event={"ID":"4dd972ad-5ab0-483b-8d74-22c991f76d0b","Type":"ContainerStarted","Data":"cf642817f7f46aa57fbbf9b83101c367f6f9e4f5788a465cefbf2b7097602345"} Jul 03 19:11:37.324703 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:37.324585 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" event={"ID":"4dd972ad-5ab0-483b-8d74-22c991f76d0b","Type":"ContainerStarted","Data":"1ff5324f93ad2b8c654ae1bfacd4d3a988c6c767886f1d5aa3c9deac06c1e38b"} Jul 03 19:11:37.324703 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:37.324605 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" event={"ID":"4dd972ad-5ab0-483b-8d74-22c991f76d0b","Type":"ContainerStarted","Data":"bd1a639492ceceddb062a62fea4c41fd1b54552c66c652cb2e3c26c1bccbf795"} Jul 03 19:11:37.337615 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:37.337567 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lrnd6" podStartSLOduration=65.340449696 podStartE2EDuration="1m9.337553524s" totalImagesPullingTime="3.997103828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:37.337270921 +0000 UTC m=+104.974016605" watchObservedRunningTime="2026-07-03 19:11:37.337553524 +0000 UTC m=+104.974299205" Jul 03 19:11:37.353551 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:37.353507 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f8f844c57-d42tp" podStartSLOduration=1.725825604 podStartE2EDuration="6.3534933s" totalImagesPullingTime="4.627667696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:37.352601052 +0000 UTC m=+104.989346732" watchObservedRunningTime="2026-07-03 19:11:37.3534933 +0000 UTC m=+104.990239010" Jul 03 19:11:41.913261 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:41.913209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:41.915559 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:41.915523 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpsg6\" (UID: \"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7\") " pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:42.165210 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:42.165114 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpsg6" Jul 03 19:11:42.286464 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:42.286422 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpsg6"] Jul 03 19:11:42.288751 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:11:42.288725 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9963ee1d_64f9_43c5_90fa_c91b6c1a5ec7.slice/crio-cddaf45c5c6fc284895078a7f95513ca9245a2b988491fdd3ca5b6ffc0cc5f71 WatchSource:0}: Error finding container cddaf45c5c6fc284895078a7f95513ca9245a2b988491fdd3ca5b6ffc0cc5f71: Status 404 returned error can't find the container with id cddaf45c5c6fc284895078a7f95513ca9245a2b988491fdd3ca5b6ffc0cc5f71 Jul 03 19:11:42.342216 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:42.342180 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpsg6" event={"ID":"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7","Type":"ContainerStarted","Data":"cddaf45c5c6fc284895078a7f95513ca9245a2b988491fdd3ca5b6ffc0cc5f71"} Jul 03 19:11:46.358753 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:46.358715 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpsg6" event={"ID":"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7","Type":"ContainerStarted","Data":"d1a93a3c7c380f3fbe55ca64c1bee024db2e28818230b737a174f01b33c58b95"} Jul 03 19:11:47.330309 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:47.330274 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lrnd6" Jul 03 19:11:47.364513 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:47.364476 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpsg6" event={"ID":"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7","Type":"ContainerStarted","Data":"6bd15a3c4cf209bee9fb0633c4c0e1bc7407eceb23e7c2bb23462c6e7ffa4654"} Jul 03 19:11:49.373436 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:49.373401 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpsg6" event={"ID":"9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7","Type":"ContainerStarted","Data":"d58cf71a3482a9b4dda987a8164022bb78e7f61b32736313e5ccc81cb43fcd51"} Jul 03 19:11:49.392424 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:49.392374 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jpsg6" podStartSLOduration=32.645827346 podStartE2EDuration="39.392358194s" totalImagesPullingTime="6.746530848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:11:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:49.391095369 +0000 UTC m=+117.027841050" watchObservedRunningTime="2026-07-03 19:11:49.392358194 +0000 UTC m=+117.029103874" Jul 03 19:11:50.412048 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.412022 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-llwgm"] Jul 03 19:11:50.415202 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.415183 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.417549 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.417527 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 03 19:11:50.418065 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.418044 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 03 19:11:50.418483 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.418468 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 03 19:11:50.418626 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.418607 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ffmmx\"" Jul 03 19:11:50.419026 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.419008 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 03 19:11:50.419097 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.419043 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 03 19:11:50.419097 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.419058 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 03 19:11:50.583659 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.583626 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-wtmp\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.583813 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.583664 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-tls\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.583813 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.583721 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.583813 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.583782 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d08717a-2a89-4c82-a0f8-5ddfa607425c-sys\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.583932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.583812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d08717a-2a89-4c82-a0f8-5ddfa607425c-metrics-client-ca\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.583932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.583835 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-accelerators-collector-config\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.583932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.583901 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-textfile\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.583932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.583927 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kqqn\" (UniqueName: \"kubernetes.io/projected/0d08717a-2a89-4c82-a0f8-5ddfa607425c-kube-api-access-5kqqn\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.584089 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.583949 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d08717a-2a89-4c82-a0f8-5ddfa607425c-root\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.684805 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.684710 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-tls\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.684805 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.684761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.685031 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.684810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d08717a-2a89-4c82-a0f8-5ddfa607425c-sys\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.685031 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.684836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d08717a-2a89-4c82-a0f8-5ddfa607425c-metrics-client-ca\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.685031 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.684914 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d08717a-2a89-4c82-a0f8-5ddfa607425c-sys\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.685031 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.684966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-accelerators-collector-config\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.685031 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.685005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-textfile\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.685031 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.685023 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kqqn\" (UniqueName: \"kubernetes.io/projected/0d08717a-2a89-4c82-a0f8-5ddfa607425c-kube-api-access-5kqqn\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.685309 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.685150 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d08717a-2a89-4c82-a0f8-5ddfa607425c-root\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.685309 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.685229 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-wtmp\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.685413 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.685378 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-wtmp\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.685413 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.685378 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d08717a-2a89-4c82-a0f8-5ddfa607425c-root\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.685512 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.685444 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-textfile\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.685633 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.685609 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-accelerators-collector-config\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.685669 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.685646 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d08717a-2a89-4c82-a0f8-5ddfa607425c-metrics-client-ca\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.687254 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.687234 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.687349 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.687329 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d08717a-2a89-4c82-a0f8-5ddfa607425c-node-exporter-tls\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.692205 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.692180 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kqqn\" (UniqueName: \"kubernetes.io/projected/0d08717a-2a89-4c82-a0f8-5ddfa607425c-kube-api-access-5kqqn\") pod \"node-exporter-llwgm\" (UID: \"0d08717a-2a89-4c82-a0f8-5ddfa607425c\") " pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.724797 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:50.724759 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-llwgm" Jul 03 19:11:50.736949 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:11:50.736920 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d08717a_2a89_4c82_a0f8_5ddfa607425c.slice/crio-3452b26e0d6669431d1d500dac755862d3a86add65935a47faa17d84b79f10fe WatchSource:0}: Error finding container 3452b26e0d6669431d1d500dac755862d3a86add65935a47faa17d84b79f10fe: Status 404 returned error can't find the container with id 3452b26e0d6669431d1d500dac755862d3a86add65935a47faa17d84b79f10fe Jul 03 19:11:51.382609 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:51.382567 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llwgm" event={"ID":"0d08717a-2a89-4c82-a0f8-5ddfa607425c","Type":"ContainerStarted","Data":"3452b26e0d6669431d1d500dac755862d3a86add65935a47faa17d84b79f10fe"} Jul 03 19:11:52.387600 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:52.387562 2580 generic.go:356] "Generic (PLEG): container finished" podID="0d08717a-2a89-4c82-a0f8-5ddfa607425c" containerID="4ee661737755e9a30aeba9798d8681275a67a52bf3d3a64e0fac022b7456fade" exitCode=0 Jul 03 19:11:52.388121 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:52.387638 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llwgm" event={"ID":"0d08717a-2a89-4c82-a0f8-5ddfa607425c","Type":"ContainerDied","Data":"4ee661737755e9a30aeba9798d8681275a67a52bf3d3a64e0fac022b7456fade"} Jul 03 19:11:53.393452 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:53.393411 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llwgm" event={"ID":"0d08717a-2a89-4c82-a0f8-5ddfa607425c","Type":"ContainerStarted","Data":"1025866b64bca51cea7cdad8be054e483fbe9b8a37d967246cf55a89f8d06522"} Jul 03 19:11:53.393855 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:53.393517 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-llwgm" event={"ID":"0d08717a-2a89-4c82-a0f8-5ddfa607425c","Type":"ContainerStarted","Data":"35dc078fee5ae9c4c13a634f7a40fdd805f8a8b5c1f15f610a3beb0dcbe3e225"} Jul 03 19:11:53.414821 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:53.414769 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-llwgm" podStartSLOduration=2.310856548 podStartE2EDuration="3.414751641s" totalImagesPullingTime="1.036647202s" totalInitContainerRuntime="67.247891ms" isStatefulPod=true podCreationTimestamp="2026-07-03 19:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:53.413801998 +0000 UTC m=+121.050547678" watchObservedRunningTime="2026-07-03 19:11:53.414751641 +0000 UTC m=+121.051497322" Jul 03 19:11:53.950646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:53.950614 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bccc7b79d-cjs5b"] Jul 03 19:11:53.955022 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:11:53.954994 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:12:02.771792 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:02.771753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:12:02.774046 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:02.774026 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d4565-f8d2-4099-adfb-e97ef0c6dcc2-metrics-certs\") pod \"network-metrics-daemon-qppqv\" (UID: \"824d4565-f8d2-4099-adfb-e97ef0c6dcc2\") " pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:12:02.794765 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:02.794732 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wwb25\"" Jul 03 19:12:02.802661 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:02.802635 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qppqv" Jul 03 19:12:02.932607 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:02.932572 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qppqv"] Jul 03 19:12:02.935586 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:12:02.935562 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824d4565_f8d2_4099_adfb_e97ef0c6dcc2.slice/crio-071fe1abc0a3d715f0468c4927a1823c491ba3fa4e8e804412136b3077f7bfbe WatchSource:0}: Error finding container 071fe1abc0a3d715f0468c4927a1823c491ba3fa4e8e804412136b3077f7bfbe: Status 404 returned error can't find the container with id 071fe1abc0a3d715f0468c4927a1823c491ba3fa4e8e804412136b3077f7bfbe Jul 03 19:12:03.427718 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:03.427684 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qppqv" event={"ID":"824d4565-f8d2-4099-adfb-e97ef0c6dcc2","Type":"ContainerStarted","Data":"071fe1abc0a3d715f0468c4927a1823c491ba3fa4e8e804412136b3077f7bfbe"} Jul 03 19:12:04.433165 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:04.433129 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qppqv" event={"ID":"824d4565-f8d2-4099-adfb-e97ef0c6dcc2","Type":"ContainerStarted","Data":"17e1c1d235f868034f5ba2c939cebff6ce3773ebb8388849931d38e7c4bb8c31"} Jul 03 19:12:04.433571 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:04.433216 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qppqv" event={"ID":"824d4565-f8d2-4099-adfb-e97ef0c6dcc2","Type":"ContainerStarted","Data":"4f76a9b0daf195b7bcb99b00cd721a558fb51d4b26843c6188a1a7c0f06263da"} Jul 03 19:12:04.448684 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:04.448627 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qppqv" podStartSLOduration=130.33243959 podStartE2EDuration="2m11.448611487s" totalImagesPullingTime="1.116171897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:12:04.447761477 +0000 UTC m=+132.084507158" watchObservedRunningTime="2026-07-03 19:12:04.448611487 +0000 UTC m=+132.085357167" Jul 03 19:12:18.970295 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:18.970248 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" podUID="c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" containerName="registry" containerID="cri-o://a11d20e51b38daed0c78e5bcdfd425b061e2f7c37e14f0f5983e816f7e167d54" gracePeriod=30 Jul 03 19:12:19.483940 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.483900 2580 generic.go:356] "Generic (PLEG): container finished" podID="c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" containerID="a11d20e51b38daed0c78e5bcdfd425b061e2f7c37e14f0f5983e816f7e167d54" exitCode=0 Jul 03 19:12:19.483940 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.483909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" event={"ID":"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c","Type":"ContainerDied","Data":"a11d20e51b38daed0c78e5bcdfd425b061e2f7c37e14f0f5983e816f7e167d54"} Jul 03 19:12:19.759797 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.759772 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:12:19.789998 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.789970 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-certificates\") pod \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " Jul 03 19:12:19.790158 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.790012 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-trusted-ca\") pod \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " Jul 03 19:12:19.790158 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.790047 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls\") pod \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " Jul 03 19:12:19.790273 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.790196 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-bound-sa-token\") pod \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " Jul 03 19:12:19.790273 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.790248 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-image-registry-private-configuration\") pod \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " Jul 03 19:12:19.790377 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.790283 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-installation-pull-secrets\") pod \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " Jul 03 19:12:19.790377 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.790344 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-ca-trust-extracted\") pod \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " Jul 03 19:12:19.790476 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.790404 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrvcv\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-kube-api-access-qrvcv\") pod \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\" (UID: \"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c\") " Jul 03 19:12:19.790476 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.790456 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:12:19.790671 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.790639 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-certificates\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:12:19.790744 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.790722 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:12:19.792816 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.792708 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:12:19.792959 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.792851 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:12:19.793029 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.793001 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-kube-api-access-qrvcv" (OuterVolumeSpecName: "kube-api-access-qrvcv") pod "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c"). InnerVolumeSpecName "kube-api-access-qrvcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:12:19.793092 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.793061 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:12:19.793619 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.793596 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:12:19.799767 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.799739 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" (UID: "c77f11c0-482b-46d6-9b01-5ba84b1fdd8c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:12:19.890989 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.890948 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-bound-sa-token\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:12:19.890989 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.890982 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-image-registry-private-configuration\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:12:19.890989 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.890998 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-installation-pull-secrets\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:12:19.891229 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.891013 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-ca-trust-extracted\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:12:19.891229 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.891026 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrvcv\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-kube-api-access-qrvcv\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:12:19.891229 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.891041 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-trusted-ca\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:12:19.891229 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:19.891054 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c-registry-tls\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:12:20.488673 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:20.488635 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" event={"ID":"c77f11c0-482b-46d6-9b01-5ba84b1fdd8c","Type":"ContainerDied","Data":"32654fbaa5f9a2e7ed618db7886c79161bfcead142efb1a4755df504594b4544"} Jul 03 19:12:20.489176 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:20.488692 2580 scope.go:117] "RemoveContainer" containerID="a11d20e51b38daed0c78e5bcdfd425b061e2f7c37e14f0f5983e816f7e167d54" Jul 03 19:12:20.489176 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:20.488645 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bccc7b79d-cjs5b" Jul 03 19:12:20.509172 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:20.509144 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bccc7b79d-cjs5b"] Jul 03 19:12:20.512493 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:20.512470 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7bccc7b79d-cjs5b"] Jul 03 19:12:20.868676 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:12:20.868647 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" path="/var/lib/kubelet/pods/c77f11c0-482b-46d6-9b01-5ba84b1fdd8c/volumes" Jul 03 19:14:52.777381 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:14:52.777347 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 03 19:15:29.254440 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.254400 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc"] Jul 03 19:15:29.256913 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.254735 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" containerName="registry" Jul 03 19:15:29.256913 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.254752 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" containerName="registry" Jul 03 19:15:29.256913 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.254865 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c77f11c0-482b-46d6-9b01-5ba84b1fdd8c" containerName="registry" Jul 03 19:15:29.257776 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.257757 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" Jul 03 19:15:29.259912 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.259889 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 03 19:15:29.260033 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.259909 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 03 19:15:29.260033 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.259924 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pqjjr\"" Jul 03 19:15:29.266321 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.266297 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc"] Jul 03 19:15:29.384789 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.384750 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11ff7b-68bd-4a15-af50-4750c089c0bc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc\" (UID: \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" Jul 03 19:15:29.385001 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.384802 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sssp\" (UniqueName: \"kubernetes.io/projected/3c11ff7b-68bd-4a15-af50-4750c089c0bc-kube-api-access-4sssp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc\" (UID: \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" Jul 03 19:15:29.385001 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.384862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11ff7b-68bd-4a15-af50-4750c089c0bc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc\" (UID: \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" Jul 03 19:15:29.486094 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.486050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sssp\" (UniqueName: \"kubernetes.io/projected/3c11ff7b-68bd-4a15-af50-4750c089c0bc-kube-api-access-4sssp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc\" (UID: \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" Jul 03 19:15:29.486094 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.486094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11ff7b-68bd-4a15-af50-4750c089c0bc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc\" (UID: \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" Jul 03 19:15:29.486294 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.486130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11ff7b-68bd-4a15-af50-4750c089c0bc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc\" (UID: \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" Jul 03 19:15:29.486504 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.486487 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11ff7b-68bd-4a15-af50-4750c089c0bc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc\" (UID: \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" Jul 03 19:15:29.486550 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.486510 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11ff7b-68bd-4a15-af50-4750c089c0bc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc\" (UID: \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" Jul 03 19:15:29.495553 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.495527 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sssp\" (UniqueName: \"kubernetes.io/projected/3c11ff7b-68bd-4a15-af50-4750c089c0bc-kube-api-access-4sssp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc\" (UID: \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" Jul 03 19:15:29.568159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.568075 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" Jul 03 19:15:29.692604 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.692575 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc"] Jul 03 19:15:29.695764 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:15:29.695732 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c11ff7b_68bd_4a15_af50_4750c089c0bc.slice/crio-526dfeb4a177fc4450905931bed2b447b90dd43f2184cf31cea2e5eebfdfad92 WatchSource:0}: Error finding container 526dfeb4a177fc4450905931bed2b447b90dd43f2184cf31cea2e5eebfdfad92: Status 404 returned error can't find the container with id 526dfeb4a177fc4450905931bed2b447b90dd43f2184cf31cea2e5eebfdfad92 Jul 03 19:15:29.697647 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:29.697628 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 19:15:30.112948 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:30.112911 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" event={"ID":"3c11ff7b-68bd-4a15-af50-4750c089c0bc","Type":"ContainerStarted","Data":"526dfeb4a177fc4450905931bed2b447b90dd43f2184cf31cea2e5eebfdfad92"} Jul 03 19:15:36.136907 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:36.136796 2580 generic.go:356] "Generic (PLEG): container finished" podID="3c11ff7b-68bd-4a15-af50-4750c089c0bc" containerID="4282f17f92f42432e431a6c1f1b8d089d363d698ebe927cf54a45cf8dda3c41a" exitCode=0 Jul 03 19:15:36.136907 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:36.136861 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" event={"ID":"3c11ff7b-68bd-4a15-af50-4750c089c0bc","Type":"ContainerDied","Data":"4282f17f92f42432e431a6c1f1b8d089d363d698ebe927cf54a45cf8dda3c41a"} Jul 03 19:15:39.149102 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:39.149059 2580 generic.go:356] "Generic (PLEG): container finished" podID="3c11ff7b-68bd-4a15-af50-4750c089c0bc" containerID="574167bde2c3550b299c1c2507d5d4bee7dc5911e1c9bc04adebc372eeded6c9" exitCode=0 Jul 03 19:15:39.149457 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:39.149114 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" event={"ID":"3c11ff7b-68bd-4a15-af50-4750c089c0bc","Type":"ContainerDied","Data":"574167bde2c3550b299c1c2507d5d4bee7dc5911e1c9bc04adebc372eeded6c9"} Jul 03 19:15:47.183164 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:47.183130 2580 generic.go:356] "Generic (PLEG): container finished" podID="3c11ff7b-68bd-4a15-af50-4750c089c0bc" containerID="9d231e2bfc6cdf74136c039416afa47eb51cff06fd4df140f48c710c56756c57" exitCode=0 Jul 03 19:15:47.183587 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:47.183210 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" event={"ID":"3c11ff7b-68bd-4a15-af50-4750c089c0bc","Type":"ContainerDied","Data":"9d231e2bfc6cdf74136c039416afa47eb51cff06fd4df140f48c710c56756c57"} Jul 03 19:15:48.321083 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:48.321059 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" Jul 03 19:15:48.421922 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:48.421865 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11ff7b-68bd-4a15-af50-4750c089c0bc-util\") pod \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\" (UID: \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\") " Jul 03 19:15:48.422070 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:48.421936 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11ff7b-68bd-4a15-af50-4750c089c0bc-bundle\") pod \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\" (UID: \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\") " Jul 03 19:15:48.422070 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:48.421981 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sssp\" (UniqueName: \"kubernetes.io/projected/3c11ff7b-68bd-4a15-af50-4750c089c0bc-kube-api-access-4sssp\") pod \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\" (UID: \"3c11ff7b-68bd-4a15-af50-4750c089c0bc\") " Jul 03 19:15:48.426868 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:48.422865 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c11ff7b-68bd-4a15-af50-4750c089c0bc-bundle" (OuterVolumeSpecName: "bundle") pod "3c11ff7b-68bd-4a15-af50-4750c089c0bc" (UID: "3c11ff7b-68bd-4a15-af50-4750c089c0bc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:15:48.427033 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:48.426938 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c11ff7b-68bd-4a15-af50-4750c089c0bc-kube-api-access-4sssp" (OuterVolumeSpecName: "kube-api-access-4sssp") pod "3c11ff7b-68bd-4a15-af50-4750c089c0bc" (UID: "3c11ff7b-68bd-4a15-af50-4750c089c0bc"). InnerVolumeSpecName "kube-api-access-4sssp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:15:48.428482 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:48.428451 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c11ff7b-68bd-4a15-af50-4750c089c0bc-util" (OuterVolumeSpecName: "util") pod "3c11ff7b-68bd-4a15-af50-4750c089c0bc" (UID: "3c11ff7b-68bd-4a15-af50-4750c089c0bc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:15:48.523501 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:48.523399 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sssp\" (UniqueName: \"kubernetes.io/projected/3c11ff7b-68bd-4a15-af50-4750c089c0bc-kube-api-access-4sssp\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:15:48.523501 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:48.523447 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11ff7b-68bd-4a15-af50-4750c089c0bc-util\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:15:48.523501 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:48.523458 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11ff7b-68bd-4a15-af50-4750c089c0bc-bundle\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:15:49.192158 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:49.192072 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" event={"ID":"3c11ff7b-68bd-4a15-af50-4750c089c0bc","Type":"ContainerDied","Data":"526dfeb4a177fc4450905931bed2b447b90dd43f2184cf31cea2e5eebfdfad92"} Jul 03 19:15:49.192158 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:49.192095 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fqssc" Jul 03 19:15:49.192158 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:49.192122 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="526dfeb4a177fc4450905931bed2b447b90dd43f2184cf31cea2e5eebfdfad92" Jul 03 19:15:52.180815 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.180778 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd"] Jul 03 19:15:52.181214 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.181018 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c11ff7b-68bd-4a15-af50-4750c089c0bc" containerName="util" Jul 03 19:15:52.181214 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.181029 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c11ff7b-68bd-4a15-af50-4750c089c0bc" containerName="util" Jul 03 19:15:52.181214 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.181041 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c11ff7b-68bd-4a15-af50-4750c089c0bc" containerName="pull" Jul 03 19:15:52.181214 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.181046 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c11ff7b-68bd-4a15-af50-4750c089c0bc" containerName="pull" Jul 03 19:15:52.181214 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.181053 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c11ff7b-68bd-4a15-af50-4750c089c0bc" containerName="extract" Jul 03 19:15:52.181214 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.181058 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c11ff7b-68bd-4a15-af50-4750c089c0bc" containerName="extract" Jul 03 19:15:52.181214 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.181104 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c11ff7b-68bd-4a15-af50-4750c089c0bc" containerName="extract" Jul 03 19:15:52.184485 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.184462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd" Jul 03 19:15:52.187031 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.187010 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:15:52.187160 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.187113 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 03 19:15:52.187219 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.187185 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-96rkp\"" Jul 03 19:15:52.202170 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.202134 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd"] Jul 03 19:15:52.353918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.353841 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxhmm\" (UniqueName: \"kubernetes.io/projected/62e2500d-7f8e-4244-a53e-86ad5528b99b-kube-api-access-hxhmm\") pod \"cert-manager-operator-controller-manager-55c444bf86-gdmjd\" (UID: \"62e2500d-7f8e-4244-a53e-86ad5528b99b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd" Jul 03 19:15:52.354107 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.353961 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62e2500d-7f8e-4244-a53e-86ad5528b99b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gdmjd\" (UID: \"62e2500d-7f8e-4244-a53e-86ad5528b99b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd" Jul 03 19:15:52.454450 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.454366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxhmm\" (UniqueName: \"kubernetes.io/projected/62e2500d-7f8e-4244-a53e-86ad5528b99b-kube-api-access-hxhmm\") pod \"cert-manager-operator-controller-manager-55c444bf86-gdmjd\" (UID: \"62e2500d-7f8e-4244-a53e-86ad5528b99b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd" Jul 03 19:15:52.454450 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.454429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62e2500d-7f8e-4244-a53e-86ad5528b99b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gdmjd\" (UID: \"62e2500d-7f8e-4244-a53e-86ad5528b99b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd" Jul 03 19:15:52.454849 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.454829 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62e2500d-7f8e-4244-a53e-86ad5528b99b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gdmjd\" (UID: \"62e2500d-7f8e-4244-a53e-86ad5528b99b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd" Jul 03 19:15:52.462523 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.462489 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxhmm\" (UniqueName: \"kubernetes.io/projected/62e2500d-7f8e-4244-a53e-86ad5528b99b-kube-api-access-hxhmm\") pod \"cert-manager-operator-controller-manager-55c444bf86-gdmjd\" (UID: \"62e2500d-7f8e-4244-a53e-86ad5528b99b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd" Jul 03 19:15:52.494498 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.494466 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd" Jul 03 19:15:52.625798 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:52.625766 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd"] Jul 03 19:15:52.630692 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:15:52.630663 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62e2500d_7f8e_4244_a53e_86ad5528b99b.slice/crio-94edc38a50f0ccbdc4c68eeb98fe1104a07991d299f1fa0fe2dd523eaab74b59 WatchSource:0}: Error finding container 94edc38a50f0ccbdc4c68eeb98fe1104a07991d299f1fa0fe2dd523eaab74b59: Status 404 returned error can't find the container with id 94edc38a50f0ccbdc4c68eeb98fe1104a07991d299f1fa0fe2dd523eaab74b59 Jul 03 19:15:53.206889 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:53.206831 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd" event={"ID":"62e2500d-7f8e-4244-a53e-86ad5528b99b","Type":"ContainerStarted","Data":"94edc38a50f0ccbdc4c68eeb98fe1104a07991d299f1fa0fe2dd523eaab74b59"} Jul 03 19:15:55.216313 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:55.216276 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd" event={"ID":"62e2500d-7f8e-4244-a53e-86ad5528b99b","Type":"ContainerStarted","Data":"7c94d77a63b144aa8e3bfbd21918a7508957c1e3b4de2b6e690e78f89dff4e06"} Jul 03 19:15:55.238851 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:55.238797 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gdmjd" podStartSLOduration=1.208618531 podStartE2EDuration="3.238778964s" totalImagesPullingTime="2.030160433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:15:55.237602038 +0000 UTC m=+362.874347719" watchObservedRunningTime="2026-07-03 19:15:55.238778964 +0000 UTC m=+362.875524644" Jul 03 19:15:55.930843 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:55.930809 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k"] Jul 03 19:15:55.934108 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:55.934089 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" Jul 03 19:15:55.936500 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:55.936480 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 03 19:15:55.937155 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:55.937136 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pqjjr\"" Jul 03 19:15:55.937261 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:55.937159 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 03 19:15:55.944291 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:55.944268 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k"] Jul 03 19:15:56.081869 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:56.081836 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k\" (UID: \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" Jul 03 19:15:56.082044 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:56.081906 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k\" (UID: \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" Jul 03 19:15:56.082044 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:56.081954 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sdzb\" (UniqueName: \"kubernetes.io/projected/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-kube-api-access-2sdzb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k\" (UID: \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" Jul 03 19:15:56.182612 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:56.182528 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k\" (UID: \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" Jul 03 19:15:56.182612 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:56.182569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sdzb\" (UniqueName: \"kubernetes.io/projected/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-kube-api-access-2sdzb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k\" (UID: \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" Jul 03 19:15:56.182612 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:56.182614 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k\" (UID: \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" Jul 03 19:15:56.183040 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:56.183024 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k\" (UID: \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" Jul 03 19:15:56.183094 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:56.183025 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k\" (UID: \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" Jul 03 19:15:56.190640 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:56.190609 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sdzb\" (UniqueName: \"kubernetes.io/projected/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-kube-api-access-2sdzb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k\" (UID: \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" Jul 03 19:15:56.243446 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:56.243408 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" Jul 03 19:15:56.371333 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:56.371160 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k"] Jul 03 19:15:56.373884 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:15:56.373839 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5add2c00_d5df_45d6_9c2f_22ffa51b3e56.slice/crio-6efd54885e5a5565e1c193c3fcac89dd1adc7b3d4825cd4d2e7994f73feca66b WatchSource:0}: Error finding container 6efd54885e5a5565e1c193c3fcac89dd1adc7b3d4825cd4d2e7994f73feca66b: Status 404 returned error can't find the container with id 6efd54885e5a5565e1c193c3fcac89dd1adc7b3d4825cd4d2e7994f73feca66b Jul 03 19:15:57.224967 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:57.224929 2580 generic.go:356] "Generic (PLEG): container finished" podID="5add2c00-d5df-45d6-9c2f-22ffa51b3e56" containerID="586f2b7a8a32e812c6f79d964a90383b5acd27650517282d04e891e77c7ff8f9" exitCode=0 Jul 03 19:15:57.225104 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:57.225007 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" event={"ID":"5add2c00-d5df-45d6-9c2f-22ffa51b3e56","Type":"ContainerDied","Data":"586f2b7a8a32e812c6f79d964a90383b5acd27650517282d04e891e77c7ff8f9"} Jul 03 19:15:57.225104 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:15:57.225059 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" event={"ID":"5add2c00-d5df-45d6-9c2f-22ffa51b3e56","Type":"ContainerStarted","Data":"6efd54885e5a5565e1c193c3fcac89dd1adc7b3d4825cd4d2e7994f73feca66b"} Jul 03 19:16:00.240030 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:00.239994 2580 generic.go:356] "Generic (PLEG): container finished" podID="5add2c00-d5df-45d6-9c2f-22ffa51b3e56" containerID="4a4469aaa3723dad39d249b2607daead63e113926518e1f7f59fb7295bc46c92" exitCode=0 Jul 03 19:16:00.240482 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:00.240071 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" event={"ID":"5add2c00-d5df-45d6-9c2f-22ffa51b3e56","Type":"ContainerDied","Data":"4a4469aaa3723dad39d249b2607daead63e113926518e1f7f59fb7295bc46c92"} Jul 03 19:16:01.245970 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:01.245934 2580 generic.go:356] "Generic (PLEG): container finished" podID="5add2c00-d5df-45d6-9c2f-22ffa51b3e56" containerID="f086015872a3de75f6b429bd4287f0c4f2ec10223f758fae77393bde75df1c70" exitCode=0 Jul 03 19:16:01.246347 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:01.246027 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" event={"ID":"5add2c00-d5df-45d6-9c2f-22ffa51b3e56","Type":"ContainerDied","Data":"f086015872a3de75f6b429bd4287f0c4f2ec10223f758fae77393bde75df1c70"} Jul 03 19:16:02.231550 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.231513 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9"] Jul 03 19:16:02.235051 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.235033 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9" Jul 03 19:16:02.237834 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.237807 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 03 19:16:02.237975 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.237837 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tbs2t\"" Jul 03 19:16:02.237975 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.237921 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 03 19:16:02.241973 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.241690 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9"] Jul 03 19:16:02.383411 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.383385 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" Jul 03 19:16:02.427501 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.427471 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfq6j\" (UniqueName: \"kubernetes.io/projected/ee07f762-d664-4059-8c24-654385481971-kube-api-access-gfq6j\") pod \"cert-manager-cainjector-559cdd8c87-g7rl9\" (UID: \"ee07f762-d664-4059-8c24-654385481971\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9" Jul 03 19:16:02.427501 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.427505 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee07f762-d664-4059-8c24-654385481971-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g7rl9\" (UID: \"ee07f762-d664-4059-8c24-654385481971\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9" Jul 03 19:16:02.528394 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.528312 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-bundle\") pod \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\" (UID: \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\") " Jul 03 19:16:02.528394 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.528359 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-util\") pod \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\" (UID: \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\") " Jul 03 19:16:02.528585 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.528397 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sdzb\" (UniqueName: \"kubernetes.io/projected/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-kube-api-access-2sdzb\") pod \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\" (UID: \"5add2c00-d5df-45d6-9c2f-22ffa51b3e56\") " Jul 03 19:16:02.528585 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.528499 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfq6j\" (UniqueName: \"kubernetes.io/projected/ee07f762-d664-4059-8c24-654385481971-kube-api-access-gfq6j\") pod \"cert-manager-cainjector-559cdd8c87-g7rl9\" (UID: \"ee07f762-d664-4059-8c24-654385481971\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9" Jul 03 19:16:02.528585 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.528529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee07f762-d664-4059-8c24-654385481971-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g7rl9\" (UID: \"ee07f762-d664-4059-8c24-654385481971\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9" Jul 03 19:16:02.528710 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.528677 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-bundle" (OuterVolumeSpecName: "bundle") pod "5add2c00-d5df-45d6-9c2f-22ffa51b3e56" (UID: "5add2c00-d5df-45d6-9c2f-22ffa51b3e56"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:16:02.530468 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.530439 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-kube-api-access-2sdzb" (OuterVolumeSpecName: "kube-api-access-2sdzb") pod "5add2c00-d5df-45d6-9c2f-22ffa51b3e56" (UID: "5add2c00-d5df-45d6-9c2f-22ffa51b3e56"). InnerVolumeSpecName "kube-api-access-2sdzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:16:02.532840 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.532818 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-util" (OuterVolumeSpecName: "util") pod "5add2c00-d5df-45d6-9c2f-22ffa51b3e56" (UID: "5add2c00-d5df-45d6-9c2f-22ffa51b3e56"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:16:02.536426 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.536397 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee07f762-d664-4059-8c24-654385481971-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g7rl9\" (UID: \"ee07f762-d664-4059-8c24-654385481971\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9" Jul 03 19:16:02.536527 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.536516 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfq6j\" (UniqueName: \"kubernetes.io/projected/ee07f762-d664-4059-8c24-654385481971-kube-api-access-gfq6j\") pod \"cert-manager-cainjector-559cdd8c87-g7rl9\" (UID: \"ee07f762-d664-4059-8c24-654385481971\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9" Jul 03 19:16:02.545223 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.545187 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9" Jul 03 19:16:02.629340 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.629306 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-bundle\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:16:02.629340 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.629331 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-util\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:16:02.629489 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.629343 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sdzb\" (UniqueName: \"kubernetes.io/projected/5add2c00-d5df-45d6-9c2f-22ffa51b3e56-kube-api-access-2sdzb\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:16:02.671541 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:02.671496 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9"] Jul 03 19:16:02.674687 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:16:02.674660 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee07f762_d664_4059_8c24_654385481971.slice/crio-d7ef8b9078bef57a6745262133a5121b2ff0bc8e37111dcf5edab66c051ccd8b WatchSource:0}: Error finding container d7ef8b9078bef57a6745262133a5121b2ff0bc8e37111dcf5edab66c051ccd8b: Status 404 returned error can't find the container with id d7ef8b9078bef57a6745262133a5121b2ff0bc8e37111dcf5edab66c051ccd8b Jul 03 19:16:03.258660 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:03.258580 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" Jul 03 19:16:03.258660 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:03.258569 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzz5k" event={"ID":"5add2c00-d5df-45d6-9c2f-22ffa51b3e56","Type":"ContainerDied","Data":"6efd54885e5a5565e1c193c3fcac89dd1adc7b3d4825cd4d2e7994f73feca66b"} Jul 03 19:16:03.258887 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:03.258692 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6efd54885e5a5565e1c193c3fcac89dd1adc7b3d4825cd4d2e7994f73feca66b" Jul 03 19:16:03.259819 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:03.259794 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9" event={"ID":"ee07f762-d664-4059-8c24-654385481971","Type":"ContainerStarted","Data":"d7ef8b9078bef57a6745262133a5121b2ff0bc8e37111dcf5edab66c051ccd8b"} Jul 03 19:16:06.043661 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.043619 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9zwdv"] Jul 03 19:16:06.044098 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.043863 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5add2c00-d5df-45d6-9c2f-22ffa51b3e56" containerName="util" Jul 03 19:16:06.044098 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.043887 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5add2c00-d5df-45d6-9c2f-22ffa51b3e56" containerName="util" Jul 03 19:16:06.044098 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.043896 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5add2c00-d5df-45d6-9c2f-22ffa51b3e56" containerName="pull" Jul 03 19:16:06.044098 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.043901 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5add2c00-d5df-45d6-9c2f-22ffa51b3e56" containerName="pull" Jul 03 19:16:06.044098 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.043913 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5add2c00-d5df-45d6-9c2f-22ffa51b3e56" containerName="extract" Jul 03 19:16:06.044098 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.043918 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5add2c00-d5df-45d6-9c2f-22ffa51b3e56" containerName="extract" Jul 03 19:16:06.044098 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.043964 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5add2c00-d5df-45d6-9c2f-22ffa51b3e56" containerName="extract" Jul 03 19:16:06.047198 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.047182 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9zwdv" Jul 03 19:16:06.049566 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.049538 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rxmjj\"" Jul 03 19:16:06.052615 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.052589 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6tfl\" (UniqueName: \"kubernetes.io/projected/cb077536-4d37-4200-8d7c-9bc145670c12-kube-api-access-c6tfl\") pod \"cert-manager-55b4d954d5-9zwdv\" (UID: \"cb077536-4d37-4200-8d7c-9bc145670c12\") " pod="cert-manager/cert-manager-55b4d954d5-9zwdv" Jul 03 19:16:06.052754 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.052629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb077536-4d37-4200-8d7c-9bc145670c12-bound-sa-token\") pod \"cert-manager-55b4d954d5-9zwdv\" (UID: \"cb077536-4d37-4200-8d7c-9bc145670c12\") " pod="cert-manager/cert-manager-55b4d954d5-9zwdv" Jul 03 19:16:06.057022 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.057000 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9zwdv"] Jul 03 19:16:06.153448 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.153409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6tfl\" (UniqueName: \"kubernetes.io/projected/cb077536-4d37-4200-8d7c-9bc145670c12-kube-api-access-c6tfl\") pod \"cert-manager-55b4d954d5-9zwdv\" (UID: \"cb077536-4d37-4200-8d7c-9bc145670c12\") " pod="cert-manager/cert-manager-55b4d954d5-9zwdv" Jul 03 19:16:06.153448 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.153445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb077536-4d37-4200-8d7c-9bc145670c12-bound-sa-token\") pod \"cert-manager-55b4d954d5-9zwdv\" (UID: \"cb077536-4d37-4200-8d7c-9bc145670c12\") " pod="cert-manager/cert-manager-55b4d954d5-9zwdv" Jul 03 19:16:06.161348 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.161319 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb077536-4d37-4200-8d7c-9bc145670c12-bound-sa-token\") pod \"cert-manager-55b4d954d5-9zwdv\" (UID: \"cb077536-4d37-4200-8d7c-9bc145670c12\") " pod="cert-manager/cert-manager-55b4d954d5-9zwdv" Jul 03 19:16:06.161675 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.161658 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6tfl\" (UniqueName: \"kubernetes.io/projected/cb077536-4d37-4200-8d7c-9bc145670c12-kube-api-access-c6tfl\") pod \"cert-manager-55b4d954d5-9zwdv\" (UID: \"cb077536-4d37-4200-8d7c-9bc145670c12\") " pod="cert-manager/cert-manager-55b4d954d5-9zwdv" Jul 03 19:16:06.273504 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.273472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9" event={"ID":"ee07f762-d664-4059-8c24-654385481971","Type":"ContainerStarted","Data":"e5ef71b1bf16b563765bb84138848e041a6dbc0ee3461afe356c3fef734b0bd2"} Jul 03 19:16:06.288456 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.288403 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g7rl9" podStartSLOduration=1.6696637060000001 podStartE2EDuration="4.288387289s" totalImagesPullingTime="2.618723583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:06.287584612 +0000 UTC m=+373.924330294" watchObservedRunningTime="2026-07-03 19:16:06.288387289 +0000 UTC m=+373.925132969" Jul 03 19:16:06.355942 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.355910 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9zwdv" Jul 03 19:16:06.482584 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:06.482550 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9zwdv"] Jul 03 19:16:06.485970 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:16:06.485940 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb077536_4d37_4200_8d7c_9bc145670c12.slice/crio-99a2fc94a54e8eb56edd8a350858b6291f4e23badf09edd7f25c155a907cd969 WatchSource:0}: Error finding container 99a2fc94a54e8eb56edd8a350858b6291f4e23badf09edd7f25c155a907cd969: Status 404 returned error can't find the container with id 99a2fc94a54e8eb56edd8a350858b6291f4e23badf09edd7f25c155a907cd969 Jul 03 19:16:07.278696 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:07.278656 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9zwdv" event={"ID":"cb077536-4d37-4200-8d7c-9bc145670c12","Type":"ContainerStarted","Data":"b8c1ceb419f780b79c495744946e232538d052281f2d8f4dac5342c8803781ee"} Jul 03 19:16:07.278696 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:07.278701 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9zwdv" event={"ID":"cb077536-4d37-4200-8d7c-9bc145670c12","Type":"ContainerStarted","Data":"99a2fc94a54e8eb56edd8a350858b6291f4e23badf09edd7f25c155a907cd969"} Jul 03 19:16:07.294180 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:07.294129 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9zwdv" podStartSLOduration=1.294114547 podStartE2EDuration="1.294114547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:07.293141123 +0000 UTC m=+374.929886804" watchObservedRunningTime="2026-07-03 19:16:07.294114547 +0000 UTC m=+374.930860228" Jul 03 19:16:17.688052 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.688012 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j"] Jul 03 19:16:17.690039 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.690023 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" Jul 03 19:16:17.692289 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.692262 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 03 19:16:17.692525 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.692504 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 03 19:16:17.693198 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.693180 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pqjjr\"" Jul 03 19:16:17.698607 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.698582 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j"] Jul 03 19:16:17.728990 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.728957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t69tr\" (UniqueName: \"kubernetes.io/projected/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-kube-api-access-t69tr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j\" (UID: \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" Jul 03 19:16:17.729146 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.729008 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j\" (UID: \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" Jul 03 19:16:17.729146 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.729030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j\" (UID: \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" Jul 03 19:16:17.829799 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.829748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j\" (UID: \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" Jul 03 19:16:17.829799 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.829799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j\" (UID: \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" Jul 03 19:16:17.830035 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.829843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t69tr\" (UniqueName: \"kubernetes.io/projected/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-kube-api-access-t69tr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j\" (UID: \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" Jul 03 19:16:17.830266 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.830235 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j\" (UID: \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" Jul 03 19:16:17.830266 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.830257 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j\" (UID: \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" Jul 03 19:16:17.837822 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.837797 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t69tr\" (UniqueName: \"kubernetes.io/projected/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-kube-api-access-t69tr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j\" (UID: \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" Jul 03 19:16:18.000007 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:17.999924 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" Jul 03 19:16:18.128917 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:18.128860 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j"] Jul 03 19:16:18.131583 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:16:18.131552 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1bcbeef_29b1_4a81_bedf_1cf0d68136a7.slice/crio-6b70be0868452b854168a3b5de31de0f246ebc398f5e13273237914005c27874 WatchSource:0}: Error finding container 6b70be0868452b854168a3b5de31de0f246ebc398f5e13273237914005c27874: Status 404 returned error can't find the container with id 6b70be0868452b854168a3b5de31de0f246ebc398f5e13273237914005c27874 Jul 03 19:16:18.322575 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:18.322488 2580 generic.go:356] "Generic (PLEG): container finished" podID="d1bcbeef-29b1-4a81-bedf-1cf0d68136a7" containerID="5cd1eced9a6fb3c8b2d0a6e60b97998d420589aecc174c4b0122d9513deb0336" exitCode=0 Jul 03 19:16:18.322721 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:18.322579 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" event={"ID":"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7","Type":"ContainerDied","Data":"5cd1eced9a6fb3c8b2d0a6e60b97998d420589aecc174c4b0122d9513deb0336"} Jul 03 19:16:18.322721 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:18.322631 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" event={"ID":"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7","Type":"ContainerStarted","Data":"6b70be0868452b854168a3b5de31de0f246ebc398f5e13273237914005c27874"} Jul 03 19:16:19.327826 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:19.327736 2580 generic.go:356] "Generic (PLEG): container finished" podID="d1bcbeef-29b1-4a81-bedf-1cf0d68136a7" containerID="d22e4a4c0dbdabbed7f9265816ca07850983fc96ca3c6c83f8f629e8b94d1cce" exitCode=0 Jul 03 19:16:19.327826 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:19.327796 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" event={"ID":"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7","Type":"ContainerDied","Data":"d22e4a4c0dbdabbed7f9265816ca07850983fc96ca3c6c83f8f629e8b94d1cce"} Jul 03 19:16:20.334456 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:20.334420 2580 generic.go:356] "Generic (PLEG): container finished" podID="d1bcbeef-29b1-4a81-bedf-1cf0d68136a7" containerID="30c3ca8af59a412049066add247a5ba780511469f3a20e4d53964ddf8c274893" exitCode=0 Jul 03 19:16:20.334839 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:20.334482 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" event={"ID":"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7","Type":"ContainerDied","Data":"30c3ca8af59a412049066add247a5ba780511469f3a20e4d53964ddf8c274893"} Jul 03 19:16:21.462000 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:21.461974 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" Jul 03 19:16:21.553319 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:21.553284 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-bundle\") pod \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\" (UID: \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\") " Jul 03 19:16:21.553487 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:21.553334 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t69tr\" (UniqueName: \"kubernetes.io/projected/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-kube-api-access-t69tr\") pod \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\" (UID: \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\") " Jul 03 19:16:21.553487 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:21.553386 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-util\") pod \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\" (UID: \"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7\") " Jul 03 19:16:21.554060 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:21.554033 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-bundle" (OuterVolumeSpecName: "bundle") pod "d1bcbeef-29b1-4a81-bedf-1cf0d68136a7" (UID: "d1bcbeef-29b1-4a81-bedf-1cf0d68136a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:16:21.555446 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:21.555412 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-kube-api-access-t69tr" (OuterVolumeSpecName: "kube-api-access-t69tr") pod "d1bcbeef-29b1-4a81-bedf-1cf0d68136a7" (UID: "d1bcbeef-29b1-4a81-bedf-1cf0d68136a7"). InnerVolumeSpecName "kube-api-access-t69tr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:16:21.558508 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:21.558476 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-util" (OuterVolumeSpecName: "util") pod "d1bcbeef-29b1-4a81-bedf-1cf0d68136a7" (UID: "d1bcbeef-29b1-4a81-bedf-1cf0d68136a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:16:21.653865 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:21.653763 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-util\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:16:21.653865 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:21.653805 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-bundle\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:16:21.653865 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:21.653815 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t69tr\" (UniqueName: \"kubernetes.io/projected/d1bcbeef-29b1-4a81-bedf-1cf0d68136a7-kube-api-access-t69tr\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:16:22.344656 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:22.344630 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" Jul 03 19:16:22.344656 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:22.344639 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af72v2j" event={"ID":"d1bcbeef-29b1-4a81-bedf-1cf0d68136a7","Type":"ContainerDied","Data":"6b70be0868452b854168a3b5de31de0f246ebc398f5e13273237914005c27874"} Jul 03 19:16:22.344862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:22.344678 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b70be0868452b854168a3b5de31de0f246ebc398f5e13273237914005c27874" Jul 03 19:16:30.404328 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.404287 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr"] Jul 03 19:16:30.404814 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.404687 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1bcbeef-29b1-4a81-bedf-1cf0d68136a7" containerName="util" Jul 03 19:16:30.404814 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.404706 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1bcbeef-29b1-4a81-bedf-1cf0d68136a7" containerName="util" Jul 03 19:16:30.404814 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.404722 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1bcbeef-29b1-4a81-bedf-1cf0d68136a7" containerName="pull" Jul 03 19:16:30.404814 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.404730 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1bcbeef-29b1-4a81-bedf-1cf0d68136a7" containerName="pull" Jul 03 19:16:30.404814 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.404739 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1bcbeef-29b1-4a81-bedf-1cf0d68136a7" containerName="extract" Jul 03 19:16:30.404814 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.404746 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1bcbeef-29b1-4a81-bedf-1cf0d68136a7" containerName="extract" Jul 03 19:16:30.404814 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.404807 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1bcbeef-29b1-4a81-bedf-1cf0d68136a7" containerName="extract" Jul 03 19:16:30.407056 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.407033 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.409657 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.409637 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 03 19:16:30.409765 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.409727 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 03 19:16:30.409831 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.409781 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 03 19:16:30.410031 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.410018 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 03 19:16:30.410572 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.410559 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-km28h\"" Jul 03 19:16:30.434818 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.434783 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr"] Jul 03 19:16:30.508356 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.508319 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/869da249-1133-4a15-aa95-2eaf39678016-webhook-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.508356 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.508363 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/869da249-1133-4a15-aa95-2eaf39678016-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.508580 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.508393 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/869da249-1133-4a15-aa95-2eaf39678016-tmp\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.508580 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.508415 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/869da249-1133-4a15-aa95-2eaf39678016-manifests\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.508580 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.508432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxl2s\" (UniqueName: \"kubernetes.io/projected/869da249-1133-4a15-aa95-2eaf39678016-kube-api-access-nxl2s\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.609522 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.609485 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/869da249-1133-4a15-aa95-2eaf39678016-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.609744 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.609536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/869da249-1133-4a15-aa95-2eaf39678016-tmp\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.609744 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.609560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/869da249-1133-4a15-aa95-2eaf39678016-manifests\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.609744 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.609577 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxl2s\" (UniqueName: \"kubernetes.io/projected/869da249-1133-4a15-aa95-2eaf39678016-kube-api-access-nxl2s\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.609744 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.609605 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/869da249-1133-4a15-aa95-2eaf39678016-webhook-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.610147 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.610121 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/869da249-1133-4a15-aa95-2eaf39678016-manifests\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.612001 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.611976 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/869da249-1133-4a15-aa95-2eaf39678016-tmp\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.612106 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.612088 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/869da249-1133-4a15-aa95-2eaf39678016-webhook-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.612224 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.612206 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/869da249-1133-4a15-aa95-2eaf39678016-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.618362 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.618337 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxl2s\" (UniqueName: \"kubernetes.io/projected/869da249-1133-4a15-aa95-2eaf39678016-kube-api-access-nxl2s\") pod \"opendatahub-operator-controller-manager-5db468f498-7jmzr\" (UID: \"869da249-1133-4a15-aa95-2eaf39678016\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.716981 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.716892 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:30.852234 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:30.852207 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr"] Jul 03 19:16:30.854867 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:16:30.854833 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869da249_1133_4a15_aa95_2eaf39678016.slice/crio-1ed984165e438ddbdb3f2e6954b804c3f6f5f7f507ee505305aa8966cfe6701d WatchSource:0}: Error finding container 1ed984165e438ddbdb3f2e6954b804c3f6f5f7f507ee505305aa8966cfe6701d: Status 404 returned error can't find the container with id 1ed984165e438ddbdb3f2e6954b804c3f6f5f7f507ee505305aa8966cfe6701d Jul 03 19:16:31.380673 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:31.380639 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" event={"ID":"869da249-1133-4a15-aa95-2eaf39678016","Type":"ContainerStarted","Data":"1ed984165e438ddbdb3f2e6954b804c3f6f5f7f507ee505305aa8966cfe6701d"} Jul 03 19:16:34.398304 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:34.398269 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" event={"ID":"869da249-1133-4a15-aa95-2eaf39678016","Type":"ContainerStarted","Data":"8d1d3e3fbc39da97f59af2f8bf9a3c004fb01c494e0c795a0fb742d3bace27a5"} Jul 03 19:16:35.403397 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:35.403367 2580 generic.go:356] "Generic (PLEG): container finished" podID="869da249-1133-4a15-aa95-2eaf39678016" containerID="8d1d3e3fbc39da97f59af2f8bf9a3c004fb01c494e0c795a0fb742d3bace27a5" exitCode=0 Jul 03 19:16:35.403799 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:35.403453 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" event={"ID":"869da249-1133-4a15-aa95-2eaf39678016","Type":"ContainerDied","Data":"8d1d3e3fbc39da97f59af2f8bf9a3c004fb01c494e0c795a0fb742d3bace27a5"} Jul 03 19:16:36.410093 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:36.410048 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" event={"ID":"869da249-1133-4a15-aa95-2eaf39678016","Type":"ContainerStarted","Data":"3a0325eecddd3c0a38dac1559806645aa8aa9cee394b1956735ccb929303b407"} Jul 03 19:16:36.410493 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:36.410155 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:36.431459 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:36.431401 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" podStartSLOduration=2.241922629 podStartE2EDuration="6.431385588s" totalImagesPullingTime="3.156568427s" totalInitContainerRuntime="1.032894532s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:36.429239958 +0000 UTC m=+404.065985663" watchObservedRunningTime="2026-07-03 19:16:36.431385588 +0000 UTC m=+404.068131269" Jul 03 19:16:47.416693 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:47.416660 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-7jmzr" Jul 03 19:16:49.727182 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.727145 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f"] Jul 03 19:16:49.730116 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.730097 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:49.732439 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.732411 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 03 19:16:49.732584 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.732476 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 03 19:16:49.733383 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.733362 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:16:49.733503 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.733364 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-48kph\"" Jul 03 19:16:49.733503 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.733399 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 03 19:16:49.733503 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.733408 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 03 19:16:49.742495 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.742471 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f"] Jul 03 19:16:49.761585 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.761560 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/95a63379-50c4-4ca7-bb91-6f58bf317dae-manager-config\") pod \"lws-controller-manager-569d79d5df-bcd4f\" (UID: \"95a63379-50c4-4ca7-bb91-6f58bf317dae\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:49.761718 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.761596 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/95a63379-50c4-4ca7-bb91-6f58bf317dae-metrics-cert\") pod \"lws-controller-manager-569d79d5df-bcd4f\" (UID: \"95a63379-50c4-4ca7-bb91-6f58bf317dae\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:49.761718 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.761623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x22fk\" (UniqueName: \"kubernetes.io/projected/95a63379-50c4-4ca7-bb91-6f58bf317dae-kube-api-access-x22fk\") pod \"lws-controller-manager-569d79d5df-bcd4f\" (UID: \"95a63379-50c4-4ca7-bb91-6f58bf317dae\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:49.761800 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.761711 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95a63379-50c4-4ca7-bb91-6f58bf317dae-cert\") pod \"lws-controller-manager-569d79d5df-bcd4f\" (UID: \"95a63379-50c4-4ca7-bb91-6f58bf317dae\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:49.862312 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.862268 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/95a63379-50c4-4ca7-bb91-6f58bf317dae-manager-config\") pod \"lws-controller-manager-569d79d5df-bcd4f\" (UID: \"95a63379-50c4-4ca7-bb91-6f58bf317dae\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:49.862312 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.862316 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/95a63379-50c4-4ca7-bb91-6f58bf317dae-metrics-cert\") pod \"lws-controller-manager-569d79d5df-bcd4f\" (UID: \"95a63379-50c4-4ca7-bb91-6f58bf317dae\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:49.862564 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.862355 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x22fk\" (UniqueName: \"kubernetes.io/projected/95a63379-50c4-4ca7-bb91-6f58bf317dae-kube-api-access-x22fk\") pod \"lws-controller-manager-569d79d5df-bcd4f\" (UID: \"95a63379-50c4-4ca7-bb91-6f58bf317dae\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:49.862564 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.862402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95a63379-50c4-4ca7-bb91-6f58bf317dae-cert\") pod \"lws-controller-manager-569d79d5df-bcd4f\" (UID: \"95a63379-50c4-4ca7-bb91-6f58bf317dae\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:49.863166 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.863141 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/95a63379-50c4-4ca7-bb91-6f58bf317dae-manager-config\") pod \"lws-controller-manager-569d79d5df-bcd4f\" (UID: \"95a63379-50c4-4ca7-bb91-6f58bf317dae\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:49.864904 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.864865 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/95a63379-50c4-4ca7-bb91-6f58bf317dae-metrics-cert\") pod \"lws-controller-manager-569d79d5df-bcd4f\" (UID: \"95a63379-50c4-4ca7-bb91-6f58bf317dae\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:49.864990 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.864948 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95a63379-50c4-4ca7-bb91-6f58bf317dae-cert\") pod \"lws-controller-manager-569d79d5df-bcd4f\" (UID: \"95a63379-50c4-4ca7-bb91-6f58bf317dae\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:49.870562 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:49.870537 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x22fk\" (UniqueName: \"kubernetes.io/projected/95a63379-50c4-4ca7-bb91-6f58bf317dae-kube-api-access-x22fk\") pod \"lws-controller-manager-569d79d5df-bcd4f\" (UID: \"95a63379-50c4-4ca7-bb91-6f58bf317dae\") " pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:50.039810 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:50.039706 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:50.169828 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:50.169706 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f"] Jul 03 19:16:50.172508 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:16:50.172477 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a63379_50c4_4ca7_bb91_6f58bf317dae.slice/crio-d18e00158513aa83af471dc6266c3542054396ce82a8d6f05fbaf8db04046649 WatchSource:0}: Error finding container d18e00158513aa83af471dc6266c3542054396ce82a8d6f05fbaf8db04046649: Status 404 returned error can't find the container with id d18e00158513aa83af471dc6266c3542054396ce82a8d6f05fbaf8db04046649 Jul 03 19:16:50.468465 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:50.468425 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" event={"ID":"95a63379-50c4-4ca7-bb91-6f58bf317dae","Type":"ContainerStarted","Data":"d18e00158513aa83af471dc6266c3542054396ce82a8d6f05fbaf8db04046649"} Jul 03 19:16:52.478308 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:52.478256 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" event={"ID":"95a63379-50c4-4ca7-bb91-6f58bf317dae","Type":"ContainerStarted","Data":"815e8d004eb3b531362ecde33411d09384aa8d0353c334eb8775a1fa1bc6e3c3"} Jul 03 19:16:52.478799 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:52.478347 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:16:52.494722 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:52.494672 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" podStartSLOduration=1.888854045 podStartE2EDuration="3.494655154s" totalImagesPullingTime="1.605801109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:52.494242765 +0000 UTC m=+420.130988464" watchObservedRunningTime="2026-07-03 19:16:52.494655154 +0000 UTC m=+420.131400834" Jul 03 19:16:57.221459 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.221415 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg"] Jul 03 19:16:57.226808 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.226785 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.229166 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.229135 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 03 19:16:57.229338 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.229234 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 03 19:16:57.229404 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.229318 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-56ppn\"" Jul 03 19:16:57.229587 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.229568 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 03 19:16:57.236429 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.236406 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg"] Jul 03 19:16:57.321319 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.321281 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.321319 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.321321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c4wj\" (UniqueName: \"kubernetes.io/projected/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-kube-api-access-6c4wj\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.321554 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.321352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.321554 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.321375 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.321554 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.321456 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.321554 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.321498 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.321554 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.321531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.321732 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.321562 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.321732 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.321599 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.422299 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.422263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.422485 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.422309 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.422485 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.422443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.422485 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.422477 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c4wj\" (UniqueName: \"kubernetes.io/projected/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-kube-api-access-6c4wj\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.422646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.422505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.422646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.422533 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.422646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.422595 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.422646 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.422634 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.422866 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.422671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.423047 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.423019 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.423174 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.423051 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.423174 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.423106 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.423174 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.423133 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.423378 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.423361 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.425136 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.425110 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.425438 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.425418 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.429990 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.429962 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.430352 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.430335 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c4wj\" (UniqueName: \"kubernetes.io/projected/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-kube-api-access-6c4wj\") pod \"data-science-gateway-data-science-gateway-class-548557588-x6mhg\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.523969 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.523886 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r"] Jul 03 19:16:57.530307 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.530277 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.539384 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.539359 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:16:57.541601 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.541579 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r"] Jul 03 19:16:57.624065 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.623534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.624065 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.623578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.624065 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.623634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.624065 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.623669 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.624065 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.623698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.624065 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.623729 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.624065 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.623754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.624065 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.623781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrbp4\" (UniqueName: \"kubernetes.io/projected/5f28f846-a63e-4c64-b48a-9e3286fd46bd-kube-api-access-nrbp4\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.624065 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.623807 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.688220 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.688194 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg"] Jul 03 19:16:57.691132 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:16:57.691104 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ed9574_5dcb_4e18_b74d_d96a77fc23b9.slice/crio-0b7640df4fc1b622522c7b6959682c55913681c0b1394165708151f8eda85827 WatchSource:0}: Error finding container 0b7640df4fc1b622522c7b6959682c55913681c0b1394165708151f8eda85827: Status 404 returned error can't find the container with id 0b7640df4fc1b622522c7b6959682c55913681c0b1394165708151f8eda85827 Jul 03 19:16:57.724373 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.724345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.724523 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.724380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.724523 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.724405 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.724523 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.724432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.724523 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.724460 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrbp4\" (UniqueName: \"kubernetes.io/projected/5f28f846-a63e-4c64-b48a-9e3286fd46bd-kube-api-access-nrbp4\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.724523 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.724488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.724769 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.724536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.724769 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.724557 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.724769 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.724611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.725103 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.725033 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.725103 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.725035 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.725293 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.725185 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.725293 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.725247 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.725410 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.725389 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.726745 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.726724 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.727069 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.727051 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.732226 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.732196 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f28f846-a63e-4c64-b48a-9e3286fd46bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.732338 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.732322 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrbp4\" (UniqueName: \"kubernetes.io/projected/5f28f846-a63e-4c64-b48a-9e3286fd46bd-kube-api-access-nrbp4\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gqt7r\" (UID: \"5f28f846-a63e-4c64-b48a-9e3286fd46bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.841658 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.841623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:16:57.980608 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:57.980573 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r"] Jul 03 19:16:57.982980 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:16:57.982952 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f28f846_a63e_4c64_b48a_9e3286fd46bd.slice/crio-a218d058abc9d7334891730d829dbd129dd520fec4cd90cbe93d81213836e8ef WatchSource:0}: Error finding container a218d058abc9d7334891730d829dbd129dd520fec4cd90cbe93d81213836e8ef: Status 404 returned error can't find the container with id a218d058abc9d7334891730d829dbd129dd520fec4cd90cbe93d81213836e8ef Jul 03 19:16:58.504509 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:58.504463 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" event={"ID":"05ed9574-5dcb-4e18-b74d-d96a77fc23b9","Type":"ContainerStarted","Data":"0b7640df4fc1b622522c7b6959682c55913681c0b1394165708151f8eda85827"} Jul 03 19:16:58.506032 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:16:58.505999 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" event={"ID":"5f28f846-a63e-4c64-b48a-9e3286fd46bd","Type":"ContainerStarted","Data":"a218d058abc9d7334891730d829dbd129dd520fec4cd90cbe93d81213836e8ef"} Jul 03 19:17:00.746553 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:00.746504 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 19:17:00.746848 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:00.746583 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 19:17:00.746848 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:00.746614 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 19:17:00.753034 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:00.752997 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 19:17:00.753127 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:00.753063 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 19:17:00.753127 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:00.753097 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 19:17:01.053786 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.053707 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6"] Jul 03 19:17:01.056806 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.056791 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" Jul 03 19:17:01.059429 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.059404 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 03 19:17:01.059538 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.059414 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5ljdq\"" Jul 03 19:17:01.070759 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.070732 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6"] Jul 03 19:17:01.072935 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.072908 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5"] Jul 03 19:17:01.076246 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.076228 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" Jul 03 19:17:01.079524 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.079020 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dp2cq\"" Jul 03 19:17:01.079524 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.079067 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 03 19:17:01.095006 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.094885 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5"] Jul 03 19:17:01.153223 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.153189 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9k54\" (UniqueName: \"kubernetes.io/projected/e5211f10-77bd-4d1e-8b20-c4e2c578a9d8-kube-api-access-h9k54\") pod \"llmisvc-controller-manager-777c6bd7d5-xkmp5\" (UID: \"e5211f10-77bd-4d1e-8b20-c4e2c578a9d8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" Jul 03 19:17:01.153384 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.153248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkp9z\" (UniqueName: \"kubernetes.io/projected/e7f10adb-7f2a-41c7-ae5b-38da4832f9f3-kube-api-access-dkp9z\") pod \"kserve-controller-manager-d6f4b65b8-nnjh6\" (UID: \"e7f10adb-7f2a-41c7-ae5b-38da4832f9f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" Jul 03 19:17:01.153384 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.153280 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5211f10-77bd-4d1e-8b20-c4e2c578a9d8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xkmp5\" (UID: \"e5211f10-77bd-4d1e-8b20-c4e2c578a9d8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" Jul 03 19:17:01.153384 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.153322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7f10adb-7f2a-41c7-ae5b-38da4832f9f3-cert\") pod \"kserve-controller-manager-d6f4b65b8-nnjh6\" (UID: \"e7f10adb-7f2a-41c7-ae5b-38da4832f9f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" Jul 03 19:17:01.253932 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.253893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7f10adb-7f2a-41c7-ae5b-38da4832f9f3-cert\") pod \"kserve-controller-manager-d6f4b65b8-nnjh6\" (UID: \"e7f10adb-7f2a-41c7-ae5b-38da4832f9f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" Jul 03 19:17:01.254127 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.253955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9k54\" (UniqueName: \"kubernetes.io/projected/e5211f10-77bd-4d1e-8b20-c4e2c578a9d8-kube-api-access-h9k54\") pod \"llmisvc-controller-manager-777c6bd7d5-xkmp5\" (UID: \"e5211f10-77bd-4d1e-8b20-c4e2c578a9d8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" Jul 03 19:17:01.254127 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.254011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkp9z\" (UniqueName: \"kubernetes.io/projected/e7f10adb-7f2a-41c7-ae5b-38da4832f9f3-kube-api-access-dkp9z\") pod \"kserve-controller-manager-d6f4b65b8-nnjh6\" (UID: \"e7f10adb-7f2a-41c7-ae5b-38da4832f9f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" Jul 03 19:17:01.254127 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.254037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5211f10-77bd-4d1e-8b20-c4e2c578a9d8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xkmp5\" (UID: \"e5211f10-77bd-4d1e-8b20-c4e2c578a9d8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" Jul 03 19:17:01.254280 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:17:01.254205 2580 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 03 19:17:01.254280 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:17:01.254274 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5211f10-77bd-4d1e-8b20-c4e2c578a9d8-cert podName:e5211f10-77bd-4d1e-8b20-c4e2c578a9d8 nodeName:}" failed. No retries permitted until 2026-07-03 19:17:01.75425201 +0000 UTC m=+429.390997674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e5211f10-77bd-4d1e-8b20-c4e2c578a9d8-cert") pod "llmisvc-controller-manager-777c6bd7d5-xkmp5" (UID: "e5211f10-77bd-4d1e-8b20-c4e2c578a9d8") : secret "llmisvc-webhook-server-cert" not found Jul 03 19:17:01.254608 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:17:01.254585 2580 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 03 19:17:01.254803 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:17:01.254644 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f10adb-7f2a-41c7-ae5b-38da4832f9f3-cert podName:e7f10adb-7f2a-41c7-ae5b-38da4832f9f3 nodeName:}" failed. No retries permitted until 2026-07-03 19:17:01.754627352 +0000 UTC m=+429.391373026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e7f10adb-7f2a-41c7-ae5b-38da4832f9f3-cert") pod "kserve-controller-manager-d6f4b65b8-nnjh6" (UID: "e7f10adb-7f2a-41c7-ae5b-38da4832f9f3") : secret "kserve-webhook-server-cert" not found Jul 03 19:17:01.269095 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.269058 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9k54\" (UniqueName: \"kubernetes.io/projected/e5211f10-77bd-4d1e-8b20-c4e2c578a9d8-kube-api-access-h9k54\") pod \"llmisvc-controller-manager-777c6bd7d5-xkmp5\" (UID: \"e5211f10-77bd-4d1e-8b20-c4e2c578a9d8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" Jul 03 19:17:01.269908 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.269866 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkp9z\" (UniqueName: \"kubernetes.io/projected/e7f10adb-7f2a-41c7-ae5b-38da4832f9f3-kube-api-access-dkp9z\") pod \"kserve-controller-manager-d6f4b65b8-nnjh6\" (UID: \"e7f10adb-7f2a-41c7-ae5b-38da4832f9f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" Jul 03 19:17:01.522222 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.522184 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" event={"ID":"05ed9574-5dcb-4e18-b74d-d96a77fc23b9","Type":"ContainerStarted","Data":"a406dfc60a4ec6eed2c0a90d5364bf5acd9a86c76fa8218aad36cd6e9a97a707"} Jul 03 19:17:01.523766 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.523739 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" event={"ID":"5f28f846-a63e-4c64-b48a-9e3286fd46bd","Type":"ContainerStarted","Data":"71808ce111ab6a64797708e9f019b10781d7a265b70b1dfb4468a74e88574fd8"} Jul 03 19:17:01.540402 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.540373 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:17:01.541700 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.541678 2580 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-x6mhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body= Jul 03 19:17:01.541770 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.541724 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" podUID="05ed9574-5dcb-4e18-b74d-d96a77fc23b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" Jul 03 19:17:01.585638 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.585583 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" podStartSLOduration=1.532515482 podStartE2EDuration="4.585566055s" totalImagesPullingTime="3.053050573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:17:01.584905364 +0000 UTC m=+429.221651036" watchObservedRunningTime="2026-07-03 19:17:01.585566055 +0000 UTC m=+429.222311736" Jul 03 19:17:01.608330 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.608276 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" podStartSLOduration=1.84056773 podStartE2EDuration="4.608259885s" totalImagesPullingTime="2.767692155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:17:01.607453552 +0000 UTC m=+429.244199238" watchObservedRunningTime="2026-07-03 19:17:01.608259885 +0000 UTC m=+429.245005565" Jul 03 19:17:01.759075 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.759033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5211f10-77bd-4d1e-8b20-c4e2c578a9d8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xkmp5\" (UID: \"e5211f10-77bd-4d1e-8b20-c4e2c578a9d8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" Jul 03 19:17:01.759447 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.759096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7f10adb-7f2a-41c7-ae5b-38da4832f9f3-cert\") pod \"kserve-controller-manager-d6f4b65b8-nnjh6\" (UID: \"e7f10adb-7f2a-41c7-ae5b-38da4832f9f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" Jul 03 19:17:01.761471 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.761438 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7f10adb-7f2a-41c7-ae5b-38da4832f9f3-cert\") pod \"kserve-controller-manager-d6f4b65b8-nnjh6\" (UID: \"e7f10adb-7f2a-41c7-ae5b-38da4832f9f3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" Jul 03 19:17:01.761613 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.761590 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5211f10-77bd-4d1e-8b20-c4e2c578a9d8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xkmp5\" (UID: \"e5211f10-77bd-4d1e-8b20-c4e2c578a9d8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" Jul 03 19:17:01.842564 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.842532 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:17:01.846909 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.846886 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:17:01.968995 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.968957 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" Jul 03 19:17:01.994404 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:01.994375 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" Jul 03 19:17:02.109472 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:02.109383 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6"] Jul 03 19:17:02.111599 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:17:02.111565 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f10adb_7f2a_41c7_ae5b_38da4832f9f3.slice/crio-b8daf0f102f97f3665c7f815f501479afdea97057e66ea0785f36c5dcbdb81c6 WatchSource:0}: Error finding container b8daf0f102f97f3665c7f815f501479afdea97057e66ea0785f36c5dcbdb81c6: Status 404 returned error can't find the container with id b8daf0f102f97f3665c7f815f501479afdea97057e66ea0785f36c5dcbdb81c6 Jul 03 19:17:02.133796 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:02.133773 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5"] Jul 03 19:17:02.136242 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:17:02.136212 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode5211f10_77bd_4d1e_8b20_c4e2c578a9d8.slice/crio-d053808a3d00026ed84839e04c5267429bcd7c68e95b825ca7cb4aafdc08d21e WatchSource:0}: Error finding container d053808a3d00026ed84839e04c5267429bcd7c68e95b825ca7cb4aafdc08d21e: Status 404 returned error can't find the container with id d053808a3d00026ed84839e04c5267429bcd7c68e95b825ca7cb4aafdc08d21e Jul 03 19:17:02.529563 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:02.529467 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" event={"ID":"e5211f10-77bd-4d1e-8b20-c4e2c578a9d8","Type":"ContainerStarted","Data":"d053808a3d00026ed84839e04c5267429bcd7c68e95b825ca7cb4aafdc08d21e"} Jul 03 19:17:02.530655 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:02.530627 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" event={"ID":"e7f10adb-7f2a-41c7-ae5b-38da4832f9f3","Type":"ContainerStarted","Data":"b8daf0f102f97f3665c7f815f501479afdea97057e66ea0785f36c5dcbdb81c6"} Jul 03 19:17:02.530825 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:02.530808 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:17:02.531891 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:02.531853 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gqt7r" Jul 03 19:17:02.540282 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:02.540262 2580 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-x6mhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body= Jul 03 19:17:02.540363 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:02.540301 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" podUID="05ed9574-5dcb-4e18-b74d-d96a77fc23b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" Jul 03 19:17:02.586483 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:02.586452 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg"] Jul 03 19:17:03.484946 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:03.484913 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-569d79d5df-bcd4f" Jul 03 19:17:03.540430 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:03.540392 2580 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-x6mhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body= Jul 03 19:17:03.540616 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:03.540467 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" podUID="05ed9574-5dcb-4e18-b74d-d96a77fc23b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" Jul 03 19:17:04.539894 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:04.539837 2580 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-x6mhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body= Jul 03 19:17:04.540371 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:04.539924 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" podUID="05ed9574-5dcb-4e18-b74d-d96a77fc23b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" Jul 03 19:17:04.542264 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:04.542212 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" podUID="05ed9574-5dcb-4e18-b74d-d96a77fc23b9" containerName="istio-proxy" containerID="cri-o://a406dfc60a4ec6eed2c0a90d5364bf5acd9a86c76fa8218aad36cd6e9a97a707" gracePeriod=30 Jul 03 19:17:05.548313 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:05.548279 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" event={"ID":"e5211f10-77bd-4d1e-8b20-c4e2c578a9d8","Type":"ContainerStarted","Data":"7bde76240ec15d9569d20e3cfa3ed85dbb64db6bdf3ffef28bff4eb8e5cf0c7e"} Jul 03 19:17:05.548726 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:05.548408 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" Jul 03 19:17:05.549903 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:05.549867 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" event={"ID":"e7f10adb-7f2a-41c7-ae5b-38da4832f9f3","Type":"ContainerStarted","Data":"33bf11ca39ec194591f377041b65b52edcaf8163bb684b84fdfb95d091f2e7f1"} Jul 03 19:17:05.550010 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:05.549998 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" Jul 03 19:17:05.565510 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:05.565469 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" podStartSLOduration=1.343920265 podStartE2EDuration="4.565455966s" totalImagesPullingTime="3.221535701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:17:05.564108725 +0000 UTC m=+433.200854419" watchObservedRunningTime="2026-07-03 19:17:05.565455966 +0000 UTC m=+433.202201650" Jul 03 19:17:05.580849 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:05.580801 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" podStartSLOduration=1.923346221 podStartE2EDuration="4.580785743s" totalImagesPullingTime="2.657439522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:17:05.579137441 +0000 UTC m=+433.215883122" watchObservedRunningTime="2026-07-03 19:17:05.580785743 +0000 UTC m=+433.217531424" Jul 03 19:17:09.788398 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.788371 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:17:09.930701 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.930657 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-token\") pod \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " Jul 03 19:17:09.930925 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.930758 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-credential-socket\") pod \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " Jul 03 19:17:09.930925 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.930781 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-workload-socket\") pod \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " Jul 03 19:17:09.930925 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.930804 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-data\") pod \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " Jul 03 19:17:09.930925 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.930825 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-workload-certs\") pod \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " Jul 03 19:17:09.930925 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.930867 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istiod-ca-cert\") pod \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " Jul 03 19:17:09.931192 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.930935 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6c4wj\" (UniqueName: \"kubernetes.io/projected/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-kube-api-access-6c4wj\") pod \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " Jul 03 19:17:09.931192 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.930975 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-podinfo\") pod \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " Jul 03 19:17:09.931192 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.931002 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-envoy\") pod \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\" (UID: \"05ed9574-5dcb-4e18-b74d-d96a77fc23b9\") " Jul 03 19:17:09.931322 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.931166 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05ed9574-5dcb-4e18-b74d-d96a77fc23b9" (UID: "05ed9574-5dcb-4e18-b74d-d96a77fc23b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:17:09.931322 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.931196 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05ed9574-5dcb-4e18-b74d-d96a77fc23b9" (UID: "05ed9574-5dcb-4e18-b74d-d96a77fc23b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:17:09.931322 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.931235 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "05ed9574-5dcb-4e18-b74d-d96a77fc23b9" (UID: "05ed9574-5dcb-4e18-b74d-d96a77fc23b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:17:09.931322 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.931250 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05ed9574-5dcb-4e18-b74d-d96a77fc23b9" (UID: "05ed9574-5dcb-4e18-b74d-d96a77fc23b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:17:09.931580 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.931556 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05ed9574-5dcb-4e18-b74d-d96a77fc23b9" (UID: "05ed9574-5dcb-4e18-b74d-d96a77fc23b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:17:09.933176 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.933146 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "05ed9574-5dcb-4e18-b74d-d96a77fc23b9" (UID: "05ed9574-5dcb-4e18-b74d-d96a77fc23b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:17:09.933279 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.933257 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05ed9574-5dcb-4e18-b74d-d96a77fc23b9" (UID: "05ed9574-5dcb-4e18-b74d-d96a77fc23b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:17:09.933536 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.933511 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05ed9574-5dcb-4e18-b74d-d96a77fc23b9" (UID: "05ed9574-5dcb-4e18-b74d-d96a77fc23b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 03 19:17:09.933624 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:09.933517 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-kube-api-access-6c4wj" (OuterVolumeSpecName: "kube-api-access-6c4wj") pod "05ed9574-5dcb-4e18-b74d-d96a77fc23b9" (UID: "05ed9574-5dcb-4e18-b74d-d96a77fc23b9"). InnerVolumeSpecName "kube-api-access-6c4wj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:17:10.031709 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.031670 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-workload-socket\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:17:10.031709 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.031702 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-data\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:17:10.031709 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.031713 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-workload-certs\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:17:10.031709 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.031721 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istiod-ca-cert\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:17:10.032004 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.031731 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6c4wj\" (UniqueName: \"kubernetes.io/projected/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-kube-api-access-6c4wj\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:17:10.032004 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.031739 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-podinfo\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:17:10.032004 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.031747 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-envoy\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:17:10.032004 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.031754 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-istio-token\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:17:10.032004 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.031762 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ed9574-5dcb-4e18-b74d-d96a77fc23b9-credential-socket\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:17:10.573282 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.573245 2580 generic.go:356] "Generic (PLEG): container finished" podID="05ed9574-5dcb-4e18-b74d-d96a77fc23b9" containerID="a406dfc60a4ec6eed2c0a90d5364bf5acd9a86c76fa8218aad36cd6e9a97a707" exitCode=0 Jul 03 19:17:10.573485 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.573321 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" Jul 03 19:17:10.573485 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.573323 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" event={"ID":"05ed9574-5dcb-4e18-b74d-d96a77fc23b9","Type":"ContainerDied","Data":"a406dfc60a4ec6eed2c0a90d5364bf5acd9a86c76fa8218aad36cd6e9a97a707"} Jul 03 19:17:10.573485 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.573400 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg" event={"ID":"05ed9574-5dcb-4e18-b74d-d96a77fc23b9","Type":"ContainerDied","Data":"0b7640df4fc1b622522c7b6959682c55913681c0b1394165708151f8eda85827"} Jul 03 19:17:10.573485 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.573423 2580 scope.go:117] "RemoveContainer" containerID="a406dfc60a4ec6eed2c0a90d5364bf5acd9a86c76fa8218aad36cd6e9a97a707" Jul 03 19:17:10.581727 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.581710 2580 scope.go:117] "RemoveContainer" containerID="a406dfc60a4ec6eed2c0a90d5364bf5acd9a86c76fa8218aad36cd6e9a97a707" Jul 03 19:17:10.582058 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:17:10.582030 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a406dfc60a4ec6eed2c0a90d5364bf5acd9a86c76fa8218aad36cd6e9a97a707\": container with ID starting with a406dfc60a4ec6eed2c0a90d5364bf5acd9a86c76fa8218aad36cd6e9a97a707 not found: ID does not exist" containerID="a406dfc60a4ec6eed2c0a90d5364bf5acd9a86c76fa8218aad36cd6e9a97a707" Jul 03 19:17:10.582132 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.582066 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a406dfc60a4ec6eed2c0a90d5364bf5acd9a86c76fa8218aad36cd6e9a97a707"} err="failed to get container status \"a406dfc60a4ec6eed2c0a90d5364bf5acd9a86c76fa8218aad36cd6e9a97a707\": rpc error: code = NotFound desc = could not find container \"a406dfc60a4ec6eed2c0a90d5364bf5acd9a86c76fa8218aad36cd6e9a97a707\": container with ID starting with a406dfc60a4ec6eed2c0a90d5364bf5acd9a86c76fa8218aad36cd6e9a97a707 not found: ID does not exist" Jul 03 19:17:10.596466 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.596438 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg"] Jul 03 19:17:10.600381 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.600356 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-x6mhg"] Jul 03 19:17:10.870073 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:10.870044 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05ed9574-5dcb-4e18-b74d-d96a77fc23b9" path="/var/lib/kubelet/pods/05ed9574-5dcb-4e18-b74d-d96a77fc23b9/volumes" Jul 03 19:17:36.557134 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:36.557099 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xkmp5" Jul 03 19:17:36.560055 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:17:36.560035 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nnjh6" Jul 03 19:18:06.486045 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.486003 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf"] Jul 03 19:18:06.486569 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.486312 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ed9574-5dcb-4e18-b74d-d96a77fc23b9" containerName="istio-proxy" Jul 03 19:18:06.486569 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.486324 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ed9574-5dcb-4e18-b74d-d96a77fc23b9" containerName="istio-proxy" Jul 03 19:18:06.486569 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.486381 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="05ed9574-5dcb-4e18-b74d-d96a77fc23b9" containerName="istio-proxy" Jul 03 19:18:06.489082 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.489065 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" Jul 03 19:18:06.491256 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.491232 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 03 19:18:06.491381 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.491299 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4g74m\"" Jul 03 19:18:06.492142 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.492122 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 03 19:18:06.497369 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.497349 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf"] Jul 03 19:18:06.573503 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.573471 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5629b139-7406-4898-82ee-cab19e9862eb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf\" (UID: \"5629b139-7406-4898-82ee-cab19e9862eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" Jul 03 19:18:06.573675 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.573521 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5629b139-7406-4898-82ee-cab19e9862eb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf\" (UID: \"5629b139-7406-4898-82ee-cab19e9862eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" Jul 03 19:18:06.573675 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.573570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc9nd\" (UniqueName: \"kubernetes.io/projected/5629b139-7406-4898-82ee-cab19e9862eb-kube-api-access-jc9nd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf\" (UID: \"5629b139-7406-4898-82ee-cab19e9862eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" Jul 03 19:18:06.674194 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.674149 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5629b139-7406-4898-82ee-cab19e9862eb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf\" (UID: \"5629b139-7406-4898-82ee-cab19e9862eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" Jul 03 19:18:06.674372 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.674210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5629b139-7406-4898-82ee-cab19e9862eb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf\" (UID: \"5629b139-7406-4898-82ee-cab19e9862eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" Jul 03 19:18:06.674372 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.674242 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9nd\" (UniqueName: \"kubernetes.io/projected/5629b139-7406-4898-82ee-cab19e9862eb-kube-api-access-jc9nd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf\" (UID: \"5629b139-7406-4898-82ee-cab19e9862eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" Jul 03 19:18:06.674529 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.674510 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5629b139-7406-4898-82ee-cab19e9862eb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf\" (UID: \"5629b139-7406-4898-82ee-cab19e9862eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" Jul 03 19:18:06.674573 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.674533 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5629b139-7406-4898-82ee-cab19e9862eb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf\" (UID: \"5629b139-7406-4898-82ee-cab19e9862eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" Jul 03 19:18:06.686849 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.686818 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc9nd\" (UniqueName: \"kubernetes.io/projected/5629b139-7406-4898-82ee-cab19e9862eb-kube-api-access-jc9nd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf\" (UID: \"5629b139-7406-4898-82ee-cab19e9862eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" Jul 03 19:18:06.799003 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.798903 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" Jul 03 19:18:06.929489 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:06.929456 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf"] Jul 03 19:18:06.931906 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:18:06.931857 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5629b139_7406_4898_82ee_cab19e9862eb.slice/crio-60a5306001faa3943a85b81fa84fb957a42ce719d8c3fda187d4cd7356ea8002 WatchSource:0}: Error finding container 60a5306001faa3943a85b81fa84fb957a42ce719d8c3fda187d4cd7356ea8002: Status 404 returned error can't find the container with id 60a5306001faa3943a85b81fa84fb957a42ce719d8c3fda187d4cd7356ea8002 Jul 03 19:18:07.085085 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.085044 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md"] Jul 03 19:18:07.087361 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.087344 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" Jul 03 19:18:07.101865 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.101828 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md"] Jul 03 19:18:07.178558 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.178526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2437be66-d69a-4dfa-8835-f9ba1d242de5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md\" (UID: \"2437be66-d69a-4dfa-8835-f9ba1d242de5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" Jul 03 19:18:07.178735 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.178576 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2437be66-d69a-4dfa-8835-f9ba1d242de5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md\" (UID: \"2437be66-d69a-4dfa-8835-f9ba1d242de5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" Jul 03 19:18:07.178735 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.178615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49bt\" (UniqueName: \"kubernetes.io/projected/2437be66-d69a-4dfa-8835-f9ba1d242de5-kube-api-access-k49bt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md\" (UID: \"2437be66-d69a-4dfa-8835-f9ba1d242de5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" Jul 03 19:18:07.279148 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.279104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2437be66-d69a-4dfa-8835-f9ba1d242de5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md\" (UID: \"2437be66-d69a-4dfa-8835-f9ba1d242de5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" Jul 03 19:18:07.279148 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.279150 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k49bt\" (UniqueName: \"kubernetes.io/projected/2437be66-d69a-4dfa-8835-f9ba1d242de5-kube-api-access-k49bt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md\" (UID: \"2437be66-d69a-4dfa-8835-f9ba1d242de5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" Jul 03 19:18:07.279352 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.279200 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2437be66-d69a-4dfa-8835-f9ba1d242de5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md\" (UID: \"2437be66-d69a-4dfa-8835-f9ba1d242de5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" Jul 03 19:18:07.279593 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.279577 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2437be66-d69a-4dfa-8835-f9ba1d242de5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md\" (UID: \"2437be66-d69a-4dfa-8835-f9ba1d242de5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" Jul 03 19:18:07.279628 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.279595 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2437be66-d69a-4dfa-8835-f9ba1d242de5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md\" (UID: \"2437be66-d69a-4dfa-8835-f9ba1d242de5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" Jul 03 19:18:07.287182 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.287160 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49bt\" (UniqueName: \"kubernetes.io/projected/2437be66-d69a-4dfa-8835-f9ba1d242de5-kube-api-access-k49bt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md\" (UID: \"2437be66-d69a-4dfa-8835-f9ba1d242de5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" Jul 03 19:18:07.398007 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.397917 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" Jul 03 19:18:07.487041 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.487008 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58"] Jul 03 19:18:07.489840 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.489817 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" Jul 03 19:18:07.498804 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.498769 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58"] Jul 03 19:18:07.528669 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.528637 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md"] Jul 03 19:18:07.531026 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:18:07.530998 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2437be66_d69a_4dfa_8835_f9ba1d242de5.slice/crio-85161643f844a34b70dead938bcdf17b16a89adcec2693d45852246ad25f2b63 WatchSource:0}: Error finding container 85161643f844a34b70dead938bcdf17b16a89adcec2693d45852246ad25f2b63: Status 404 returned error can't find the container with id 85161643f844a34b70dead938bcdf17b16a89adcec2693d45852246ad25f2b63 Jul 03 19:18:07.580785 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.580761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8919ec36-2171-4db8-b323-11f4e2c668ae-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58\" (UID: \"8919ec36-2171-4db8-b323-11f4e2c668ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" Jul 03 19:18:07.580945 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.580818 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdvkq\" (UniqueName: \"kubernetes.io/projected/8919ec36-2171-4db8-b323-11f4e2c668ae-kube-api-access-gdvkq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58\" (UID: \"8919ec36-2171-4db8-b323-11f4e2c668ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" Jul 03 19:18:07.580945 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.580910 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8919ec36-2171-4db8-b323-11f4e2c668ae-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58\" (UID: \"8919ec36-2171-4db8-b323-11f4e2c668ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" Jul 03 19:18:07.681671 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.681578 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8919ec36-2171-4db8-b323-11f4e2c668ae-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58\" (UID: \"8919ec36-2171-4db8-b323-11f4e2c668ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" Jul 03 19:18:07.681671 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.681646 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8919ec36-2171-4db8-b323-11f4e2c668ae-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58\" (UID: \"8919ec36-2171-4db8-b323-11f4e2c668ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" Jul 03 19:18:07.681849 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.681680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdvkq\" (UniqueName: \"kubernetes.io/projected/8919ec36-2171-4db8-b323-11f4e2c668ae-kube-api-access-gdvkq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58\" (UID: \"8919ec36-2171-4db8-b323-11f4e2c668ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" Jul 03 19:18:07.682075 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.682053 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8919ec36-2171-4db8-b323-11f4e2c668ae-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58\" (UID: \"8919ec36-2171-4db8-b323-11f4e2c668ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" Jul 03 19:18:07.682115 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.682065 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8919ec36-2171-4db8-b323-11f4e2c668ae-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58\" (UID: \"8919ec36-2171-4db8-b323-11f4e2c668ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" Jul 03 19:18:07.689803 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.689776 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdvkq\" (UniqueName: \"kubernetes.io/projected/8919ec36-2171-4db8-b323-11f4e2c668ae-kube-api-access-gdvkq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58\" (UID: \"8919ec36-2171-4db8-b323-11f4e2c668ae\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" Jul 03 19:18:07.803024 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.802977 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" Jul 03 19:18:07.818291 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.818255 2580 generic.go:356] "Generic (PLEG): container finished" podID="2437be66-d69a-4dfa-8835-f9ba1d242de5" containerID="f6b3564d0d445fbd1692a7e6d24869e75fe720d5aa69ba7517d7ca1d295e2335" exitCode=0 Jul 03 19:18:07.818417 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.818318 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" event={"ID":"2437be66-d69a-4dfa-8835-f9ba1d242de5","Type":"ContainerDied","Data":"f6b3564d0d445fbd1692a7e6d24869e75fe720d5aa69ba7517d7ca1d295e2335"} Jul 03 19:18:07.818417 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.818370 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" event={"ID":"2437be66-d69a-4dfa-8835-f9ba1d242de5","Type":"ContainerStarted","Data":"85161643f844a34b70dead938bcdf17b16a89adcec2693d45852246ad25f2b63"} Jul 03 19:18:07.820461 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.820441 2580 generic.go:356] "Generic (PLEG): container finished" podID="5629b139-7406-4898-82ee-cab19e9862eb" containerID="735390be95c948dcb4c39b9083bd714bd48f37fb739a0acf6ea190f44b21c414" exitCode=0 Jul 03 19:18:07.820557 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.820471 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" event={"ID":"5629b139-7406-4898-82ee-cab19e9862eb","Type":"ContainerDied","Data":"735390be95c948dcb4c39b9083bd714bd48f37fb739a0acf6ea190f44b21c414"} Jul 03 19:18:07.820557 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.820500 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" event={"ID":"5629b139-7406-4898-82ee-cab19e9862eb","Type":"ContainerStarted","Data":"60a5306001faa3943a85b81fa84fb957a42ce719d8c3fda187d4cd7356ea8002"} Jul 03 19:18:07.886362 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.886329 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5"] Jul 03 19:18:07.889108 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.889090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" Jul 03 19:18:07.899062 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.898233 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5"] Jul 03 19:18:07.942097 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.942070 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58"] Jul 03 19:18:07.943763 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:18:07.943732 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8919ec36_2171_4db8_b323_11f4e2c668ae.slice/crio-35609146ad3972320a1e7e2d01bdb20f34c7480307da07ad24844948caae08bb WatchSource:0}: Error finding container 35609146ad3972320a1e7e2d01bdb20f34c7480307da07ad24844948caae08bb: Status 404 returned error can't find the container with id 35609146ad3972320a1e7e2d01bdb20f34c7480307da07ad24844948caae08bb Jul 03 19:18:07.984269 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.984242 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5\" (UID: \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" Jul 03 19:18:07.984389 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.984272 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5\" (UID: \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" Jul 03 19:18:07.984389 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:07.984290 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djgxk\" (UniqueName: \"kubernetes.io/projected/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-kube-api-access-djgxk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5\" (UID: \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" Jul 03 19:18:08.085553 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.085517 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5\" (UID: \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" Jul 03 19:18:08.085748 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.085561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5\" (UID: \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" Jul 03 19:18:08.085748 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.085603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djgxk\" (UniqueName: \"kubernetes.io/projected/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-kube-api-access-djgxk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5\" (UID: \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" Jul 03 19:18:08.086003 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.085980 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5\" (UID: \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" Jul 03 19:18:08.086059 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.086024 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5\" (UID: \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" Jul 03 19:18:08.093946 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.093926 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djgxk\" (UniqueName: \"kubernetes.io/projected/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-kube-api-access-djgxk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5\" (UID: \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" Jul 03 19:18:08.201289 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.201190 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" Jul 03 19:18:08.329398 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.329361 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5"] Jul 03 19:18:08.331433 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:18:08.331406 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7aa3bf_70b0_4a5b_b8ee_440d17de8556.slice/crio-7bd9d1383bd93a45c1e0212703a2070682a13a2c4e838249549c2cbbb5370205 WatchSource:0}: Error finding container 7bd9d1383bd93a45c1e0212703a2070682a13a2c4e838249549c2cbbb5370205: Status 404 returned error can't find the container with id 7bd9d1383bd93a45c1e0212703a2070682a13a2c4e838249549c2cbbb5370205 Jul 03 19:18:08.828332 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.828297 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" event={"ID":"5629b139-7406-4898-82ee-cab19e9862eb","Type":"ContainerStarted","Data":"417929e08bc29419c65c05110ec0b3347327e5366d0d99a995ce80849a7b5686"} Jul 03 19:18:08.830384 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.830354 2580 generic.go:356] "Generic (PLEG): container finished" podID="2b7aa3bf-70b0-4a5b-b8ee-440d17de8556" containerID="8fd88236752828a439ad62c5282778b3ebadd67c93cea52eaf436ad5f2dd5390" exitCode=0 Jul 03 19:18:08.830535 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.830430 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" event={"ID":"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556","Type":"ContainerDied","Data":"8fd88236752828a439ad62c5282778b3ebadd67c93cea52eaf436ad5f2dd5390"} Jul 03 19:18:08.830535 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.830488 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" event={"ID":"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556","Type":"ContainerStarted","Data":"7bd9d1383bd93a45c1e0212703a2070682a13a2c4e838249549c2cbbb5370205"} Jul 03 19:18:08.832581 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.832555 2580 generic.go:356] "Generic (PLEG): container finished" podID="8919ec36-2171-4db8-b323-11f4e2c668ae" containerID="cffdc27d0b12b5a4c4b3f479b00066805f3689a38f73db27e516b6331a8014f4" exitCode=0 Jul 03 19:18:08.832703 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.832642 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" event={"ID":"8919ec36-2171-4db8-b323-11f4e2c668ae","Type":"ContainerDied","Data":"cffdc27d0b12b5a4c4b3f479b00066805f3689a38f73db27e516b6331a8014f4"} Jul 03 19:18:08.832703 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.832683 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" event={"ID":"8919ec36-2171-4db8-b323-11f4e2c668ae","Type":"ContainerStarted","Data":"35609146ad3972320a1e7e2d01bdb20f34c7480307da07ad24844948caae08bb"} Jul 03 19:18:08.835805 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:08.835744 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" event={"ID":"2437be66-d69a-4dfa-8835-f9ba1d242de5","Type":"ContainerStarted","Data":"bd14cf2a7cab681da2666bad0f68f95bf0b1f0fd826e6a54a4e4208f4b840f82"} Jul 03 19:18:09.841885 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:09.841834 2580 generic.go:356] "Generic (PLEG): container finished" podID="2b7aa3bf-70b0-4a5b-b8ee-440d17de8556" containerID="4b8a5d5d6a00c09dcff1501ed827c3f7d672fba8f8a1052ccc70b48d4f464259" exitCode=0 Jul 03 19:18:09.842365 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:09.841920 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" event={"ID":"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556","Type":"ContainerDied","Data":"4b8a5d5d6a00c09dcff1501ed827c3f7d672fba8f8a1052ccc70b48d4f464259"} Jul 03 19:18:09.843888 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:09.843841 2580 generic.go:356] "Generic (PLEG): container finished" podID="8919ec36-2171-4db8-b323-11f4e2c668ae" containerID="36b5933111b1e9a3a1bed6a49d63eb3f284fd12dae297117d3a2bcd2b20cb795" exitCode=0 Jul 03 19:18:09.843980 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:09.843906 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" event={"ID":"8919ec36-2171-4db8-b323-11f4e2c668ae","Type":"ContainerDied","Data":"36b5933111b1e9a3a1bed6a49d63eb3f284fd12dae297117d3a2bcd2b20cb795"} Jul 03 19:18:09.845968 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:09.845943 2580 generic.go:356] "Generic (PLEG): container finished" podID="2437be66-d69a-4dfa-8835-f9ba1d242de5" containerID="bd14cf2a7cab681da2666bad0f68f95bf0b1f0fd826e6a54a4e4208f4b840f82" exitCode=0 Jul 03 19:18:09.846059 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:09.846017 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" event={"ID":"2437be66-d69a-4dfa-8835-f9ba1d242de5","Type":"ContainerDied","Data":"bd14cf2a7cab681da2666bad0f68f95bf0b1f0fd826e6a54a4e4208f4b840f82"} Jul 03 19:18:09.853261 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:09.853237 2580 generic.go:356] "Generic (PLEG): container finished" podID="5629b139-7406-4898-82ee-cab19e9862eb" containerID="417929e08bc29419c65c05110ec0b3347327e5366d0d99a995ce80849a7b5686" exitCode=0 Jul 03 19:18:09.853379 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:09.853270 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" event={"ID":"5629b139-7406-4898-82ee-cab19e9862eb","Type":"ContainerDied","Data":"417929e08bc29419c65c05110ec0b3347327e5366d0d99a995ce80849a7b5686"} Jul 03 19:18:10.860692 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:10.860659 2580 generic.go:356] "Generic (PLEG): container finished" podID="5629b139-7406-4898-82ee-cab19e9862eb" containerID="ff00bcf8acb8a77eb6f40be6dca9b3e86776bfaa667c3d04218801d7c06190bb" exitCode=0 Jul 03 19:18:10.861169 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:10.860745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" event={"ID":"5629b139-7406-4898-82ee-cab19e9862eb","Type":"ContainerDied","Data":"ff00bcf8acb8a77eb6f40be6dca9b3e86776bfaa667c3d04218801d7c06190bb"} Jul 03 19:18:10.862661 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:10.862640 2580 generic.go:356] "Generic (PLEG): container finished" podID="2b7aa3bf-70b0-4a5b-b8ee-440d17de8556" containerID="b8ddea14064dce12d7c3e80403eda838a1e7f913155744304e6d4a6055cfeb1e" exitCode=0 Jul 03 19:18:10.862790 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:10.862706 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" event={"ID":"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556","Type":"ContainerDied","Data":"b8ddea14064dce12d7c3e80403eda838a1e7f913155744304e6d4a6055cfeb1e"} Jul 03 19:18:10.864776 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:10.864755 2580 generic.go:356] "Generic (PLEG): container finished" podID="8919ec36-2171-4db8-b323-11f4e2c668ae" containerID="341c1bdc5ecced1923110d7ee33a0c991f1434651a09838b73fba5daa35d0594" exitCode=0 Jul 03 19:18:10.867030 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:10.867010 2580 generic.go:356] "Generic (PLEG): container finished" podID="2437be66-d69a-4dfa-8835-f9ba1d242de5" containerID="5fdbee5e79a349d09f498a3ac0e834abf1fadefa46ee2b8315870f4d40ca388e" exitCode=0 Jul 03 19:18:10.870120 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:10.870100 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" event={"ID":"8919ec36-2171-4db8-b323-11f4e2c668ae","Type":"ContainerDied","Data":"341c1bdc5ecced1923110d7ee33a0c991f1434651a09838b73fba5daa35d0594"} Jul 03 19:18:10.870200 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:10.870134 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" event={"ID":"2437be66-d69a-4dfa-8835-f9ba1d242de5","Type":"ContainerDied","Data":"5fdbee5e79a349d09f498a3ac0e834abf1fadefa46ee2b8315870f4d40ca388e"} Jul 03 19:18:12.017170 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.017132 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" Jul 03 19:18:12.086239 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.086214 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" Jul 03 19:18:12.089539 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.089518 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" Jul 03 19:18:12.093190 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.093163 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" Jul 03 19:18:12.119773 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.119739 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2437be66-d69a-4dfa-8835-f9ba1d242de5-util\") pod \"2437be66-d69a-4dfa-8835-f9ba1d242de5\" (UID: \"2437be66-d69a-4dfa-8835-f9ba1d242de5\") " Jul 03 19:18:12.119773 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.119785 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5629b139-7406-4898-82ee-cab19e9862eb-util\") pod \"5629b139-7406-4898-82ee-cab19e9862eb\" (UID: \"5629b139-7406-4898-82ee-cab19e9862eb\") " Jul 03 19:18:12.120043 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.119819 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc9nd\" (UniqueName: \"kubernetes.io/projected/5629b139-7406-4898-82ee-cab19e9862eb-kube-api-access-jc9nd\") pod \"5629b139-7406-4898-82ee-cab19e9862eb\" (UID: \"5629b139-7406-4898-82ee-cab19e9862eb\") " Jul 03 19:18:12.120043 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.119941 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8919ec36-2171-4db8-b323-11f4e2c668ae-bundle\") pod \"8919ec36-2171-4db8-b323-11f4e2c668ae\" (UID: \"8919ec36-2171-4db8-b323-11f4e2c668ae\") " Jul 03 19:18:12.120043 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.119968 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdvkq\" (UniqueName: \"kubernetes.io/projected/8919ec36-2171-4db8-b323-11f4e2c668ae-kube-api-access-gdvkq\") pod \"8919ec36-2171-4db8-b323-11f4e2c668ae\" (UID: \"8919ec36-2171-4db8-b323-11f4e2c668ae\") " Jul 03 19:18:12.120043 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.119999 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8919ec36-2171-4db8-b323-11f4e2c668ae-util\") pod \"8919ec36-2171-4db8-b323-11f4e2c668ae\" (UID: \"8919ec36-2171-4db8-b323-11f4e2c668ae\") " Jul 03 19:18:12.120043 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.120026 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2437be66-d69a-4dfa-8835-f9ba1d242de5-bundle\") pod \"2437be66-d69a-4dfa-8835-f9ba1d242de5\" (UID: \"2437be66-d69a-4dfa-8835-f9ba1d242de5\") " Jul 03 19:18:12.120310 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.120054 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k49bt\" (UniqueName: \"kubernetes.io/projected/2437be66-d69a-4dfa-8835-f9ba1d242de5-kube-api-access-k49bt\") pod \"2437be66-d69a-4dfa-8835-f9ba1d242de5\" (UID: \"2437be66-d69a-4dfa-8835-f9ba1d242de5\") " Jul 03 19:18:12.120310 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.120086 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5629b139-7406-4898-82ee-cab19e9862eb-bundle\") pod \"5629b139-7406-4898-82ee-cab19e9862eb\" (UID: \"5629b139-7406-4898-82ee-cab19e9862eb\") " Jul 03 19:18:12.121416 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.121075 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2437be66-d69a-4dfa-8835-f9ba1d242de5-bundle" (OuterVolumeSpecName: "bundle") pod "2437be66-d69a-4dfa-8835-f9ba1d242de5" (UID: "2437be66-d69a-4dfa-8835-f9ba1d242de5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:18:12.121416 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.121338 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5629b139-7406-4898-82ee-cab19e9862eb-bundle" (OuterVolumeSpecName: "bundle") pod "5629b139-7406-4898-82ee-cab19e9862eb" (UID: "5629b139-7406-4898-82ee-cab19e9862eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:18:12.122323 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.122063 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8919ec36-2171-4db8-b323-11f4e2c668ae-bundle" (OuterVolumeSpecName: "bundle") pod "8919ec36-2171-4db8-b323-11f4e2c668ae" (UID: "8919ec36-2171-4db8-b323-11f4e2c668ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:18:12.122889 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.122839 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5629b139-7406-4898-82ee-cab19e9862eb-kube-api-access-jc9nd" (OuterVolumeSpecName: "kube-api-access-jc9nd") pod "5629b139-7406-4898-82ee-cab19e9862eb" (UID: "5629b139-7406-4898-82ee-cab19e9862eb"). InnerVolumeSpecName "kube-api-access-jc9nd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:18:12.123638 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.123611 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2437be66-d69a-4dfa-8835-f9ba1d242de5-kube-api-access-k49bt" (OuterVolumeSpecName: "kube-api-access-k49bt") pod "2437be66-d69a-4dfa-8835-f9ba1d242de5" (UID: "2437be66-d69a-4dfa-8835-f9ba1d242de5"). InnerVolumeSpecName "kube-api-access-k49bt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:18:12.123838 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.123812 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8919ec36-2171-4db8-b323-11f4e2c668ae-kube-api-access-gdvkq" (OuterVolumeSpecName: "kube-api-access-gdvkq") pod "8919ec36-2171-4db8-b323-11f4e2c668ae" (UID: "8919ec36-2171-4db8-b323-11f4e2c668ae"). InnerVolumeSpecName "kube-api-access-gdvkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:18:12.126802 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.126775 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8919ec36-2171-4db8-b323-11f4e2c668ae-util" (OuterVolumeSpecName: "util") pod "8919ec36-2171-4db8-b323-11f4e2c668ae" (UID: "8919ec36-2171-4db8-b323-11f4e2c668ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:18:12.126940 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.126922 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2437be66-d69a-4dfa-8835-f9ba1d242de5-util" (OuterVolumeSpecName: "util") pod "2437be66-d69a-4dfa-8835-f9ba1d242de5" (UID: "2437be66-d69a-4dfa-8835-f9ba1d242de5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:18:12.184668 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.184629 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5629b139-7406-4898-82ee-cab19e9862eb-util" (OuterVolumeSpecName: "util") pod "5629b139-7406-4898-82ee-cab19e9862eb" (UID: "5629b139-7406-4898-82ee-cab19e9862eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:18:12.221519 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.221492 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djgxk\" (UniqueName: \"kubernetes.io/projected/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-kube-api-access-djgxk\") pod \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\" (UID: \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\") " Jul 03 19:18:12.221519 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.221524 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-bundle\") pod \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\" (UID: \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\") " Jul 03 19:18:12.221764 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.221553 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-util\") pod \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\" (UID: \"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556\") " Jul 03 19:18:12.221764 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.221722 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8919ec36-2171-4db8-b323-11f4e2c668ae-bundle\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:18:12.221764 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.221732 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdvkq\" (UniqueName: \"kubernetes.io/projected/8919ec36-2171-4db8-b323-11f4e2c668ae-kube-api-access-gdvkq\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:18:12.221764 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.221742 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8919ec36-2171-4db8-b323-11f4e2c668ae-util\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:18:12.221764 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.221750 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2437be66-d69a-4dfa-8835-f9ba1d242de5-bundle\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:18:12.221764 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.221758 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k49bt\" (UniqueName: \"kubernetes.io/projected/2437be66-d69a-4dfa-8835-f9ba1d242de5-kube-api-access-k49bt\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:18:12.221764 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.221765 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5629b139-7406-4898-82ee-cab19e9862eb-bundle\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:18:12.222144 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.221774 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2437be66-d69a-4dfa-8835-f9ba1d242de5-util\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:18:12.222144 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.221781 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5629b139-7406-4898-82ee-cab19e9862eb-util\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:18:12.222144 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.221789 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc9nd\" (UniqueName: \"kubernetes.io/projected/5629b139-7406-4898-82ee-cab19e9862eb-kube-api-access-jc9nd\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:18:12.222144 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.222066 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-bundle" (OuterVolumeSpecName: "bundle") pod "2b7aa3bf-70b0-4a5b-b8ee-440d17de8556" (UID: "2b7aa3bf-70b0-4a5b-b8ee-440d17de8556"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:18:12.223689 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.223666 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-kube-api-access-djgxk" (OuterVolumeSpecName: "kube-api-access-djgxk") pod "2b7aa3bf-70b0-4a5b-b8ee-440d17de8556" (UID: "2b7aa3bf-70b0-4a5b-b8ee-440d17de8556"). InnerVolumeSpecName "kube-api-access-djgxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:18:12.227190 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.227154 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-util" (OuterVolumeSpecName: "util") pod "2b7aa3bf-70b0-4a5b-b8ee-440d17de8556" (UID: "2b7aa3bf-70b0-4a5b-b8ee-440d17de8556"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:18:12.324907 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.323055 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djgxk\" (UniqueName: \"kubernetes.io/projected/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-kube-api-access-djgxk\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:18:12.324907 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.323093 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-bundle\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:18:12.324907 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.323117 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b7aa3bf-70b0-4a5b-b8ee-440d17de8556-util\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:18:12.879827 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.879799 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" Jul 03 19:18:12.880027 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.879822 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md" event={"ID":"2437be66-d69a-4dfa-8835-f9ba1d242de5","Type":"ContainerDied","Data":"85161643f844a34b70dead938bcdf17b16a89adcec2693d45852246ad25f2b63"} Jul 03 19:18:12.880027 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.879891 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85161643f844a34b70dead938bcdf17b16a89adcec2693d45852246ad25f2b63" Jul 03 19:18:12.882128 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.882107 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" Jul 03 19:18:12.882272 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.882128 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf" event={"ID":"5629b139-7406-4898-82ee-cab19e9862eb","Type":"ContainerDied","Data":"60a5306001faa3943a85b81fa84fb957a42ce719d8c3fda187d4cd7356ea8002"} Jul 03 19:18:12.882272 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.882175 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60a5306001faa3943a85b81fa84fb957a42ce719d8c3fda187d4cd7356ea8002" Jul 03 19:18:12.884471 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.884446 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" Jul 03 19:18:12.884583 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.884440 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5" event={"ID":"2b7aa3bf-70b0-4a5b-b8ee-440d17de8556","Type":"ContainerDied","Data":"7bd9d1383bd93a45c1e0212703a2070682a13a2c4e838249549c2cbbb5370205"} Jul 03 19:18:12.884583 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.884569 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bd9d1383bd93a45c1e0212703a2070682a13a2c4e838249549c2cbbb5370205" Jul 03 19:18:12.886599 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.886574 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" event={"ID":"8919ec36-2171-4db8-b323-11f4e2c668ae","Type":"ContainerDied","Data":"35609146ad3972320a1e7e2d01bdb20f34c7480307da07ad24844948caae08bb"} Jul 03 19:18:12.886727 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.886609 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35609146ad3972320a1e7e2d01bdb20f34c7480307da07ad24844948caae08bb" Jul 03 19:18:12.886727 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:12.886612 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58" Jul 03 19:18:27.778619 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.778582 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf"] Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.778908 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2437be66-d69a-4dfa-8835-f9ba1d242de5" containerName="extract" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.778924 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2437be66-d69a-4dfa-8835-f9ba1d242de5" containerName="extract" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.778937 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7aa3bf-70b0-4a5b-b8ee-440d17de8556" containerName="extract" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.778943 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7aa3bf-70b0-4a5b-b8ee-440d17de8556" containerName="extract" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.778951 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2437be66-d69a-4dfa-8835-f9ba1d242de5" containerName="pull" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.778957 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2437be66-d69a-4dfa-8835-f9ba1d242de5" containerName="pull" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.778964 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7aa3bf-70b0-4a5b-b8ee-440d17de8556" containerName="util" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.778969 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7aa3bf-70b0-4a5b-b8ee-440d17de8556" containerName="util" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.778975 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8919ec36-2171-4db8-b323-11f4e2c668ae" containerName="util" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.778980 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8919ec36-2171-4db8-b323-11f4e2c668ae" containerName="util" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.778985 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8919ec36-2171-4db8-b323-11f4e2c668ae" containerName="extract" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.778990 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8919ec36-2171-4db8-b323-11f4e2c668ae" containerName="extract" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779002 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5629b139-7406-4898-82ee-cab19e9862eb" containerName="pull" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779008 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5629b139-7406-4898-82ee-cab19e9862eb" containerName="pull" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779012 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8919ec36-2171-4db8-b323-11f4e2c668ae" containerName="pull" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779017 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8919ec36-2171-4db8-b323-11f4e2c668ae" containerName="pull" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779023 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5629b139-7406-4898-82ee-cab19e9862eb" containerName="extract" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779028 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5629b139-7406-4898-82ee-cab19e9862eb" containerName="extract" Jul 03 19:18:27.779028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779036 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2437be66-d69a-4dfa-8835-f9ba1d242de5" containerName="util" Jul 03 19:18:27.779571 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779042 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2437be66-d69a-4dfa-8835-f9ba1d242de5" containerName="util" Jul 03 19:18:27.779571 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779047 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7aa3bf-70b0-4a5b-b8ee-440d17de8556" containerName="pull" Jul 03 19:18:27.779571 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779052 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7aa3bf-70b0-4a5b-b8ee-440d17de8556" containerName="pull" Jul 03 19:18:27.779571 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779060 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5629b139-7406-4898-82ee-cab19e9862eb" containerName="util" Jul 03 19:18:27.779571 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779065 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5629b139-7406-4898-82ee-cab19e9862eb" containerName="util" Jul 03 19:18:27.779571 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779110 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5629b139-7406-4898-82ee-cab19e9862eb" containerName="extract" Jul 03 19:18:27.779571 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779117 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2437be66-d69a-4dfa-8835-f9ba1d242de5" containerName="extract" Jul 03 19:18:27.779571 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779124 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8919ec36-2171-4db8-b323-11f4e2c668ae" containerName="extract" Jul 03 19:18:27.779571 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.779130 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b7aa3bf-70b0-4a5b-b8ee-440d17de8556" containerName="extract" Jul 03 19:18:27.781868 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.781849 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" Jul 03 19:18:27.784663 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.784641 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 03 19:18:27.784768 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.784687 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7khgr\"" Jul 03 19:18:27.785306 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.785290 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 03 19:18:27.792370 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.792351 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf"] Jul 03 19:18:27.859716 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.859678 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5qhr\" (UniqueName: \"kubernetes.io/projected/f895cd84-ecae-4c12-ae89-93f15bb817d2-kube-api-access-g5qhr\") pod \"limitador-operator-controller-manager-859d7b78bd-st8rf\" (UID: \"f895cd84-ecae-4c12-ae89-93f15bb817d2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" Jul 03 19:18:27.960475 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.960439 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5qhr\" (UniqueName: \"kubernetes.io/projected/f895cd84-ecae-4c12-ae89-93f15bb817d2-kube-api-access-g5qhr\") pod \"limitador-operator-controller-manager-859d7b78bd-st8rf\" (UID: \"f895cd84-ecae-4c12-ae89-93f15bb817d2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" Jul 03 19:18:27.968600 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:27.968563 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5qhr\" (UniqueName: \"kubernetes.io/projected/f895cd84-ecae-4c12-ae89-93f15bb817d2-kube-api-access-g5qhr\") pod \"limitador-operator-controller-manager-859d7b78bd-st8rf\" (UID: \"f895cd84-ecae-4c12-ae89-93f15bb817d2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" Jul 03 19:18:28.092718 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:28.092687 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" Jul 03 19:18:28.222735 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:28.222696 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf"] Jul 03 19:18:28.226281 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:18:28.226252 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf895cd84_ecae_4c12_ae89_93f15bb817d2.slice/crio-21e76306fd80cd37616e0fe198cd5361b236b1a2b5839c627536d11386292331 WatchSource:0}: Error finding container 21e76306fd80cd37616e0fe198cd5361b236b1a2b5839c627536d11386292331: Status 404 returned error can't find the container with id 21e76306fd80cd37616e0fe198cd5361b236b1a2b5839c627536d11386292331 Jul 03 19:18:28.959632 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:28.959596 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" event={"ID":"f895cd84-ecae-4c12-ae89-93f15bb817d2","Type":"ContainerStarted","Data":"21e76306fd80cd37616e0fe198cd5361b236b1a2b5839c627536d11386292331"} Jul 03 19:18:30.970764 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:30.970727 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" event={"ID":"f895cd84-ecae-4c12-ae89-93f15bb817d2","Type":"ContainerStarted","Data":"489e1527f949a97c595297b89ba2b28a3994eda9b1d37ad5b001bf5532e5193c"} Jul 03 19:18:30.971169 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:30.970808 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" Jul 03 19:18:30.988355 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:30.988301 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" podStartSLOduration=2.248994395 podStartE2EDuration="3.9882866s" totalImagesPullingTime="1.739292205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:18:30.986712475 +0000 UTC m=+518.623458180" watchObservedRunningTime="2026-07-03 19:18:30.9882866 +0000 UTC m=+518.625032280" Jul 03 19:18:41.977465 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:41.977426 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" Jul 03 19:18:44.520542 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.520490 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf"] Jul 03 19:18:44.521140 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.520735 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" podUID="f895cd84-ecae-4c12-ae89-93f15bb817d2" containerName="manager" containerID="cri-o://489e1527f949a97c595297b89ba2b28a3994eda9b1d37ad5b001bf5532e5193c" gracePeriod=2 Jul 03 19:18:44.526393 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.526359 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf"] Jul 03 19:18:44.546157 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.546132 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t82w8"] Jul 03 19:18:44.546416 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.546405 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f895cd84-ecae-4c12-ae89-93f15bb817d2" containerName="manager" Jul 03 19:18:44.546458 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.546418 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f895cd84-ecae-4c12-ae89-93f15bb817d2" containerName="manager" Jul 03 19:18:44.546502 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.546473 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f895cd84-ecae-4c12-ae89-93f15bb817d2" containerName="manager" Jul 03 19:18:44.549244 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.549227 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t82w8" Jul 03 19:18:44.556807 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.556781 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t82w8"] Jul 03 19:18:44.569662 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:18:44.569619 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-st8rf\" is forbidden: User \"system:node:ip-10-0-131-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-31.ec2.internal' and this object" podUID="f895cd84-ecae-4c12-ae89-93f15bb817d2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" Jul 03 19:18:44.602775 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.602750 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76nd8\" (UniqueName: \"kubernetes.io/projected/77f1d03f-697e-459c-a974-8caa9ec91edf-kube-api-access-76nd8\") pod \"limitador-operator-controller-manager-859d7b78bd-t82w8\" (UID: \"77f1d03f-697e-459c-a974-8caa9ec91edf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t82w8" Jul 03 19:18:44.703417 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.703386 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76nd8\" (UniqueName: \"kubernetes.io/projected/77f1d03f-697e-459c-a974-8caa9ec91edf-kube-api-access-76nd8\") pod \"limitador-operator-controller-manager-859d7b78bd-t82w8\" (UID: \"77f1d03f-697e-459c-a974-8caa9ec91edf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t82w8" Jul 03 19:18:44.714605 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.714568 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76nd8\" (UniqueName: \"kubernetes.io/projected/77f1d03f-697e-459c-a974-8caa9ec91edf-kube-api-access-76nd8\") pod \"limitador-operator-controller-manager-859d7b78bd-t82w8\" (UID: \"77f1d03f-697e-459c-a974-8caa9ec91edf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t82w8" Jul 03 19:18:44.755438 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.755414 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" Jul 03 19:18:44.757474 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:18:44.757450 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-st8rf\" is forbidden: User \"system:node:ip-10-0-131-31.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-31.ec2.internal' and this object" podUID="f895cd84-ecae-4c12-ae89-93f15bb817d2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" Jul 03 19:18:44.804578 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.804469 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5qhr\" (UniqueName: \"kubernetes.io/projected/f895cd84-ecae-4c12-ae89-93f15bb817d2-kube-api-access-g5qhr\") pod \"f895cd84-ecae-4c12-ae89-93f15bb817d2\" (UID: \"f895cd84-ecae-4c12-ae89-93f15bb817d2\") " Jul 03 19:18:44.806429 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.806401 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f895cd84-ecae-4c12-ae89-93f15bb817d2-kube-api-access-g5qhr" (OuterVolumeSpecName: "kube-api-access-g5qhr") pod "f895cd84-ecae-4c12-ae89-93f15bb817d2" (UID: "f895cd84-ecae-4c12-ae89-93f15bb817d2"). InnerVolumeSpecName "kube-api-access-g5qhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:18:44.869794 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.869762 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f895cd84-ecae-4c12-ae89-93f15bb817d2" path="/var/lib/kubelet/pods/f895cd84-ecae-4c12-ae89-93f15bb817d2/volumes" Jul 03 19:18:44.897861 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.897817 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t82w8" Jul 03 19:18:44.904995 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:44.904973 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5qhr\" (UniqueName: \"kubernetes.io/projected/f895cd84-ecae-4c12-ae89-93f15bb817d2-kube-api-access-g5qhr\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:18:45.037814 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:45.037785 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t82w8"] Jul 03 19:18:45.038973 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:45.038934 2580 generic.go:356] "Generic (PLEG): container finished" podID="f895cd84-ecae-4c12-ae89-93f15bb817d2" containerID="489e1527f949a97c595297b89ba2b28a3994eda9b1d37ad5b001bf5532e5193c" exitCode=0 Jul 03 19:18:45.039099 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:45.038990 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-st8rf" Jul 03 19:18:45.039099 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:45.039007 2580 scope.go:117] "RemoveContainer" containerID="489e1527f949a97c595297b89ba2b28a3994eda9b1d37ad5b001bf5532e5193c" Jul 03 19:18:45.039785 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:18:45.039756 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f1d03f_697e_459c_a974_8caa9ec91edf.slice/crio-0fdded3dd89853c81353e8ccac0e4ea2b495ecb519fdb772b9b96fb80f9af24f WatchSource:0}: Error finding container 0fdded3dd89853c81353e8ccac0e4ea2b495ecb519fdb772b9b96fb80f9af24f: Status 404 returned error can't find the container with id 0fdded3dd89853c81353e8ccac0e4ea2b495ecb519fdb772b9b96fb80f9af24f Jul 03 19:18:45.047379 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:45.047361 2580 scope.go:117] "RemoveContainer" containerID="489e1527f949a97c595297b89ba2b28a3994eda9b1d37ad5b001bf5532e5193c" Jul 03 19:18:45.047660 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:18:45.047640 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"489e1527f949a97c595297b89ba2b28a3994eda9b1d37ad5b001bf5532e5193c\": container with ID starting with 489e1527f949a97c595297b89ba2b28a3994eda9b1d37ad5b001bf5532e5193c not found: ID does not exist" containerID="489e1527f949a97c595297b89ba2b28a3994eda9b1d37ad5b001bf5532e5193c" Jul 03 19:18:45.047712 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:45.047668 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489e1527f949a97c595297b89ba2b28a3994eda9b1d37ad5b001bf5532e5193c"} err="failed to get container status \"489e1527f949a97c595297b89ba2b28a3994eda9b1d37ad5b001bf5532e5193c\": rpc error: code = NotFound desc = could not find container \"489e1527f949a97c595297b89ba2b28a3994eda9b1d37ad5b001bf5532e5193c\": container with ID starting with 489e1527f949a97c595297b89ba2b28a3994eda9b1d37ad5b001bf5532e5193c not found: ID does not exist" Jul 03 19:18:46.045892 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:46.045830 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t82w8" event={"ID":"77f1d03f-697e-459c-a974-8caa9ec91edf","Type":"ContainerStarted","Data":"eb11f6f80b9cbe84bddab426973a6c124ac5d6f1227d1275917f35d8d55caafc"} Jul 03 19:18:46.046341 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:46.045920 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t82w8" Jul 03 19:18:46.046341 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:46.045947 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t82w8" event={"ID":"77f1d03f-697e-459c-a974-8caa9ec91edf","Type":"ContainerStarted","Data":"0fdded3dd89853c81353e8ccac0e4ea2b495ecb519fdb772b9b96fb80f9af24f"} Jul 03 19:18:46.065472 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:46.065422 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t82w8" podStartSLOduration=2.065406295 podStartE2EDuration="2.065406295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:18:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:18:46.064771849 +0000 UTC m=+533.701517541" watchObservedRunningTime="2026-07-03 19:18:46.065406295 +0000 UTC m=+533.702151976" Jul 03 19:18:57.053362 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:18:57.053328 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t82w8" Jul 03 19:19:41.505827 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.505790 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:19:41.509258 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.509234 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-67449" Jul 03 19:19:41.511724 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.511700 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 03 19:19:41.511844 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.511752 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4g74m\"" Jul 03 19:19:41.518777 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.518750 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:19:41.546647 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.546618 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:19:41.655934 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.655897 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9628t\" (UniqueName: \"kubernetes.io/projected/a039546b-18ff-406b-8e37-ed2329191a6e-kube-api-access-9628t\") pod \"limitador-limitador-54d6d988d5-67449\" (UID: \"a039546b-18ff-406b-8e37-ed2329191a6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-67449" Jul 03 19:19:41.656106 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.655957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a039546b-18ff-406b-8e37-ed2329191a6e-config-file\") pod \"limitador-limitador-54d6d988d5-67449\" (UID: \"a039546b-18ff-406b-8e37-ed2329191a6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-67449" Jul 03 19:19:41.756414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.756329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a039546b-18ff-406b-8e37-ed2329191a6e-config-file\") pod \"limitador-limitador-54d6d988d5-67449\" (UID: \"a039546b-18ff-406b-8e37-ed2329191a6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-67449" Jul 03 19:19:41.756414 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.756398 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9628t\" (UniqueName: \"kubernetes.io/projected/a039546b-18ff-406b-8e37-ed2329191a6e-kube-api-access-9628t\") pod \"limitador-limitador-54d6d988d5-67449\" (UID: \"a039546b-18ff-406b-8e37-ed2329191a6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-67449" Jul 03 19:19:41.756974 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.756953 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a039546b-18ff-406b-8e37-ed2329191a6e-config-file\") pod \"limitador-limitador-54d6d988d5-67449\" (UID: \"a039546b-18ff-406b-8e37-ed2329191a6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-67449" Jul 03 19:19:41.764050 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.764019 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9628t\" (UniqueName: \"kubernetes.io/projected/a039546b-18ff-406b-8e37-ed2329191a6e-kube-api-access-9628t\") pod \"limitador-limitador-54d6d988d5-67449\" (UID: \"a039546b-18ff-406b-8e37-ed2329191a6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-67449" Jul 03 19:19:41.820075 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.820038 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-67449" Jul 03 19:19:41.947883 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:41.947848 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:19:41.950150 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:19:41.950121 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda039546b_18ff_406b_8e37_ed2329191a6e.slice/crio-b2682f02ff25ffaaa19ece7d21e4c708fd85ebb3f36e770422f4d820613fdb94 WatchSource:0}: Error finding container b2682f02ff25ffaaa19ece7d21e4c708fd85ebb3f36e770422f4d820613fdb94: Status 404 returned error can't find the container with id b2682f02ff25ffaaa19ece7d21e4c708fd85ebb3f36e770422f4d820613fdb94 Jul 03 19:19:42.105143 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:42.105114 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-8vbj4"] Jul 03 19:19:42.109281 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:42.109264 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8vbj4" Jul 03 19:19:42.111767 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:42.111737 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-svxt9\"" Jul 03 19:19:42.113210 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:42.113186 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8vbj4"] Jul 03 19:19:42.261137 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:42.261092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkvwb\" (UniqueName: \"kubernetes.io/projected/22a8f223-1873-4283-a6fd-42586d943aa4-kube-api-access-bkvwb\") pod \"authorino-75d556bd77-8vbj4\" (UID: \"22a8f223-1873-4283-a6fd-42586d943aa4\") " pod="kuadrant-system/authorino-75d556bd77-8vbj4" Jul 03 19:19:42.311385 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:42.311349 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-67449" event={"ID":"a039546b-18ff-406b-8e37-ed2329191a6e","Type":"ContainerStarted","Data":"b2682f02ff25ffaaa19ece7d21e4c708fd85ebb3f36e770422f4d820613fdb94"} Jul 03 19:19:42.361775 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:42.361687 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkvwb\" (UniqueName: \"kubernetes.io/projected/22a8f223-1873-4283-a6fd-42586d943aa4-kube-api-access-bkvwb\") pod \"authorino-75d556bd77-8vbj4\" (UID: \"22a8f223-1873-4283-a6fd-42586d943aa4\") " pod="kuadrant-system/authorino-75d556bd77-8vbj4" Jul 03 19:19:42.369374 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:42.369346 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkvwb\" (UniqueName: \"kubernetes.io/projected/22a8f223-1873-4283-a6fd-42586d943aa4-kube-api-access-bkvwb\") pod \"authorino-75d556bd77-8vbj4\" (UID: \"22a8f223-1873-4283-a6fd-42586d943aa4\") " pod="kuadrant-system/authorino-75d556bd77-8vbj4" Jul 03 19:19:42.419297 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:42.419263 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8vbj4" Jul 03 19:19:42.579660 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:42.579624 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8vbj4"] Jul 03 19:19:42.581770 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:19:42.581715 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22a8f223_1873_4283_a6fd_42586d943aa4.slice/crio-075ffde75431452c6fb53dc899478ffdb2b4f924487fb66c2f3fbd7c586602b1 WatchSource:0}: Error finding container 075ffde75431452c6fb53dc899478ffdb2b4f924487fb66c2f3fbd7c586602b1: Status 404 returned error can't find the container with id 075ffde75431452c6fb53dc899478ffdb2b4f924487fb66c2f3fbd7c586602b1 Jul 03 19:19:43.320719 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:43.320672 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8vbj4" event={"ID":"22a8f223-1873-4283-a6fd-42586d943aa4","Type":"ContainerStarted","Data":"075ffde75431452c6fb53dc899478ffdb2b4f924487fb66c2f3fbd7c586602b1"} Jul 03 19:19:47.343085 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:47.343050 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-67449" event={"ID":"a039546b-18ff-406b-8e37-ed2329191a6e","Type":"ContainerStarted","Data":"a50e7077d7a57a80083126aac096c1085fcfaa8634826ad457d69286096a7f48"} Jul 03 19:19:47.343559 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:47.343167 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-67449" Jul 03 19:19:47.344597 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:47.344571 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8vbj4" event={"ID":"22a8f223-1873-4283-a6fd-42586d943aa4","Type":"ContainerStarted","Data":"87e0cf7b8732fef513cebe9338ab77477d93a8cbfcc0652c502cc7037f7b2a20"} Jul 03 19:19:47.359347 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:47.359291 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-67449" podStartSLOduration=1.943982089 podStartE2EDuration="6.359272033s" totalImagesPullingTime="4.415289944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:19:47.358967663 +0000 UTC m=+594.995713349" watchObservedRunningTime="2026-07-03 19:19:47.359272033 +0000 UTC m=+594.996017715" Jul 03 19:19:47.372899 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:47.372841 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-8vbj4" podStartSLOduration=1.580757339 podStartE2EDuration="5.372827946s" totalImagesPullingTime="3.792070607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:19:47.371291041 +0000 UTC m=+595.008036722" watchObservedRunningTime="2026-07-03 19:19:47.372827946 +0000 UTC m=+595.009573661" Jul 03 19:19:58.350620 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:19:58.350584 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-67449" Jul 03 19:20:35.225994 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:35.225958 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bddd9c767-d9wwt"] Jul 03 19:20:35.228053 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:35.228036 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bddd9c767-d9wwt" Jul 03 19:20:35.241914 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:35.241868 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bddd9c767-d9wwt"] Jul 03 19:20:35.288525 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:35.288488 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z92p2\" (UniqueName: \"kubernetes.io/projected/d06f85e7-c3c7-498d-b15b-169fb1bee522-kube-api-access-z92p2\") pod \"authorino-6bddd9c767-d9wwt\" (UID: \"d06f85e7-c3c7-498d-b15b-169fb1bee522\") " pod="kuadrant-system/authorino-6bddd9c767-d9wwt" Jul 03 19:20:35.318889 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:35.318831 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bddd9c767-d9wwt"] Jul 03 19:20:35.319113 ip-10-0-131-31 kubenswrapper[2580]: E0703 19:20:35.319090 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-z92p2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6bddd9c767-d9wwt" podUID="d06f85e7-c3c7-498d-b15b-169fb1bee522" Jul 03 19:20:35.388982 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:35.388947 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z92p2\" (UniqueName: \"kubernetes.io/projected/d06f85e7-c3c7-498d-b15b-169fb1bee522-kube-api-access-z92p2\") pod \"authorino-6bddd9c767-d9wwt\" (UID: \"d06f85e7-c3c7-498d-b15b-169fb1bee522\") " pod="kuadrant-system/authorino-6bddd9c767-d9wwt" Jul 03 19:20:35.398210 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:35.398182 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z92p2\" (UniqueName: \"kubernetes.io/projected/d06f85e7-c3c7-498d-b15b-169fb1bee522-kube-api-access-z92p2\") pod \"authorino-6bddd9c767-d9wwt\" (UID: \"d06f85e7-c3c7-498d-b15b-169fb1bee522\") " pod="kuadrant-system/authorino-6bddd9c767-d9wwt" Jul 03 19:20:35.568329 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:35.568239 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bddd9c767-d9wwt" Jul 03 19:20:35.574158 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:35.574137 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bddd9c767-d9wwt" Jul 03 19:20:35.691569 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:35.691529 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z92p2\" (UniqueName: \"kubernetes.io/projected/d06f85e7-c3c7-498d-b15b-169fb1bee522-kube-api-access-z92p2\") pod \"d06f85e7-c3c7-498d-b15b-169fb1bee522\" (UID: \"d06f85e7-c3c7-498d-b15b-169fb1bee522\") " Jul 03 19:20:35.693696 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:35.693658 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d06f85e7-c3c7-498d-b15b-169fb1bee522-kube-api-access-z92p2" (OuterVolumeSpecName: "kube-api-access-z92p2") pod "d06f85e7-c3c7-498d-b15b-169fb1bee522" (UID: "d06f85e7-c3c7-498d-b15b-169fb1bee522"). InnerVolumeSpecName "kube-api-access-z92p2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:20:35.792313 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:35.792279 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z92p2\" (UniqueName: \"kubernetes.io/projected/d06f85e7-c3c7-498d-b15b-169fb1bee522-kube-api-access-z92p2\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:20:36.454914 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:36.454832 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8vbj4"] Jul 03 19:20:36.455396 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:36.455091 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-8vbj4" podUID="22a8f223-1873-4283-a6fd-42586d943aa4" containerName="authorino" containerID="cri-o://87e0cf7b8732fef513cebe9338ab77477d93a8cbfcc0652c502cc7037f7b2a20" gracePeriod=30 Jul 03 19:20:36.574223 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:36.574191 2580 generic.go:356] "Generic (PLEG): container finished" podID="22a8f223-1873-4283-a6fd-42586d943aa4" containerID="87e0cf7b8732fef513cebe9338ab77477d93a8cbfcc0652c502cc7037f7b2a20" exitCode=0 Jul 03 19:20:36.574359 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:36.574232 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8vbj4" event={"ID":"22a8f223-1873-4283-a6fd-42586d943aa4","Type":"ContainerDied","Data":"87e0cf7b8732fef513cebe9338ab77477d93a8cbfcc0652c502cc7037f7b2a20"} Jul 03 19:20:36.574359 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:36.574299 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bddd9c767-d9wwt" Jul 03 19:20:36.602159 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:36.602117 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bddd9c767-d9wwt"] Jul 03 19:20:36.604696 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:36.604670 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6bddd9c767-d9wwt"] Jul 03 19:20:36.694305 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:36.694279 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8vbj4" Jul 03 19:20:36.799405 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:36.799310 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkvwb\" (UniqueName: \"kubernetes.io/projected/22a8f223-1873-4283-a6fd-42586d943aa4-kube-api-access-bkvwb\") pod \"22a8f223-1873-4283-a6fd-42586d943aa4\" (UID: \"22a8f223-1873-4283-a6fd-42586d943aa4\") " Jul 03 19:20:36.801350 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:36.801327 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22a8f223-1873-4283-a6fd-42586d943aa4-kube-api-access-bkvwb" (OuterVolumeSpecName: "kube-api-access-bkvwb") pod "22a8f223-1873-4283-a6fd-42586d943aa4" (UID: "22a8f223-1873-4283-a6fd-42586d943aa4"). InnerVolumeSpecName "kube-api-access-bkvwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:20:36.870256 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:36.870222 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d06f85e7-c3c7-498d-b15b-169fb1bee522" path="/var/lib/kubelet/pods/d06f85e7-c3c7-498d-b15b-169fb1bee522/volumes" Jul 03 19:20:36.900248 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:36.900214 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkvwb\" (UniqueName: \"kubernetes.io/projected/22a8f223-1873-4283-a6fd-42586d943aa4-kube-api-access-bkvwb\") on node \"ip-10-0-131-31.ec2.internal\" DevicePath \"\"" Jul 03 19:20:37.580051 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:37.580021 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8vbj4" Jul 03 19:20:37.580538 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:37.580020 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8vbj4" event={"ID":"22a8f223-1873-4283-a6fd-42586d943aa4","Type":"ContainerDied","Data":"075ffde75431452c6fb53dc899478ffdb2b4f924487fb66c2f3fbd7c586602b1"} Jul 03 19:20:37.580538 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:37.580140 2580 scope.go:117] "RemoveContainer" containerID="87e0cf7b8732fef513cebe9338ab77477d93a8cbfcc0652c502cc7037f7b2a20" Jul 03 19:20:37.595993 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:37.595967 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8vbj4"] Jul 03 19:20:37.605443 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:37.605416 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8vbj4"] Jul 03 19:20:38.870094 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:20:38.870059 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22a8f223-1873-4283-a6fd-42586d943aa4" path="/var/lib/kubelet/pods/22a8f223-1873-4283-a6fd-42586d943aa4/volumes" Jul 03 19:21:17.099789 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:21:17.099751 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:21:34.055623 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:21:34.055583 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:21:42.663390 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:21:42.663356 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:21:58.055486 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:21:58.055400 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:22:06.350765 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.350732 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649"] Jul 03 19:22:06.351402 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.351183 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22a8f223-1873-4283-a6fd-42586d943aa4" containerName="authorino" Jul 03 19:22:06.351402 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.351202 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="22a8f223-1873-4283-a6fd-42586d943aa4" containerName="authorino" Jul 03 19:22:06.351402 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.351308 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="22a8f223-1873-4283-a6fd-42586d943aa4" containerName="authorino" Jul 03 19:22:06.353518 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.353498 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.356810 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.356788 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 03 19:22:06.356976 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.356790 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-79k5p\"" Jul 03 19:22:06.356976 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.356861 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 03 19:22:06.357099 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.356921 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 03 19:22:06.362736 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.362716 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649"] Jul 03 19:22:06.525227 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.525190 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a13b4620-4748-4b5f-9472-03d8c901bccc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.525227 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.525232 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrx5t\" (UniqueName: \"kubernetes.io/projected/a13b4620-4748-4b5f-9472-03d8c901bccc-kube-api-access-mrx5t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.525442 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.525311 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a13b4620-4748-4b5f-9472-03d8c901bccc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.525442 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.525356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a13b4620-4748-4b5f-9472-03d8c901bccc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.525442 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.525422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a13b4620-4748-4b5f-9472-03d8c901bccc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.525546 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.525451 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a13b4620-4748-4b5f-9472-03d8c901bccc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.626848 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.626754 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a13b4620-4748-4b5f-9472-03d8c901bccc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.626848 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.626794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrx5t\" (UniqueName: \"kubernetes.io/projected/a13b4620-4748-4b5f-9472-03d8c901bccc-kube-api-access-mrx5t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.626848 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.626836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a13b4620-4748-4b5f-9472-03d8c901bccc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.627174 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.626858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a13b4620-4748-4b5f-9472-03d8c901bccc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.627174 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.626915 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a13b4620-4748-4b5f-9472-03d8c901bccc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.627174 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.626937 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a13b4620-4748-4b5f-9472-03d8c901bccc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.627371 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.627345 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a13b4620-4748-4b5f-9472-03d8c901bccc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.627429 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.627389 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a13b4620-4748-4b5f-9472-03d8c901bccc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.627429 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.627413 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a13b4620-4748-4b5f-9472-03d8c901bccc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.629168 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.629146 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a13b4620-4748-4b5f-9472-03d8c901bccc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.629459 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.629435 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a13b4620-4748-4b5f-9472-03d8c901bccc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.634150 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.634126 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrx5t\" (UniqueName: \"kubernetes.io/projected/a13b4620-4748-4b5f-9472-03d8c901bccc-kube-api-access-mrx5t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649\" (UID: \"a13b4620-4748-4b5f-9472-03d8c901bccc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.665075 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.665044 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:06.796203 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.796173 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649"] Jul 03 19:22:06.798196 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:22:06.798166 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13b4620_4748_4b5f_9472_03d8c901bccc.slice/crio-3443dc60f472fa013a7eee17be859239e56410e978d0eb5978d4941b2fdaacba WatchSource:0}: Error finding container 3443dc60f472fa013a7eee17be859239e56410e978d0eb5978d4941b2fdaacba: Status 404 returned error can't find the container with id 3443dc60f472fa013a7eee17be859239e56410e978d0eb5978d4941b2fdaacba Jul 03 19:22:06.799923 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.799903 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 19:22:06.993960 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:06.993790 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" event={"ID":"a13b4620-4748-4b5f-9472-03d8c901bccc","Type":"ContainerStarted","Data":"3443dc60f472fa013a7eee17be859239e56410e978d0eb5978d4941b2fdaacba"} Jul 03 19:22:07.856769 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:07.856737 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:22:08.007628 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:08.007588 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" event={"ID":"a13b4620-4748-4b5f-9472-03d8c901bccc","Type":"ContainerStarted","Data":"88cb3ab97900811cda26fa972a0c0967fa3aba69e0f09cba78592a2d26d212ca"} Jul 03 19:22:08.023550 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:08.023449 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" podStartSLOduration=1.048757485 podStartE2EDuration="2.023434191s" totalImagesPullingTime="974.676706ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:22:08.022287186 +0000 UTC m=+735.659032881" watchObservedRunningTime="2026-07-03 19:22:08.023434191 +0000 UTC m=+735.660179929" Jul 03 19:22:13.856263 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:13.856216 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:22:16.665517 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:16.665468 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:16.665954 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:16.665554 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:16.677862 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:16.677832 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:17.066036 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:17.065951 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649" Jul 03 19:22:41.337357 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.337317 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw"] Jul 03 19:22:41.342251 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.342224 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.344670 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.344647 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 03 19:22:41.351838 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.351811 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw"] Jul 03 19:22:41.398868 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.398815 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/865aa259-f1b6-4335-bb3c-4a8333fd3c52-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.398868 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.398881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/865aa259-f1b6-4335-bb3c-4a8333fd3c52-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.399133 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.398941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/865aa259-f1b6-4335-bb3c-4a8333fd3c52-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.399133 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.398979 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/865aa259-f1b6-4335-bb3c-4a8333fd3c52-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.399133 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.399016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/865aa259-f1b6-4335-bb3c-4a8333fd3c52-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.399133 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.399055 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2kqr\" (UniqueName: \"kubernetes.io/projected/865aa259-f1b6-4335-bb3c-4a8333fd3c52-kube-api-access-h2kqr\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.499686 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.499653 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/865aa259-f1b6-4335-bb3c-4a8333fd3c52-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.499905 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.499700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2kqr\" (UniqueName: \"kubernetes.io/projected/865aa259-f1b6-4335-bb3c-4a8333fd3c52-kube-api-access-h2kqr\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.499905 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.499760 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/865aa259-f1b6-4335-bb3c-4a8333fd3c52-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.499905 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.499785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/865aa259-f1b6-4335-bb3c-4a8333fd3c52-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.499905 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.499807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/865aa259-f1b6-4335-bb3c-4a8333fd3c52-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.499905 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.499830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/865aa259-f1b6-4335-bb3c-4a8333fd3c52-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.500177 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.500141 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/865aa259-f1b6-4335-bb3c-4a8333fd3c52-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.500239 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.500216 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/865aa259-f1b6-4335-bb3c-4a8333fd3c52-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.500334 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.500312 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/865aa259-f1b6-4335-bb3c-4a8333fd3c52-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.502474 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.502443 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/865aa259-f1b6-4335-bb3c-4a8333fd3c52-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.502599 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.502542 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/865aa259-f1b6-4335-bb3c-4a8333fd3c52-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.507284 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.507258 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2kqr\" (UniqueName: \"kubernetes.io/projected/865aa259-f1b6-4335-bb3c-4a8333fd3c52-kube-api-access-h2kqr\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw\" (UID: \"865aa259-f1b6-4335-bb3c-4a8333fd3c52\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.652358 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.652257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:41.786278 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:41.786106 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw"] Jul 03 19:22:41.788375 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:22:41.788348 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod865aa259_f1b6_4335_bb3c_4a8333fd3c52.slice/crio-2dbe8fed6ca4aadd9428cb0a93303a183c00107eef81f819b9165460476b8299 WatchSource:0}: Error finding container 2dbe8fed6ca4aadd9428cb0a93303a183c00107eef81f819b9165460476b8299: Status 404 returned error can't find the container with id 2dbe8fed6ca4aadd9428cb0a93303a183c00107eef81f819b9165460476b8299 Jul 03 19:22:42.170846 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:42.170794 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" event={"ID":"865aa259-f1b6-4335-bb3c-4a8333fd3c52","Type":"ContainerStarted","Data":"59449900958c9f07116aac2c3c458b1ca354299be46c62aa1d96139d6bfdcdba"} Jul 03 19:22:42.171186 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:42.170859 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" event={"ID":"865aa259-f1b6-4335-bb3c-4a8333fd3c52","Type":"ContainerStarted","Data":"2dbe8fed6ca4aadd9428cb0a93303a183c00107eef81f819b9165460476b8299"} Jul 03 19:22:42.186574 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:42.186414 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" podStartSLOduration=0.985855022 podStartE2EDuration="1.186393753s" totalImagesPullingTime="200.538731ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:22:42.186035854 +0000 UTC m=+769.822781536" watchObservedRunningTime="2026-07-03 19:22:42.186393753 +0000 UTC m=+769.823139415" Jul 03 19:22:43.755491 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:43.755452 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:22:51.652673 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:51.652633 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:51.653202 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:51.652691 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:51.665283 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:51.665252 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:22:52.233349 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:22:52.233311 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw" Jul 03 19:23:45.636378 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:45.636342 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54d8c5c8b6-7ndnn"] Jul 03 19:23:45.639662 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:45.639646 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54d8c5c8b6-7ndnn" Jul 03 19:23:45.642851 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:45.642809 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-svxt9\"" Jul 03 19:23:45.643060 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:45.642896 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 03 19:23:45.645177 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:45.645150 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54d8c5c8b6-7ndnn"] Jul 03 19:23:45.717674 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:45.717635 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr2l5\" (UniqueName: \"kubernetes.io/projected/1cdb51e4-fe91-42e0-a13e-13a867b21e56-kube-api-access-gr2l5\") pod \"authorino-54d8c5c8b6-7ndnn\" (UID: \"1cdb51e4-fe91-42e0-a13e-13a867b21e56\") " pod="kuadrant-system/authorino-54d8c5c8b6-7ndnn" Jul 03 19:23:45.717907 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:45.717681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1cdb51e4-fe91-42e0-a13e-13a867b21e56-tls-cert\") pod \"authorino-54d8c5c8b6-7ndnn\" (UID: \"1cdb51e4-fe91-42e0-a13e-13a867b21e56\") " pod="kuadrant-system/authorino-54d8c5c8b6-7ndnn" Jul 03 19:23:45.818152 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:45.818113 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1cdb51e4-fe91-42e0-a13e-13a867b21e56-tls-cert\") pod \"authorino-54d8c5c8b6-7ndnn\" (UID: \"1cdb51e4-fe91-42e0-a13e-13a867b21e56\") " pod="kuadrant-system/authorino-54d8c5c8b6-7ndnn" Jul 03 19:23:45.818337 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:45.818206 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2l5\" (UniqueName: \"kubernetes.io/projected/1cdb51e4-fe91-42e0-a13e-13a867b21e56-kube-api-access-gr2l5\") pod \"authorino-54d8c5c8b6-7ndnn\" (UID: \"1cdb51e4-fe91-42e0-a13e-13a867b21e56\") " pod="kuadrant-system/authorino-54d8c5c8b6-7ndnn" Jul 03 19:23:45.820672 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:45.820647 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1cdb51e4-fe91-42e0-a13e-13a867b21e56-tls-cert\") pod \"authorino-54d8c5c8b6-7ndnn\" (UID: \"1cdb51e4-fe91-42e0-a13e-13a867b21e56\") " pod="kuadrant-system/authorino-54d8c5c8b6-7ndnn" Jul 03 19:23:45.825028 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:45.825005 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr2l5\" (UniqueName: \"kubernetes.io/projected/1cdb51e4-fe91-42e0-a13e-13a867b21e56-kube-api-access-gr2l5\") pod \"authorino-54d8c5c8b6-7ndnn\" (UID: \"1cdb51e4-fe91-42e0-a13e-13a867b21e56\") " pod="kuadrant-system/authorino-54d8c5c8b6-7ndnn" Jul 03 19:23:45.949441 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:45.949337 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54d8c5c8b6-7ndnn" Jul 03 19:23:46.077225 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:46.077195 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54d8c5c8b6-7ndnn"] Jul 03 19:23:46.079301 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:23:46.079273 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cdb51e4_fe91_42e0_a13e_13a867b21e56.slice/crio-16273bd29e90583dd8e69f6fa5682028ffcdcc3337ac9db30897c5599eec7238 WatchSource:0}: Error finding container 16273bd29e90583dd8e69f6fa5682028ffcdcc3337ac9db30897c5599eec7238: Status 404 returned error can't find the container with id 16273bd29e90583dd8e69f6fa5682028ffcdcc3337ac9db30897c5599eec7238 Jul 03 19:23:46.481264 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:46.481227 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54d8c5c8b6-7ndnn" event={"ID":"1cdb51e4-fe91-42e0-a13e-13a867b21e56","Type":"ContainerStarted","Data":"16273bd29e90583dd8e69f6fa5682028ffcdcc3337ac9db30897c5599eec7238"} Jul 03 19:23:47.488029 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:47.487981 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54d8c5c8b6-7ndnn" event={"ID":"1cdb51e4-fe91-42e0-a13e-13a867b21e56","Type":"ContainerStarted","Data":"aa25da87aa1115bc52cfcfa42aae55346c9c801fc4b6e528fee1bed283dedfb6"} Jul 03 19:23:47.502282 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:23:47.502222 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54d8c5c8b6-7ndnn" podStartSLOduration=1.928080486 podStartE2EDuration="2.502206761s" totalImagesPullingTime="574.126275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:23:47.500636302 +0000 UTC m=+835.137381983" watchObservedRunningTime="2026-07-03 19:23:47.502206761 +0000 UTC m=+835.138952442" Jul 03 19:24:10.269858 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:24:10.269823 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:24:18.962866 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:24:18.962817 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:24:45.964801 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:24:45.964704 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:25:00.565404 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:25:00.565365 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:25:33.858278 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:25:33.858231 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:25:45.352689 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:25:45.352650 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:26:15.659918 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:26:15.659826 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:26:33.055390 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:26:33.055352 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:27:27.064242 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:27:27.064209 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:27:40.154002 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:27:40.153964 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:27:47.356556 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:27:47.356471 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:29:07.957426 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:29:07.957384 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:29:20.962726 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:29:20.962640 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:30:08.858010 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:30:08.857966 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:30:28.651502 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:30:28.651466 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:31:12.158532 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:31:12.158445 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:32:15.356994 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:32:15.356907 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:34:21.657847 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:34:21.657809 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:34:34.462460 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:34:34.462422 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-67449"] Jul 03 19:35:17.368014 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:17.367931 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54d8c5c8b6-7ndnn_1cdb51e4-fe91-42e0-a13e-13a867b21e56/authorino/0.log" Jul 03 19:35:21.783694 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:21.783660 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nnjh6_e7f10adb-7f2a-41c7-ae5b-38da4832f9f3/manager/0.log" Jul 03 19:35:21.898272 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:21.898244 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xkmp5_e5211f10-77bd-4d1e-8b20-c4e2c578a9d8/manager/0.log" Jul 03 19:35:22.595358 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:22.595328 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5db468f498-7jmzr_869da249-1133-4a15-aa95-2eaf39678016/copy-manifests/0.log" Jul 03 19:35:22.602021 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:22.601992 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5db468f498-7jmzr_869da249-1133-4a15-aa95-2eaf39678016/manager/0.log" Jul 03 19:35:23.740423 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:23.740392 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md_2437be66-d69a-4dfa-8835-f9ba1d242de5/extract/0.log" Jul 03 19:35:23.745937 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:23.745909 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md_2437be66-d69a-4dfa-8835-f9ba1d242de5/util/0.log" Jul 03 19:35:23.751434 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:23.751413 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md_2437be66-d69a-4dfa-8835-f9ba1d242de5/pull/0.log" Jul 03 19:35:23.858065 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:23.858036 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5_2b7aa3bf-70b0-4a5b-b8ee-440d17de8556/pull/0.log" Jul 03 19:35:23.863203 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:23.863188 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5_2b7aa3bf-70b0-4a5b-b8ee-440d17de8556/extract/0.log" Jul 03 19:35:23.868614 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:23.868597 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5_2b7aa3bf-70b0-4a5b-b8ee-440d17de8556/util/0.log" Jul 03 19:35:23.976809 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:23.976779 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf_5629b139-7406-4898-82ee-cab19e9862eb/util/0.log" Jul 03 19:35:23.982588 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:23.982569 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf_5629b139-7406-4898-82ee-cab19e9862eb/pull/0.log" Jul 03 19:35:23.988445 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:23.988424 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf_5629b139-7406-4898-82ee-cab19e9862eb/extract/0.log" Jul 03 19:35:24.097684 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:24.097659 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58_8919ec36-2171-4db8-b323-11f4e2c668ae/pull/0.log" Jul 03 19:35:24.103554 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:24.103525 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58_8919ec36-2171-4db8-b323-11f4e2c668ae/extract/0.log" Jul 03 19:35:24.108963 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:24.108943 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58_8919ec36-2171-4db8-b323-11f4e2c668ae/util/0.log" Jul 03 19:35:24.229026 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:24.228994 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54d8c5c8b6-7ndnn_1cdb51e4-fe91-42e0-a13e-13a867b21e56/authorino/0.log" Jul 03 19:35:24.943357 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:24.943332 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-67449_a039546b-18ff-406b-8e37-ed2329191a6e/limitador/0.log" Jul 03 19:35:25.058110 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:25.058076 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-t82w8_77f1d03f-697e-459c-a974-8caa9ec91edf/manager/0.log" Jul 03 19:35:25.396068 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:25.396039 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678gqt7r_5f28f846-a63e-4c64-b48a-9e3286fd46bd/istio-proxy/0.log" Jul 03 19:35:26.876390 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:26.876360 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8k649_a13b4620-4748-4b5f-9472-03d8c901bccc/main/0.log" Jul 03 19:35:27.087387 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:27.087361 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-cnljw_865aa259-f1b6-4335-bb3c-4a8333fd3c52/main/0.log" Jul 03 19:35:34.372650 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:34.372620 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9nssv_c62e02f4-4e83-4acd-aea5-6a54a58b87aa/global-pull-secret-syncer/0.log" Jul 03 19:35:34.530383 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:34.530352 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gbw2p_b0ef4969-336c-4a67-a4ab-58614ca9931a/konnectivity-agent/0.log" Jul 03 19:35:34.598217 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:34.598186 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-31.ec2.internal_eea71dadc75afc88f8ed3c86908d6173/haproxy/0.log" Jul 03 19:35:39.402241 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.402210 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md_2437be66-d69a-4dfa-8835-f9ba1d242de5/extract/0.log" Jul 03 19:35:39.432573 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.432544 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md_2437be66-d69a-4dfa-8835-f9ba1d242de5/util/0.log" Jul 03 19:35:39.458818 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.458796 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wv8md_2437be66-d69a-4dfa-8835-f9ba1d242de5/pull/0.log" Jul 03 19:35:39.485485 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.485456 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5_2b7aa3bf-70b0-4a5b-b8ee-440d17de8556/extract/0.log" Jul 03 19:35:39.506739 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.506712 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5_2b7aa3bf-70b0-4a5b-b8ee-440d17de8556/util/0.log" Jul 03 19:35:39.526629 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.526601 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e045sw5_2b7aa3bf-70b0-4a5b-b8ee-440d17de8556/pull/0.log" Jul 03 19:35:39.552833 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.552803 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf_5629b139-7406-4898-82ee-cab19e9862eb/extract/0.log" Jul 03 19:35:39.572099 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.572072 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf_5629b139-7406-4898-82ee-cab19e9862eb/util/0.log" Jul 03 19:35:39.595025 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.594995 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqqtf_5629b139-7406-4898-82ee-cab19e9862eb/pull/0.log" Jul 03 19:35:39.618974 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.618943 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58_8919ec36-2171-4db8-b323-11f4e2c668ae/extract/0.log" Jul 03 19:35:39.637545 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.637515 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58_8919ec36-2171-4db8-b323-11f4e2c668ae/util/0.log" Jul 03 19:35:39.655839 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.655770 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1p5b58_8919ec36-2171-4db8-b323-11f4e2c668ae/pull/0.log" Jul 03 19:35:39.753049 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.753011 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54d8c5c8b6-7ndnn_1cdb51e4-fe91-42e0-a13e-13a867b21e56/authorino/0.log" Jul 03 19:35:39.972557 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:39.972470 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-67449_a039546b-18ff-406b-8e37-ed2329191a6e/limitador/0.log" Jul 03 19:35:40.011481 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:40.011451 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-t82w8_77f1d03f-697e-459c-a974-8caa9ec91edf/manager/0.log" Jul 03 19:35:42.080397 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:42.080365 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llwgm_0d08717a-2a89-4c82-a0f8-5ddfa607425c/node-exporter/0.log" Jul 03 19:35:42.102409 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:42.102384 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llwgm_0d08717a-2a89-4c82-a0f8-5ddfa607425c/kube-rbac-proxy/0.log" Jul 03 19:35:42.123126 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:42.123102 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-llwgm_0d08717a-2a89-4c82-a0f8-5ddfa607425c/init-textfile/0.log" Jul 03 19:35:45.098141 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.098102 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz"] Jul 03 19:35:45.101365 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.101347 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.103694 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.103673 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9kmg\"/\"openshift-service-ca.crt\"" Jul 03 19:35:45.103791 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.103744 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c9kmg\"/\"default-dockercfg-gjmpz\"" Jul 03 19:35:45.104998 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.104979 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9kmg\"/\"kube-root-ca.crt\"" Jul 03 19:35:45.110294 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.110272 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz"] Jul 03 19:35:45.190540 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.190503 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7efeb7f1-0766-4d8a-aaf6-55896510f786-sys\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.190711 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.190547 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5fgl\" (UniqueName: \"kubernetes.io/projected/7efeb7f1-0766-4d8a-aaf6-55896510f786-kube-api-access-k5fgl\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.190711 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.190632 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7efeb7f1-0766-4d8a-aaf6-55896510f786-podres\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.190711 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.190690 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7efeb7f1-0766-4d8a-aaf6-55896510f786-proc\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.190711 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.190707 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7efeb7f1-0766-4d8a-aaf6-55896510f786-lib-modules\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.291834 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.291794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7efeb7f1-0766-4d8a-aaf6-55896510f786-proc\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.291834 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.291834 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7efeb7f1-0766-4d8a-aaf6-55896510f786-lib-modules\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.292148 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.291860 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7efeb7f1-0766-4d8a-aaf6-55896510f786-sys\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.292148 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.291922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5fgl\" (UniqueName: \"kubernetes.io/projected/7efeb7f1-0766-4d8a-aaf6-55896510f786-kube-api-access-k5fgl\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.292148 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.291961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7efeb7f1-0766-4d8a-aaf6-55896510f786-podres\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.292148 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.292023 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7efeb7f1-0766-4d8a-aaf6-55896510f786-sys\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.292148 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.292025 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7efeb7f1-0766-4d8a-aaf6-55896510f786-lib-modules\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.292148 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.292045 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7efeb7f1-0766-4d8a-aaf6-55896510f786-proc\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.292148 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.292072 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7efeb7f1-0766-4d8a-aaf6-55896510f786-podres\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.299364 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.299331 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5fgl\" (UniqueName: \"kubernetes.io/projected/7efeb7f1-0766-4d8a-aaf6-55896510f786-kube-api-access-k5fgl\") pod \"perf-node-gather-daemonset-gfxkz\" (UID: \"7efeb7f1-0766-4d8a-aaf6-55896510f786\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.412634 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.412547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.544538 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.544510 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz"] Jul 03 19:35:45.546384 ip-10-0-131-31 kubenswrapper[2580]: W0703 19:35:45.546358 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7efeb7f1_0766_4d8a_aaf6_55896510f786.slice/crio-85ec228ae11a3920f9b57651c1aceeda58a93fd7cf7d353bad669cd4792b0424 WatchSource:0}: Error finding container 85ec228ae11a3920f9b57651c1aceeda58a93fd7cf7d353bad669cd4792b0424: Status 404 returned error can't find the container with id 85ec228ae11a3920f9b57651c1aceeda58a93fd7cf7d353bad669cd4792b0424 Jul 03 19:35:45.935077 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.935033 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" event={"ID":"7efeb7f1-0766-4d8a-aaf6-55896510f786","Type":"ContainerStarted","Data":"484381effd7aa94fc808f45f39dcdd82909058a1add644622552b075262862f0"} Jul 03 19:35:45.935284 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.935097 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" event={"ID":"7efeb7f1-0766-4d8a-aaf6-55896510f786","Type":"ContainerStarted","Data":"85ec228ae11a3920f9b57651c1aceeda58a93fd7cf7d353bad669cd4792b0424"} Jul 03 19:35:45.935284 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.935177 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:45.950010 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:45.949929 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" podStartSLOduration=0.949914442 podStartE2EDuration="949.914442ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:35:45.949130531 +0000 UTC m=+1553.585876255" watchObservedRunningTime="2026-07-03 19:35:45.949914442 +0000 UTC m=+1553.586660122" Jul 03 19:35:47.019630 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:47.019605 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lrnd6_6a5b0d08-0add-40ba-b8d2-44761b1e54d7/dns/0.log" Jul 03 19:35:47.040181 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:47.040151 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lrnd6_6a5b0d08-0add-40ba-b8d2-44761b1e54d7/kube-rbac-proxy/0.log" Jul 03 19:35:47.124948 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:47.124909 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7gdj_1f84c8db-09a4-4159-af48-b3eeeb85a717/dns-node-resolver/0.log" Jul 03 19:35:47.710190 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:47.710164 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2lkpp_1a93ef31-a568-4c2d-8dbd-4327453115de/node-ca/0.log" Jul 03 19:35:48.637752 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:48.637721 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678gqt7r_5f28f846-a63e-4c64-b48a-9e3286fd46bd/istio-proxy/0.log" Jul 03 19:35:49.536238 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:49.536209 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bqptn_e3c305ed-06b4-430f-8f40-ff3d84434342/serve-healthcheck-canary/0.log" Jul 03 19:35:50.109023 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:50.108994 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpsg6_9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7/kube-rbac-proxy/0.log" Jul 03 19:35:50.129551 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:50.129525 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpsg6_9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7/exporter/0.log" Jul 03 19:35:50.150052 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:50.150022 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpsg6_9963ee1d-64f9-43c5-90fa-c91b6c1a5ec7/extractor/0.log" Jul 03 19:35:51.949816 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:51.949786 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-gfxkz" Jul 03 19:35:52.276965 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:52.276885 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nnjh6_e7f10adb-7f2a-41c7-ae5b-38da4832f9f3/manager/0.log" Jul 03 19:35:52.307848 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:52.307820 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xkmp5_e5211f10-77bd-4d1e-8b20-c4e2c578a9d8/manager/0.log" Jul 03 19:35:52.576017 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:52.575930 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5db468f498-7jmzr_869da249-1133-4a15-aa95-2eaf39678016/manager/0.log" Jul 03 19:35:52.594230 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:52.594205 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5db468f498-7jmzr_869da249-1133-4a15-aa95-2eaf39678016/copy-manifests/0.log" Jul 03 19:35:54.060609 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:54.060531 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-569d79d5df-bcd4f_95a63379-50c4-4ca7-bb91-6f58bf317dae/manager/0.log" Jul 03 19:35:55.659273 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:55.659242 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678gqt7r_5f28f846-a63e-4c64-b48a-9e3286fd46bd/istio-proxy/0.log" Jul 03 19:35:57.138105 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:57.138077 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678gqt7r_5f28f846-a63e-4c64-b48a-9e3286fd46bd/istio-proxy/0.log" Jul 03 19:35:59.414776 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:59.414749 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-nl62p_50ec8c0d-c135-4e73-b881-f3d366a75eef/migrator/0.log" Jul 03 19:35:59.434011 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:35:59.433989 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-nl62p_50ec8c0d-c135-4e73-b881-f3d366a75eef/graceful-termination/0.log" Jul 03 19:36:01.098976 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:01.098938 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nrgtv_6457dab1-5787-4473-b0e1-83aee66283ad/kube-multus-additional-cni-plugins/0.log" Jul 03 19:36:01.117487 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:01.117458 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nrgtv_6457dab1-5787-4473-b0e1-83aee66283ad/egress-router-binary-copy/0.log" Jul 03 19:36:01.136853 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:01.136829 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nrgtv_6457dab1-5787-4473-b0e1-83aee66283ad/cni-plugins/0.log" Jul 03 19:36:01.154082 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:01.154052 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nrgtv_6457dab1-5787-4473-b0e1-83aee66283ad/bond-cni-plugin/0.log" Jul 03 19:36:01.171343 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:01.171313 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nrgtv_6457dab1-5787-4473-b0e1-83aee66283ad/routeoverride-cni/0.log" Jul 03 19:36:01.188252 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:01.188231 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nrgtv_6457dab1-5787-4473-b0e1-83aee66283ad/whereabouts-cni-bincopy/0.log" Jul 03 19:36:01.206106 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:01.206082 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nrgtv_6457dab1-5787-4473-b0e1-83aee66283ad/whereabouts-cni/0.log" Jul 03 19:36:01.301440 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:01.301356 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zmtrs_29e493de-b3a6-478c-bbce-3e91a048d7c5/kube-multus/0.log" Jul 03 19:36:01.399394 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:01.399361 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qppqv_824d4565-f8d2-4099-adfb-e97ef0c6dcc2/network-metrics-daemon/0.log" Jul 03 19:36:01.417065 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:01.417037 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qppqv_824d4565-f8d2-4099-adfb-e97ef0c6dcc2/kube-rbac-proxy/0.log" Jul 03 19:36:02.201888 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:02.201852 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bc7lt_e29883ca-7474-4677-823b-0a5cbc393c29/ovn-controller/0.log" Jul 03 19:36:02.218473 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:02.218451 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bc7lt_e29883ca-7474-4677-823b-0a5cbc393c29/ovn-acl-logging/0.log" Jul 03 19:36:02.239379 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:02.239350 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bc7lt_e29883ca-7474-4677-823b-0a5cbc393c29/kube-rbac-proxy-node/0.log" Jul 03 19:36:02.258320 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:02.258293 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bc7lt_e29883ca-7474-4677-823b-0a5cbc393c29/kube-rbac-proxy-ovn-metrics/0.log" Jul 03 19:36:02.276287 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:02.276263 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bc7lt_e29883ca-7474-4677-823b-0a5cbc393c29/northd/0.log" Jul 03 19:36:02.296080 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:02.296057 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bc7lt_e29883ca-7474-4677-823b-0a5cbc393c29/nbdb/0.log" Jul 03 19:36:02.314619 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:02.314591 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bc7lt_e29883ca-7474-4677-823b-0a5cbc393c29/sbdb/0.log" Jul 03 19:36:02.353352 ip-10-0-131-31 kubenswrapper[2580]: I0703 19:36:02.353318 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bc7lt_e29883ca-7474-4677-823b-0a5cbc393c29/ovnkube-controller/0.log"