Jul 08 17:07:40.225318 ip-10-0-138-180 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 17:07:40.225328 ip-10-0-138-180 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 17:07:40.225336 ip-10-0-138-180 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 17:07:40.225595 ip-10-0-138-180 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 17:07:51.607835 ip-10-0-138-180 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 17:07:51.607853 ip-10-0-138-180 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b75e36d4e5ea406f96bee9dd1bd89dba -- Jul 08 17:09:33.469464 ip-10-0-138-180 systemd[1]: Starting Kubernetes Kubelet... Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.911622 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918252 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918268 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918272 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918276 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918279 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918283 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918286 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:09:34.054470 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918289 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:09:33.989258 ip-10-0-138-180 systemd[1]: Started Kubernetes Kubelet. Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918291 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918294 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918296 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918299 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918302 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918305 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918307 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918311 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918313 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918316 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918318 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918321 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918324 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918326 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918329 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918332 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918334 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918337 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918339 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:09:34.210283 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918343 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918346 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918348 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918351 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918354 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918357 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918360 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918362 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918365 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918367 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918370 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918373 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918375 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918378 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918380 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918383 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918385 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918389 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918392 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918395 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:09:34.211810 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918397 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918400 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918404 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918407 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918409 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918412 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918417 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918421 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918424 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918427 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918430 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918432 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918435 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918437 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918440 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918442 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918446 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918448 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918451 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:09:34.213003 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918453 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918456 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918459 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918464 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918468 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918471 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918473 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918476 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918479 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918481 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918484 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918486 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918489 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918491 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918494 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918497 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918499 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918502 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918505 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918509 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:09:34.213608 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918511 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918514 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918517 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918519 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918522 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918524 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918527 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918530 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918532 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918535 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918539 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918543 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.918546 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920071 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920081 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920085 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920088 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920092 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920095 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920099 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:09:34.214244 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920102 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920104 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920107 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920110 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920113 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920116 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920119 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920122 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920124 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920127 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920131 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920134 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920137 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920140 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920142 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920145 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920147 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920168 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920171 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920173 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:09:34.214859 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920176 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920179 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920182 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920184 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920187 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920190 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920192 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920195 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920198 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920201 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920206 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920210 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920213 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920216 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920219 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920222 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920224 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920227 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920230 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:09:34.215548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920232 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920235 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920238 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920240 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920244 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920247 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920250 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920252 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920255 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920258 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920260 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920263 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920266 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920268 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920272 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920276 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920278 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920281 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920284 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:09:34.216109 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920286 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920289 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920291 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920295 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920298 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920300 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920303 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920305 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920308 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920311 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920313 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920316 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920318 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920322 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920324 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920329 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920332 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920349 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920353 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920356 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:09:34.216770 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920360 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920362 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920365 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920368 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920370 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920373 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920376 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920379 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920382 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920384 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920387 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920390 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920393 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920395 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920784 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920789 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920792 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920795 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920798 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920800 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:09:34.217397 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920803 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920806 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920808 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920811 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920813 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920816 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920819 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920821 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920824 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920827 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920831 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920834 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920836 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920839 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920842 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920844 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920847 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920849 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920852 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920854 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920857 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:09:34.218023 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920860 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920863 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920866 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920868 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920871 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920875 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920878 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920881 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920885 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920888 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920891 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920894 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920897 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920900 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920903 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920906 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920909 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920912 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920915 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:09:34.218718 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920917 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920920 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920923 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920927 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920929 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920932 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920934 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920937 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920940 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920942 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920945 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920948 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920950 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920953 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920957 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920960 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920962 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920965 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920969 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:09:34.219343 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920971 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920974 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920976 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920979 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920982 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920985 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920987 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920989 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920992 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920995 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.920997 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921000 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921002 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921005 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921007 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921010 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921012 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921015 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921018 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921021 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:09:34.219845 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921023 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921026 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921030 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921032 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921035 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921038 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921040 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921044 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921046 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921049 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921051 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921055 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921059 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921063 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921139 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921146 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921166 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921171 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921180 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921183 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921187 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 17:09:34.220428 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921192 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921195 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921198 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921201 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921205 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921208 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921211 2567 flags.go:64] FLAG: --cgroup-root="" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921214 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921217 2567 flags.go:64] FLAG: --client-ca-file="" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921224 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921227 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921232 2567 flags.go:64] FLAG: --cluster-domain="" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921234 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921237 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921241 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921244 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921249 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921252 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921257 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921260 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921263 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921266 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921271 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921274 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 17:09:34.221016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921277 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921281 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921285 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921288 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921291 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921294 2567 flags.go:64] FLAG: --enable-server="true" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921297 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921304 2567 flags.go:64] FLAG: --event-burst="100" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921307 2567 flags.go:64] FLAG: --event-qps="50" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921310 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921313 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921316 2567 flags.go:64] FLAG: --eviction-hard="" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921320 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921323 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921326 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921329 2567 flags.go:64] FLAG: --eviction-soft="" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921332 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921334 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921345 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921348 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921351 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921354 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921357 2567 flags.go:64] FLAG: --feature-gates="" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921361 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921364 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 17:09:34.221766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921367 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921375 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921377 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921381 2567 flags.go:64] FLAG: --help="false" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921384 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921388 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921391 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921394 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921398 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921401 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921404 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921407 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921409 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921413 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921416 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921419 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921421 2567 flags.go:64] FLAG: --kube-reserved="" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921424 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921427 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921430 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921433 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921436 2567 flags.go:64] FLAG: --lock-file="" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921439 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921441 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 17:09:34.222538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921444 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921450 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921458 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921461 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921464 2567 flags.go:64] FLAG: --logging-format="text" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921467 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921470 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921473 2567 flags.go:64] FLAG: --manifest-url="" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921475 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921482 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921485 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921489 2567 flags.go:64] FLAG: --max-pods="110" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921492 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921496 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921499 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921502 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921505 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921508 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921511 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921518 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921521 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921524 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921527 2567 flags.go:64] FLAG: --pod-cidr="" Jul 08 17:09:34.223223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921530 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921535 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921538 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921541 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921545 2567 flags.go:64] FLAG: --port="10250" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921548 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921550 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07c8a9ee288005bb4" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921554 2567 flags.go:64] FLAG: --qos-reserved="" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921557 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921560 2567 flags.go:64] FLAG: --register-node="true" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921563 2567 flags.go:64] FLAG: --register-with-taints="" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921566 2567 flags.go:64] FLAG: --registry-burst="10" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921570 2567 flags.go:64] FLAG: --registry-qps="5" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921573 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921575 2567 flags.go:64] FLAG: --reserved-memory="" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921579 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921582 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921585 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921589 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921592 2567 flags.go:64] FLAG: --runonce="false" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921594 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921597 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921600 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921605 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921607 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921610 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 17:09:34.224137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921614 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921617 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921620 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921622 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921625 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921628 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921631 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921634 2567 flags.go:64] FLAG: --system-cgroups="" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921637 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921642 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921645 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921648 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921654 2567 flags.go:64] FLAG: --tls-min-version="" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921657 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921660 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921663 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921666 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921669 2567 flags.go:64] FLAG: --v="2" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921673 2567 flags.go:64] FLAG: --version="false" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921677 2567 flags.go:64] FLAG: --vmodule="" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921681 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.921684 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921797 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921801 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:09:34.225891 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921807 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921811 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921814 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921817 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921820 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921824 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921827 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921829 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921832 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921834 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921838 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921840 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921843 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921846 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921849 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921851 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921854 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921856 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921859 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921862 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:09:34.373095 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921864 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921867 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921870 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921873 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921875 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921879 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921883 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921886 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921889 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921892 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921896 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921899 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921903 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921906 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921909 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921911 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921914 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921918 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921921 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:09:34.374174 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921924 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921926 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921929 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921932 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921934 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921937 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921939 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921942 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921944 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921947 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921950 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921952 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921955 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921957 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921960 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921963 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921965 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921968 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921970 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921973 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:09:34.375055 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921975 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921978 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921981 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921983 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921986 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921991 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921993 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921996 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.921998 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922001 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922005 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922007 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922010 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922012 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922015 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922018 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922020 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922023 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922025 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:09:34.375925 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922028 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922031 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922033 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922036 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922038 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922041 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922044 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922046 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922049 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922052 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922054 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922057 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922059 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922062 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922064 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922067 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922070 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922072 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:09:34.376876 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.922077 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.922741 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.929130 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.929147 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.929184 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.929190 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929246 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929251 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929254 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929258 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929260 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929264 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929266 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929269 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929272 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:09:34.377712 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929275 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929278 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929281 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929285 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929290 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929294 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929297 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929300 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929304 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929307 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929310 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929313 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929316 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929320 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929324 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929327 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929330 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929333 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929336 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:09:34.378393 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929338 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929342 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929345 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929348 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929351 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929354 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929357 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929359 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929362 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929365 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929368 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929372 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929375 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929378 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929381 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929384 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929386 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929389 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929392 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929395 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:09:34.379504 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929397 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929400 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929403 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929405 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929409 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929413 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929416 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929419 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929422 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929426 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929430 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929433 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929435 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929438 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929441 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929444 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929447 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929450 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929453 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929455 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:09:34.380404 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929458 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929460 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929463 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929467 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929469 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929472 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929474 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929477 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929480 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929483 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929486 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929488 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929491 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929494 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929496 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929499 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929502 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929505 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929507 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929510 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:09:34.381280 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929512 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929516 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929519 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929522 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929525 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929527 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929530 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929533 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929536 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929538 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929541 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.929546 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929673 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929678 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929681 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:09:34.382196 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929685 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929688 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929692 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929695 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929697 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929701 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929704 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929706 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929709 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929712 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929715 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929718 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929720 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929723 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929726 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929729 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929731 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929734 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929737 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929742 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:09:34.382848 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929745 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929747 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929750 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929753 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929755 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929758 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929761 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929764 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929766 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929769 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929771 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929774 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929780 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929782 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929785 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929787 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929790 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929792 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929795 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:09:34.383746 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929797 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929801 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929805 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929808 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929810 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929813 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929815 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929818 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929820 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929823 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929825 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929828 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929832 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929834 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929837 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929839 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929842 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929844 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929847 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929850 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:09:34.384636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929853 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929856 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929858 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929861 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929863 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929867 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929869 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929872 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929874 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929877 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929879 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929882 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929884 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929887 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929889 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929892 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929895 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929897 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929900 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929902 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:09:34.385529 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929905 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929907 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929910 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929912 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929916 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929919 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929921 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929924 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929927 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929931 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929934 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929937 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929941 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929944 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929947 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929949 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:09:34.386428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:33.929952 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:09:34.387085 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.929958 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:09:34.387085 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.930068 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 17:09:34.387085 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.932113 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 17:09:34.387085 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.933469 2567 server.go:1019] "Starting client certificate rotation" Jul 08 17:09:34.387085 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.933566 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:09:34.387085 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.933599 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:09:34.387085 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.937838 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:09:34.387085 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.940713 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:09:34.387085 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.953682 2567 log.go:25] "Validated CRI v1 runtime API" Jul 08 17:09:34.387085 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.957797 2567 log.go:25] "Validated CRI v1 image API" Jul 08 17:09:34.387085 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.958617 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 17:09:34.387085 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.961093 2567 fs.go:135] Filesystem UUIDs: map[5902c585-9d8b-453d-9cc5-b3186b53654c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ad73e5fe-8590-4a3a-a3b3-658a982bbc57:/dev/nvme0n1p3] Jul 08 17:09:34.387738 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.961116 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 17:09:34.387738 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.964439 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.966618 2567 manager.go:216] Machine: {Timestamp:2026-07-08 17:09:33.965209684 +0000 UTC m=+0.366714094 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099890 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a4d6d2e8849c3fd8fbf425da556b9 SystemUUID:ec2a4d6d-2e88-49c3-fd8f-bf425da556b9 BootID:b75e36d4-e5ea-406f-96be-e9dd1bd89dba Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ab:f1:d4:6f:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ab:f1:d4:6f:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:3e:1a:fe:c5:a7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.966732 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.966845 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.968913 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.968942 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-180.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.970366 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.970381 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.970391 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.970410 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.971716 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.974924 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.975047 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.975087 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.975101 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.975121 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.975130 2567 kubelet.go:398] "Adding apiserver pod source" Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.975139 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 17:09:34.388177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.975506 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.975526 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.977696 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.980021 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.980049 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981063 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981076 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981083 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981089 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981098 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981104 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981113 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981118 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981126 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981131 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981140 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981145 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981840 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.981849 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.985030 2567 server.go:1268] "Started kubelet" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.985112 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.989196 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.989248 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:33.989334 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:33.989464 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-180.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.989706 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-180.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.991221 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.991468 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:33.994866 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:33.995401 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-180.ec2.internal.18c05f9b846ca9a3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-180.ec2.internal,UID:ip-10-0-138-180.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-180.ec2.internal,},FirstTimestamp:2026-07-08 17:09:33.984999843 +0000 UTC m=+0.386504254,LastTimestamp:2026-07-08 17:09:33.984999843 +0000 UTC m=+0.386504254,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-180.ec2.internal,}" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.998542 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.998545 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:33.998633 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-180.ec2.internal\" not found" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.999198 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.999214 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.999202 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.999339 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.999348 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.999633 2567 factory.go:55] Registering systemd factory Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.999670 2567 factory.go:223] Registration of the systemd container factory successfully Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.999858 2567 factory.go:153] Registering CRI-O factory Jul 08 17:09:34.391375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.999870 2567 factory.go:223] Registration of the crio container factory successfully Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.999918 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.999938 2567 factory.go:103] Registering Raw factory Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:33.999949 2567 manager.go:1196] Started watching for new ooms in manager Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.000361 2567 manager.go:349] Starting recovery of all containers Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.008472 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-180.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.010261 2567 manager.go:354] Recovery completed Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.010288 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.014676 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.016497 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.016522 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.016531 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.016992 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.017000 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.017007 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.017014 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.017695 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.017718 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.017727 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.018353 2567 policy_none.go:49] "None policy: Start" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.018394 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.018408 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.018523 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-180.ec2.internal.18c05f9b864d7460 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-180.ec2.internal,UID:ip-10-0-138-180.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-180.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-180.ec2.internal,},FirstTimestamp:2026-07-08 17:09:34.016509024 +0000 UTC m=+0.418013436,LastTimestamp:2026-07-08 17:09:34.016509024 +0000 UTC m=+0.418013436,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-180.ec2.internal,}" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.019576 2567 policy_none.go:47] "Start" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.029132 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-180.ec2.internal.18c05f9b864db6d3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-180.ec2.internal,UID:ip-10-0-138-180.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-180.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-180.ec2.internal,},FirstTimestamp:2026-07-08 17:09:34.016526035 +0000 UTC m=+0.418030444,LastTimestamp:2026-07-08 17:09:34.016526035 +0000 UTC m=+0.418030444,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-180.ec2.internal,}" Jul 08 17:09:34.393122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.037712 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g6bf7" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.040595 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-180.ec2.internal.18c05f9b864ddb40 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-180.ec2.internal,UID:ip-10-0-138-180.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-180.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-180.ec2.internal,},FirstTimestamp:2026-07-08 17:09:34.01653536 +0000 UTC m=+0.418039769,LastTimestamp:2026-07-08 17:09:34.01653536 +0000 UTC m=+0.418039769,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-180.ec2.internal,}" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.046283 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g6bf7" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.078542 2567 manager.go:337] "Starting Device Plugin manager" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.078794 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.078810 2567 server.go:87] "Starting device plugin registration server" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.079063 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.079074 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.079177 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.079265 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.079275 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.079778 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.079832 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-180.ec2.internal\" not found" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.179444 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.182240 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.182270 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.182280 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.182344 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.200017 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.200037 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-180.ec2.internal\": node \"ip-10-0-138-180.ec2.internal\" not found" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.252139 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.252219 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-180.ec2.internal\" not found" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.253388 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.253420 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.253438 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.253475 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.256304 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.352556 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-180.ec2.internal\" not found" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.353639 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-180.ec2.internal"] Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.353727 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.358103 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.358132 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.358144 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.359550 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.359661 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.359688 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.360472 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:09:34.530441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.360480 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.360504 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.360519 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.360570 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.360587 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.361930 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.361950 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.362558 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.362581 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.362593 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.404764 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2050e983844161e2057b234e4718588-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal\" (UID: \"c2050e983844161e2057b234e4718588\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.404789 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d6797f993b19877f01026719e994bf0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-180.ec2.internal\" (UID: \"5d6797f993b19877f01026719e994bf0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.404807 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2050e983844161e2057b234e4718588-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal\" (UID: \"c2050e983844161e2057b234e4718588\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.409781 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-180.ec2.internal\" not found" node="ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.413993 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-180.ec2.internal\" not found" node="ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.453624 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-180.ec2.internal\" not found" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.505359 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2050e983844161e2057b234e4718588-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal\" (UID: \"c2050e983844161e2057b234e4718588\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.505385 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d6797f993b19877f01026719e994bf0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-180.ec2.internal\" (UID: \"5d6797f993b19877f01026719e994bf0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.505401 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2050e983844161e2057b234e4718588-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal\" (UID: \"c2050e983844161e2057b234e4718588\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.505443 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2050e983844161e2057b234e4718588-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal\" (UID: \"c2050e983844161e2057b234e4718588\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.505469 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2050e983844161e2057b234e4718588-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal\" (UID: \"c2050e983844161e2057b234e4718588\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.532620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.505469 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d6797f993b19877f01026719e994bf0-config\") pod \"kube-apiserver-proxy-ip-10-0-138-180.ec2.internal\" (UID: \"5d6797f993b19877f01026719e994bf0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.711997 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.554519 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-180.ec2.internal\" not found" Jul 08 17:09:34.711997 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.654938 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-180.ec2.internal\" not found" Jul 08 17:09:34.715141 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.714770 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.880654 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.717510 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.880654 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.755419 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-180.ec2.internal\" not found" Jul 08 17:09:34.880654 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.854598 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:09:34.957838 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.899022 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.957838 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.933083 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 17:09:34.957838 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.933240 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 17:09:34.957838 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.933504 2567 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.138.180:44126->3.211.212.70:6443: use of closed network connection" Jul 08 17:09:34.957838 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.933553 2567 kubelet.go:3250] "Failed creating a mirror pod" err="unexpected error when reading response body. Please retry. Original error: read tcp 10.0.138.180:44126->3.211.212.70:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" Jul 08 17:09:34.957838 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.933570 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-180.ec2.internal" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.974296 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.975393 2567 apiserver.go:52] "Watching apiserver" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.984443 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.985254 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9d4bs","kube-system/konnectivity-agent-687zq","openshift-cluster-node-tuning-operator/tuned-cjgn9","openshift-image-registry/node-ca-gp6fb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal","openshift-multus/multus-additional-cni-plugins-fmf67","openshift-multus/network-metrics-daemon-f6jwj","openshift-network-diagnostics/network-check-target-rrn89","kube-system/kube-apiserver-proxy-ip-10-0-138-180.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458","openshift-dns/node-resolver-fbzfk","openshift-multus/multus-xlrfn","openshift-network-operator/iptables-alerter-xn4q8","openshift-ovn-kubernetes/ovnkube-node-t7wkp"] Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.988463 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.991347 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.992671 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-687zq" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.993785 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.994866 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gp6fb" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.996124 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.997299 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.997374 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.997831 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pjc98\"" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.998416 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.998422 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:34.998487 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.998539 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.998540 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.998612 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.998646 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.998914 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.999177 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.999441 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4576g\"" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.999520 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.999659 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.999725 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9qtxm\"" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:34.999752 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.000129 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.000260 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 17:09:35.100804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.000530 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.001675 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fbzfk" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.003029 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.004647 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xn4q8" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.006066 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.008980 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-modprobe-d\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009010 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-sysctl-d\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009035 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-lib-modules\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009059 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f653f2c8-1e71-4873-aa01-ff31a98cb14f-os-release\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009082 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f653f2c8-1e71-4873-aa01-ff31a98cb14f-cni-binary-copy\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009127 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl4lx\" (UniqueName: \"kubernetes.io/projected/f653f2c8-1e71-4873-aa01-ff31a98cb14f-kube-api-access-fl4lx\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009143 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nr2ht\"" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009172 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009132 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009184 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-sysconfig\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009211 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-host\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7jz4\" (UniqueName: \"kubernetes.io/projected/6e808ac0-56f2-43de-820c-c788e873dbec-kube-api-access-r7jz4\") pod \"node-ca-gp6fb\" (UID: \"6e808ac0-56f2-43de-820c-c788e873dbec\") " pod="openshift-image-registry/node-ca-gp6fb" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009269 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-registration-dir\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009302 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8v7c\" (UniqueName: \"kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c\") pod \"network-check-target-rrn89\" (UID: \"a9500b93-f23e-4463-b378-0cd8967cbaef\") " pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009327 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-sys\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.102171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e901979-aed4-4211-a8d5-5730506e1c5d-tmp\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009360 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e808ac0-56f2-43de-820c-c788e873dbec-host\") pod \"node-ca-gp6fb\" (UID: \"6e808ac0-56f2-43de-820c-c788e873dbec\") " pod="openshift-image-registry/node-ca-gp6fb" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009386 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6e808ac0-56f2-43de-820c-c788e873dbec-serviceca\") pod \"node-ca-gp6fb\" (UID: \"6e808ac0-56f2-43de-820c-c788e873dbec\") " pod="openshift-image-registry/node-ca-gp6fb" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009414 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f653f2c8-1e71-4873-aa01-ff31a98cb14f-system-cni-dir\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009432 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g2zg4\"" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009443 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f653f2c8-1e71-4873-aa01-ff31a98cb14f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009471 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-socket-dir\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009496 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-device-dir\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009522 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcfn9\" (UniqueName: \"kubernetes.io/projected/e8310662-9b6b-481e-a746-2ad820ca153c-kube-api-access-bcfn9\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009567 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs\") pod \"network-metrics-daemon-f6jwj\" (UID: \"506c8214-179c-4cb1-91c2-6f282fdca948\") " pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009603 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ghpb\" (UniqueName: \"kubernetes.io/projected/506c8214-179c-4cb1-91c2-6f282fdca948-kube-api-access-8ghpb\") pod \"network-metrics-daemon-f6jwj\" (UID: \"506c8214-179c-4cb1-91c2-6f282fdca948\") " pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f653f2c8-1e71-4873-aa01-ff31a98cb14f-cnibin\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f653f2c8-1e71-4873-aa01-ff31a98cb14f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-sys-fs\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009711 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-kubelet-config\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:35.102949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009729 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-var-lib-kubelet\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-tuned\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009758 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-dbus\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-kubernetes\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009786 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-sysctl-conf\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-systemd\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009864 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-run\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009888 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009912 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-etc-selinux\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4357f9ee-c302-449a-ba96-678febe063ae-agent-certs\") pod \"konnectivity-agent-687zq\" (UID: \"4357f9ee-c302-449a-ba96-678febe063ae\") " pod="kube-system/konnectivity-agent-687zq" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009959 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4357f9ee-c302-449a-ba96-678febe063ae-konnectivity-ca\") pod \"konnectivity-agent-687zq\" (UID: \"4357f9ee-c302-449a-ba96-678febe063ae\") " pod="kube-system/konnectivity-agent-687zq" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.009982 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv74p\" (UniqueName: \"kubernetes.io/projected/6e901979-aed4-4211-a8d5-5730506e1c5d-kube-api-access-vv74p\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.010007 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f653f2c8-1e71-4873-aa01-ff31a98cb14f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.010120 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qbr2k\"" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.010292 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.010363 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.010375 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.010689 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.011233 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.011294 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n77qj\"" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.011473 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.011620 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 17:09:35.103466 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.011732 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.011743 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7k8wn\"" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.011796 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.012313 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.012371 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.012468 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.012454 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.012555 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5jpb5\"" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.012581 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.021001 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.048004 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 17:04:34 +0000 UTC" deadline="2028-03-25 15:14:11.535036448 +0000 UTC" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.048050 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15022h4m36.486990092s" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.064615 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p8gmz" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.075680 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p8gmz" Jul 08 17:09:35.104207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.100043 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110691 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f653f2c8-1e71-4873-aa01-ff31a98cb14f-system-cni-dir\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110726 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-socket-dir\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110747 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-run-netns\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110764 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9hhn\" (UniqueName: \"kubernetes.io/projected/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-kube-api-access-f9hhn\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-var-lib-cni-multus\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110803 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f653f2c8-1e71-4873-aa01-ff31a98cb14f-system-cni-dir\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-device-dir\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110847 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-device-dir\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110879 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-run-openvswitch\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110903 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f653f2c8-1e71-4873-aa01-ff31a98cb14f-cnibin\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110925 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-kubelet-config\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110947 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-var-lib-kubelet\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110969 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-var-lib-kubelet\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110976 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f653f2c8-1e71-4873-aa01-ff31a98cb14f-cnibin\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110991 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-dbus\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:35.195875 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.111017 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111020 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-var-lib-kubelet\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.110980 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-kubelet-config\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111015 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.111078 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret podName:766e4d7c-1d51-4db8-bdc4-3be62175a3a6 nodeName:}" failed. No retries permitted until 2026-07-08 17:09:35.611059341 +0000 UTC m=+2.012563762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret") pod "global-pull-secret-syncer-9d4bs" (UID: "766e4d7c-1d51-4db8-bdc4-3be62175a3a6") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111098 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8899e7f-6aab-4a26-9ada-63336b5a05d4-iptables-alerter-script\") pod \"iptables-alerter-xn4q8\" (UID: \"e8899e7f-6aab-4a26-9ada-63336b5a05d4\") " pod="openshift-network-operator/iptables-alerter-xn4q8" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-kubernetes\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-systemd\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-run\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111203 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e-hosts-file\") pod \"node-resolver-fbzfk\" (UID: \"6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e\") " pod="openshift-dns/node-resolver-fbzfk" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111220 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgxnn\" (UniqueName: \"kubernetes.io/projected/6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e-kube-api-access-dgxnn\") pod \"node-resolver-fbzfk\" (UID: \"6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e\") " pod="openshift-dns/node-resolver-fbzfk" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111223 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-dbus\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111200 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-kubernetes\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111242 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-systemd\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-var-lib-openvswitch\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111307 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4357f9ee-c302-449a-ba96-678febe063ae-konnectivity-ca\") pod \"konnectivity-agent-687zq\" (UID: \"4357f9ee-c302-449a-ba96-678febe063ae\") " pod="kube-system/konnectivity-agent-687zq" Jul 08 17:09:35.196610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111320 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-run\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-etc-openvswitch\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111369 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-hostroot\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111397 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-sysctl-d\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111417 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-slash\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111439 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-log-socket\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111459 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-ovnkube-config\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111478 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-multus-cni-dir\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111485 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-sysctl-d\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111519 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-cnibin\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111544 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7jz4\" (UniqueName: \"kubernetes.io/projected/6e808ac0-56f2-43de-820c-c788e873dbec-kube-api-access-r7jz4\") pod \"node-ca-gp6fb\" (UID: \"6e808ac0-56f2-43de-820c-c788e873dbec\") " pod="openshift-image-registry/node-ca-gp6fb" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-registration-dir\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111610 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-system-cni-dir\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111647 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8899e7f-6aab-4a26-9ada-63336b5a05d4-host-slash\") pod \"iptables-alerter-xn4q8\" (UID: \"e8899e7f-6aab-4a26-9ada-63336b5a05d4\") " pod="openshift-network-operator/iptables-alerter-xn4q8" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111653 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-registration-dir\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111664 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-sys\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.197226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e901979-aed4-4211-a8d5-5730506e1c5d-tmp\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111721 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f653f2c8-1e71-4873-aa01-ff31a98cb14f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111731 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-sys\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111744 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs\") pod \"network-metrics-daemon-f6jwj\" (UID: \"506c8214-179c-4cb1-91c2-6f282fdca948\") " pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111760 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-kubelet\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111776 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-ovnkube-script-lib\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111792 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-var-lib-cni-bin\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.111807 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111817 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcfn9\" (UniqueName: \"kubernetes.io/projected/e8310662-9b6b-481e-a746-2ad820ca153c-kube-api-access-bcfn9\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111841 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-socket-dir\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111852 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ghpb\" (UniqueName: \"kubernetes.io/projected/506c8214-179c-4cb1-91c2-6f282fdca948-kube-api-access-8ghpb\") pod \"network-metrics-daemon-f6jwj\" (UID: \"506c8214-179c-4cb1-91c2-6f282fdca948\") " pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111884 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-multus-daemon-config\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111901 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f653f2c8-1e71-4873-aa01-ff31a98cb14f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.111944 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs podName:506c8214-179c-4cb1-91c2-6f282fdca948 nodeName:}" failed. No retries permitted until 2026-07-08 17:09:35.611929474 +0000 UTC m=+2.013433871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs") pod "network-metrics-daemon-f6jwj" (UID: "506c8214-179c-4cb1-91c2-6f282fdca948") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111961 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f653f2c8-1e71-4873-aa01-ff31a98cb14f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-sys-fs\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.111992 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 17:09:35.197776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112006 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e-tmp-dir\") pod \"node-resolver-fbzfk\" (UID: \"6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e\") " pod="openshift-dns/node-resolver-fbzfk" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112033 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-run-ovn\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112047 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-env-overrides\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112055 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-sys-fs\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112061 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-ovn-node-metrics-cert\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112097 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-tuned\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112133 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-os-release\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112186 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-multus-conf-dir\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112211 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-etc-kubernetes\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112240 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-sysctl-conf\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112267 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-etc-selinux\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112314 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-systemd-units\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112358 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-node-log\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112374 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112384 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4357f9ee-c302-449a-ba96-678febe063ae-agent-certs\") pod \"konnectivity-agent-687zq\" (UID: \"4357f9ee-c302-449a-ba96-678febe063ae\") " pod="kube-system/konnectivity-agent-687zq" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112410 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv74p\" (UniqueName: \"kubernetes.io/projected/6e901979-aed4-4211-a8d5-5730506e1c5d-kube-api-access-vv74p\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.198827 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112426 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e8310662-9b6b-481e-a746-2ad820ca153c-etc-selinux\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112436 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f653f2c8-1e71-4873-aa01-ff31a98cb14f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112465 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-cni-bin\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112489 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-cni-netd\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112513 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-cni-binary-copy\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-run-netns\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112569 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-modprobe-d\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112595 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-lib-modules\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112621 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f653f2c8-1e71-4873-aa01-ff31a98cb14f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112623 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f653f2c8-1e71-4873-aa01-ff31a98cb14f-os-release\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f653f2c8-1e71-4873-aa01-ff31a98cb14f-cni-binary-copy\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112682 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f653f2c8-1e71-4873-aa01-ff31a98cb14f-os-release\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112688 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl4lx\" (UniqueName: \"kubernetes.io/projected/f653f2c8-1e71-4873-aa01-ff31a98cb14f-kube-api-access-fl4lx\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112718 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-run-systemd\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-multus-socket-dir-parent\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112754 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4357f9ee-c302-449a-ba96-678febe063ae-konnectivity-ca\") pod \"konnectivity-agent-687zq\" (UID: \"4357f9ee-c302-449a-ba96-678febe063ae\") " pod="kube-system/konnectivity-agent-687zq" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112772 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-run-multus-certs\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.199368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-sysconfig\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112802 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-sysctl-conf\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112856 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-sysconfig\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112882 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-host\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112890 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-lib-modules\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112905 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8v7c\" (UniqueName: \"kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c\") pod \"network-check-target-rrn89\" (UID: \"a9500b93-f23e-4463-b378-0cd8967cbaef\") " pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112932 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-run-k8s-cni-cncf-io\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112957 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-host\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.112989 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grzd4\" (UniqueName: \"kubernetes.io/projected/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-kube-api-access-grzd4\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.113027 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc9zb\" (UniqueName: \"kubernetes.io/projected/e8899e7f-6aab-4a26-9ada-63336b5a05d4-kube-api-access-sc9zb\") pod \"iptables-alerter-xn4q8\" (UID: \"e8899e7f-6aab-4a26-9ada-63336b5a05d4\") " pod="openshift-network-operator/iptables-alerter-xn4q8" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.113055 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e808ac0-56f2-43de-820c-c788e873dbec-host\") pod \"node-ca-gp6fb\" (UID: \"6e808ac0-56f2-43de-820c-c788e873dbec\") " pod="openshift-image-registry/node-ca-gp6fb" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.113056 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-modprobe-d\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.113089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6e808ac0-56f2-43de-820c-c788e873dbec-serviceca\") pod \"node-ca-gp6fb\" (UID: \"6e808ac0-56f2-43de-820c-c788e873dbec\") " pod="openshift-image-registry/node-ca-gp6fb" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.113106 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e808ac0-56f2-43de-820c-c788e873dbec-host\") pod \"node-ca-gp6fb\" (UID: \"6e808ac0-56f2-43de-820c-c788e873dbec\") " pod="openshift-image-registry/node-ca-gp6fb" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.113239 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f653f2c8-1e71-4873-aa01-ff31a98cb14f-cni-binary-copy\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.113358 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f653f2c8-1e71-4873-aa01-ff31a98cb14f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.113519 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6e808ac0-56f2-43de-820c-c788e873dbec-serviceca\") pod \"node-ca-gp6fb\" (UID: \"6e808ac0-56f2-43de-820c-c788e873dbec\") " pod="openshift-image-registry/node-ca-gp6fb" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.115008 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e901979-aed4-4211-a8d5-5730506e1c5d-etc-tuned\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.199933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.115043 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e901979-aed4-4211-a8d5-5730506e1c5d-tmp\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.200617 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.115318 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4357f9ee-c302-449a-ba96-678febe063ae-agent-certs\") pod \"konnectivity-agent-687zq\" (UID: \"4357f9ee-c302-449a-ba96-678febe063ae\") " pod="kube-system/konnectivity-agent-687zq" Jul 08 17:09:35.200617 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.122788 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcfn9\" (UniqueName: \"kubernetes.io/projected/e8310662-9b6b-481e-a746-2ad820ca153c-kube-api-access-bcfn9\") pod \"aws-ebs-csi-driver-node-4q458\" (UID: \"e8310662-9b6b-481e-a746-2ad820ca153c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.200617 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.122923 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7jz4\" (UniqueName: \"kubernetes.io/projected/6e808ac0-56f2-43de-820c-c788e873dbec-kube-api-access-r7jz4\") pod \"node-ca-gp6fb\" (UID: \"6e808ac0-56f2-43de-820c-c788e873dbec\") " pod="openshift-image-registry/node-ca-gp6fb" Jul 08 17:09:35.200617 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.124714 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:09:35.200617 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.124731 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:09:35.200617 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.124741 2567 projected.go:196] Error preparing data for projected volume kube-api-access-k8v7c for pod openshift-network-diagnostics/network-check-target-rrn89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:09:35.200617 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.124787 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c podName:a9500b93-f23e-4463-b378-0cd8967cbaef nodeName:}" failed. No retries permitted until 2026-07-08 17:09:35.624775461 +0000 UTC m=+2.026279857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k8v7c" (UniqueName: "kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c") pod "network-check-target-rrn89" (UID: "a9500b93-f23e-4463-b378-0cd8967cbaef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:09:35.200617 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.125386 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv74p\" (UniqueName: \"kubernetes.io/projected/6e901979-aed4-4211-a8d5-5730506e1c5d-kube-api-access-vv74p\") pod \"tuned-cjgn9\" (UID: \"6e901979-aed4-4211-a8d5-5730506e1c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.200617 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.127465 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl4lx\" (UniqueName: \"kubernetes.io/projected/f653f2c8-1e71-4873-aa01-ff31a98cb14f-kube-api-access-fl4lx\") pod \"multus-additional-cni-plugins-fmf67\" (UID: \"f653f2c8-1e71-4873-aa01-ff31a98cb14f\") " pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.200617 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.151949 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ghpb\" (UniqueName: \"kubernetes.io/projected/506c8214-179c-4cb1-91c2-6f282fdca948-kube-api-access-8ghpb\") pod \"network-metrics-daemon-f6jwj\" (UID: \"506c8214-179c-4cb1-91c2-6f282fdca948\") " pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213434 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-var-lib-cni-bin\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213477 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-multus-daemon-config\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213502 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e-tmp-dir\") pod \"node-resolver-fbzfk\" (UID: \"6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e\") " pod="openshift-dns/node-resolver-fbzfk" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213524 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-run-ovn\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213541 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-var-lib-cni-bin\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213545 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-env-overrides\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213615 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-run-ovn\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213676 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-ovn-node-metrics-cert\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-os-release\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213725 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-multus-conf-dir\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213748 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-etc-kubernetes\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213773 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-systemd-units\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-node-log\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213805 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-os-release\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213819 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-cni-bin\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213823 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-etc-kubernetes\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213827 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-multus-conf-dir\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.334809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213843 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-cni-netd\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213826 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e-tmp-dir\") pod \"node-resolver-fbzfk\" (UID: \"6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e\") " pod="openshift-dns/node-resolver-fbzfk" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213852 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-systemd-units\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213863 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-node-log\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213868 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-cni-binary-copy\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213907 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-cni-bin\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213961 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-cni-netd\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213973 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-env-overrides\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.213996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-run-netns\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214022 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-run-netns\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214037 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-run-systemd\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214063 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-multus-socket-dir-parent\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214073 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-run-systemd\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214087 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-run-multus-certs\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214034 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-multus-daemon-config\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214126 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-multus-socket-dir-parent\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-run-k8s-cni-cncf-io\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214139 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-run-multus-certs\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.335597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grzd4\" (UniqueName: \"kubernetes.io/projected/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-kube-api-access-grzd4\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214181 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-run-k8s-cni-cncf-io\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc9zb\" (UniqueName: \"kubernetes.io/projected/e8899e7f-6aab-4a26-9ada-63336b5a05d4-kube-api-access-sc9zb\") pod \"iptables-alerter-xn4q8\" (UID: \"e8899e7f-6aab-4a26-9ada-63336b5a05d4\") " pod="openshift-network-operator/iptables-alerter-xn4q8" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214225 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-run-netns\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214247 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9hhn\" (UniqueName: \"kubernetes.io/projected/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-kube-api-access-f9hhn\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214269 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-var-lib-cni-multus\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214294 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-cni-binary-copy\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-run-openvswitch\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214325 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-var-lib-kubelet\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214350 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-var-lib-cni-multus\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214377 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-host-var-lib-kubelet\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214377 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8899e7f-6aab-4a26-9ada-63336b5a05d4-iptables-alerter-script\") pod \"iptables-alerter-xn4q8\" (UID: \"e8899e7f-6aab-4a26-9ada-63336b5a05d4\") " pod="openshift-network-operator/iptables-alerter-xn4q8" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214390 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-run-openvswitch\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214349 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-run-netns\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214424 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e-hosts-file\") pod \"node-resolver-fbzfk\" (UID: \"6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e\") " pod="openshift-dns/node-resolver-fbzfk" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214438 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214445 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgxnn\" (UniqueName: \"kubernetes.io/projected/6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e-kube-api-access-dgxnn\") pod \"node-resolver-fbzfk\" (UID: \"6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e\") " pod="openshift-dns/node-resolver-fbzfk" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214492 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-var-lib-openvswitch\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214525 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-etc-openvswitch\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214551 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-hostroot\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214526 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e-hosts-file\") pod \"node-resolver-fbzfk\" (UID: \"6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e\") " pod="openshift-dns/node-resolver-fbzfk" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214559 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-etc-openvswitch\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214553 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-var-lib-openvswitch\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214576 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-slash\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214599 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-hostroot\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214608 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-log-socket\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214632 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-ovnkube-config\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214651 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-slash\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214658 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-log-socket\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214660 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-multus-cni-dir\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214688 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-cnibin\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214710 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-multus-cni-dir\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214740 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-system-cni-dir\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.337624 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214745 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-cnibin\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214741 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214763 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8899e7f-6aab-4a26-9ada-63336b5a05d4-host-slash\") pod \"iptables-alerter-xn4q8\" (UID: \"e8899e7f-6aab-4a26-9ada-63336b5a05d4\") " pod="openshift-network-operator/iptables-alerter-xn4q8" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214783 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-system-cni-dir\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214793 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e8899e7f-6aab-4a26-9ada-63336b5a05d4-iptables-alerter-script\") pod \"iptables-alerter-xn4q8\" (UID: \"e8899e7f-6aab-4a26-9ada-63336b5a05d4\") " pod="openshift-network-operator/iptables-alerter-xn4q8" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214802 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-kubelet\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214830 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-ovnkube-script-lib\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214837 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8899e7f-6aab-4a26-9ada-63336b5a05d4-host-slash\") pod \"iptables-alerter-xn4q8\" (UID: \"e8899e7f-6aab-4a26-9ada-63336b5a05d4\") " pod="openshift-network-operator/iptables-alerter-xn4q8" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.214849 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-host-kubelet\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.215098 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-ovnkube-config\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.215264 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-ovnkube-script-lib\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.215898 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-ovn-node-metrics-cert\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.223885 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgxnn\" (UniqueName: \"kubernetes.io/projected/6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e-kube-api-access-dgxnn\") pod \"node-resolver-fbzfk\" (UID: \"6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e\") " pod="openshift-dns/node-resolver-fbzfk" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.224835 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc9zb\" (UniqueName: \"kubernetes.io/projected/e8899e7f-6aab-4a26-9ada-63336b5a05d4-kube-api-access-sc9zb\") pod \"iptables-alerter-xn4q8\" (UID: \"e8899e7f-6aab-4a26-9ada-63336b5a05d4\") " pod="openshift-network-operator/iptables-alerter-xn4q8" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.225242 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grzd4\" (UniqueName: \"kubernetes.io/projected/8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3-kube-api-access-grzd4\") pod \"multus-xlrfn\" (UID: \"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3\") " pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.225908 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9hhn\" (UniqueName: \"kubernetes.io/projected/b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7-kube-api-access-f9hhn\") pod \"ovnkube-node-t7wkp\" (UID: \"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.338313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.330085 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-687zq" Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.346022 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.364796 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gp6fb" Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.372424 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:35.373720 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e901979_aed4_4211_a8d5_5730506e1c5d.slice/crio-a4641c857f9d48a1e30833523b7f3b64b1c450e9734eff3770c7334cbbb365ee WatchSource:0}: Error finding container a4641c857f9d48a1e30833523b7f3b64b1c450e9734eff3770c7334cbbb365ee: Status 404 returned error can't find the container with id a4641c857f9d48a1e30833523b7f3b64b1c450e9734eff3770c7334cbbb365ee Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.374062 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:35.374297 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6797f993b19877f01026719e994bf0.slice/crio-32e79dea3b0e83b6e962afdae0a1f077d7b9b5a61a8137d030404729dc58cc27 WatchSource:0}: Error finding container 32e79dea3b0e83b6e962afdae0a1f077d7b9b5a61a8137d030404729dc58cc27: Status 404 returned error can't find the container with id 32e79dea3b0e83b6e962afdae0a1f077d7b9b5a61a8137d030404729dc58cc27 Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:35.374878 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e808ac0_56f2_43de_820c_c788e873dbec.slice/crio-38cea0e8dcf7c51f82a0abbba410de9bb03912ffe3752889ebbb60e7c0562d07 WatchSource:0}: Error finding container 38cea0e8dcf7c51f82a0abbba410de9bb03912ffe3752889ebbb60e7c0562d07: Status 404 returned error can't find the container with id 38cea0e8dcf7c51f82a0abbba410de9bb03912ffe3752889ebbb60e7c0562d07 Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.379178 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.393850 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fmf67" Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.399656 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:35.404974 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf653f2c8_1e71_4873_aa01_ff31a98cb14f.slice/crio-d6de44a86dad648968e30a0cfee250aed00c62b1502fd5fb6a59ee0db3acc688 WatchSource:0}: Error finding container d6de44a86dad648968e30a0cfee250aed00c62b1502fd5fb6a59ee0db3acc688: Status 404 returned error can't find the container with id d6de44a86dad648968e30a0cfee250aed00c62b1502fd5fb6a59ee0db3acc688 Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:35.409374 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8310662_9b6b_481e_a746_2ad820ca153c.slice/crio-71b5c4d7614b65b91e7428c954eb6159f6ad1a01cb3a13c76e371492d88163dd WatchSource:0}: Error finding container 71b5c4d7614b65b91e7428c954eb6159f6ad1a01cb3a13c76e371492d88163dd: Status 404 returned error can't find the container with id 71b5c4d7614b65b91e7428c954eb6159f6ad1a01cb3a13c76e371492d88163dd Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:35.431018 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2050e983844161e2057b234e4718588.slice/crio-042d1e2eefbb73916439dbcc8c4814b29b02a06e4a0e220b98c5a913e5b8870e WatchSource:0}: Error finding container 042d1e2eefbb73916439dbcc8c4814b29b02a06e4a0e220b98c5a913e5b8870e: Status 404 returned error can't find the container with id 042d1e2eefbb73916439dbcc8c4814b29b02a06e4a0e220b98c5a913e5b8870e Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.441893 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fbzfk" Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.447759 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xlrfn" Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:35.448737 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad2f2a1_97af_4cd8_8166_c1b9bf2c928e.slice/crio-ad4a60d47c53825df22d837c4c8f6b5ab0c6e0556eb2574da996e7b16c030bc3 WatchSource:0}: Error finding container ad4a60d47c53825df22d837c4c8f6b5ab0c6e0556eb2574da996e7b16c030bc3: Status 404 returned error can't find the container with id ad4a60d47c53825df22d837c4c8f6b5ab0c6e0556eb2574da996e7b16c030bc3 Jul 08 17:09:35.465695 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:35.454739 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa60a71_f6c1_45f6_83d5_174ec7b9ecb3.slice/crio-f92a641c7f35b93ecc4603f8b071ea68ccee5501539c6245052c82ab8040a34a WatchSource:0}: Error finding container f92a641c7f35b93ecc4603f8b071ea68ccee5501539c6245052c82ab8040a34a: Status 404 returned error can't find the container with id f92a641c7f35b93ecc4603f8b071ea68ccee5501539c6245052c82ab8040a34a Jul 08 17:09:35.624362 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.478466 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xn4q8" Jul 08 17:09:35.624362 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:35.486200 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8899e7f_6aab_4a26_9ada_63336b5a05d4.slice/crio-f86474fd869317da0a40adb05e67ec5bb8d84769191bac49d79c2974add2a1c9 WatchSource:0}: Error finding container f86474fd869317da0a40adb05e67ec5bb8d84769191bac49d79c2974add2a1c9: Status 404 returned error can't find the container with id f86474fd869317da0a40adb05e67ec5bb8d84769191bac49d79c2974add2a1c9 Jul 08 17:09:35.624362 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.492907 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:09:35.624362 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:35.500739 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5aa675b_9f8b_4f8c_a2ab_d5dd209c84c7.slice/crio-04d93bd745e09476820ecfebe116da5ed027a4ae018c111be5359fdba6c19148 WatchSource:0}: Error finding container 04d93bd745e09476820ecfebe116da5ed027a4ae018c111be5359fdba6c19148: Status 404 returned error can't find the container with id 04d93bd745e09476820ecfebe116da5ed027a4ae018c111be5359fdba6c19148 Jul 08 17:09:35.624362 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.616949 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:35.624362 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.616996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs\") pod \"network-metrics-daemon-f6jwj\" (UID: \"506c8214-179c-4cb1-91c2-6f282fdca948\") " pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:35.624362 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.617087 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:09:35.624362 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.617142 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs podName:506c8214-179c-4cb1-91c2-6f282fdca948 nodeName:}" failed. No retries permitted until 2026-07-08 17:09:36.617126045 +0000 UTC m=+3.018630441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs") pod "network-metrics-daemon-f6jwj" (UID: "506c8214-179c-4cb1-91c2-6f282fdca948") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:09:35.624362 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.617088 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:09:35.624362 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.617230 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret podName:766e4d7c-1d51-4db8-bdc4-3be62175a3a6 nodeName:}" failed. No retries permitted until 2026-07-08 17:09:36.61721399 +0000 UTC m=+3.018718387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret") pod "global-pull-secret-syncer-9d4bs" (UID: "766e4d7c-1d51-4db8-bdc4-3be62175a3a6") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:09:35.787597 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:35.717914 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8v7c\" (UniqueName: \"kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c\") pod \"network-check-target-rrn89\" (UID: \"a9500b93-f23e-4463-b378-0cd8967cbaef\") " pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:35.787597 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.718052 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:09:35.787597 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.718067 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:09:35.787597 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.718076 2567 projected.go:196] Error preparing data for projected volume kube-api-access-k8v7c for pod openshift-network-diagnostics/network-check-target-rrn89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:09:35.787597 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:35.718123 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c podName:a9500b93-f23e-4463-b378-0cd8967cbaef nodeName:}" failed. No retries permitted until 2026-07-08 17:09:36.71811055 +0000 UTC m=+3.119614947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8v7c" (UniqueName: "kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c") pod "network-check-target-rrn89" (UID: "a9500b93-f23e-4463-b378-0cd8967cbaef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:09:36.059667 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.010913 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:09:36.133936 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.078214 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:04:35 +0000 UTC" deadline="2028-03-08 22:27:31.848269015 +0000 UTC" Jul 08 17:09:36.133936 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.078265 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14621h17m55.770007389s" Jul 08 17:09:36.254918 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.254891 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:36.255048 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:36.255023 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:09:36.255480 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.255459 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:36.255604 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:36.255584 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:09:36.261276 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:09:36.261251 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4357f9ee_c302_449a_ba96_678febe063ae.slice/crio-a3f9ac1172d5e58f9ba0eb72c7d2e7fbe37c1f1bc8143738c6bacf4c089201a1 WatchSource:0}: Error finding container a3f9ac1172d5e58f9ba0eb72c7d2e7fbe37c1f1bc8143738c6bacf4c089201a1: Status 404 returned error can't find the container with id a3f9ac1172d5e58f9ba0eb72c7d2e7fbe37c1f1bc8143738c6bacf4c089201a1 Jul 08 17:09:36.275285 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.275192 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gp6fb" event={"ID":"6e808ac0-56f2-43de-820c-c788e873dbec","Type":"ContainerStarted","Data":"38cea0e8dcf7c51f82a0abbba410de9bb03912ffe3752889ebbb60e7c0562d07"} Jul 08 17:09:36.284790 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.284751 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" event={"ID":"6e901979-aed4-4211-a8d5-5730506e1c5d","Type":"ContainerStarted","Data":"a4641c857f9d48a1e30833523b7f3b64b1c450e9734eff3770c7334cbbb365ee"} Jul 08 17:09:36.286949 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.286884 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-180.ec2.internal" event={"ID":"5d6797f993b19877f01026719e994bf0","Type":"ContainerStarted","Data":"32e79dea3b0e83b6e962afdae0a1f077d7b9b5a61a8137d030404729dc58cc27"} Jul 08 17:09:36.293898 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.293848 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xn4q8" event={"ID":"e8899e7f-6aab-4a26-9ada-63336b5a05d4","Type":"ContainerStarted","Data":"f86474fd869317da0a40adb05e67ec5bb8d84769191bac49d79c2974add2a1c9"} Jul 08 17:09:36.295960 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.295887 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" event={"ID":"c2050e983844161e2057b234e4718588","Type":"ContainerStarted","Data":"042d1e2eefbb73916439dbcc8c4814b29b02a06e4a0e220b98c5a913e5b8870e"} Jul 08 17:09:36.297951 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.297879 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmf67" event={"ID":"f653f2c8-1e71-4873-aa01-ff31a98cb14f","Type":"ContainerStarted","Data":"d6de44a86dad648968e30a0cfee250aed00c62b1502fd5fb6a59ee0db3acc688"} Jul 08 17:09:36.303844 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.303745 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" event={"ID":"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7","Type":"ContainerStarted","Data":"04d93bd745e09476820ecfebe116da5ed027a4ae018c111be5359fdba6c19148"} Jul 08 17:09:36.313463 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.313351 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xlrfn" event={"ID":"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3","Type":"ContainerStarted","Data":"f92a641c7f35b93ecc4603f8b071ea68ccee5501539c6245052c82ab8040a34a"} Jul 08 17:09:36.332172 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.328899 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fbzfk" event={"ID":"6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e","Type":"ContainerStarted","Data":"ad4a60d47c53825df22d837c4c8f6b5ab0c6e0556eb2574da996e7b16c030bc3"} Jul 08 17:09:36.334289 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.334258 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" event={"ID":"e8310662-9b6b-481e-a746-2ad820ca153c","Type":"ContainerStarted","Data":"71b5c4d7614b65b91e7428c954eb6159f6ad1a01cb3a13c76e371492d88163dd"} Jul 08 17:09:36.626438 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.626356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:36.626604 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.626452 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs\") pod \"network-metrics-daemon-f6jwj\" (UID: \"506c8214-179c-4cb1-91c2-6f282fdca948\") " pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:36.626604 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:36.626580 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:09:36.626721 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:36.626640 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs podName:506c8214-179c-4cb1-91c2-6f282fdca948 nodeName:}" failed. No retries permitted until 2026-07-08 17:09:38.626622334 +0000 UTC m=+5.028126735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs") pod "network-metrics-daemon-f6jwj" (UID: "506c8214-179c-4cb1-91c2-6f282fdca948") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:09:36.627171 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:36.627024 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:09:36.627171 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:36.627079 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret podName:766e4d7c-1d51-4db8-bdc4-3be62175a3a6 nodeName:}" failed. No retries permitted until 2026-07-08 17:09:38.627064544 +0000 UTC m=+5.028568955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret") pod "global-pull-secret-syncer-9d4bs" (UID: "766e4d7c-1d51-4db8-bdc4-3be62175a3a6") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:09:36.727439 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:36.726750 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8v7c\" (UniqueName: \"kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c\") pod \"network-check-target-rrn89\" (UID: \"a9500b93-f23e-4463-b378-0cd8967cbaef\") " pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:36.727439 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:36.726979 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:09:36.727439 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:36.726998 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:09:36.727439 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:36.727010 2567 projected.go:196] Error preparing data for projected volume kube-api-access-k8v7c for pod openshift-network-diagnostics/network-check-target-rrn89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:09:36.727439 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:36.727068 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c podName:a9500b93-f23e-4463-b378-0cd8967cbaef nodeName:}" failed. No retries permitted until 2026-07-08 17:09:38.727049284 +0000 UTC m=+5.128553684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8v7c" (UniqueName: "kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c") pod "network-check-target-rrn89" (UID: "a9500b93-f23e-4463-b378-0cd8967cbaef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:09:37.078879 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:37.078755 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:04:35 +0000 UTC" deadline="2028-01-19 17:02:33.365598445 +0000 UTC" Jul 08 17:09:37.078879 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:37.078793 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13439h52m56.286809877s" Jul 08 17:09:37.255027 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:37.254553 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:37.255027 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:37.254681 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:09:37.352404 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:37.352316 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-687zq" event={"ID":"4357f9ee-c302-449a-ba96-678febe063ae","Type":"ContainerStarted","Data":"a3f9ac1172d5e58f9ba0eb72c7d2e7fbe37c1f1bc8143738c6bacf4c089201a1"} Jul 08 17:09:38.254866 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:38.254717 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:38.255057 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:38.254882 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:09:38.255057 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:38.254720 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:38.255522 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:38.255073 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:09:38.642486 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:38.642396 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs\") pod \"network-metrics-daemon-f6jwj\" (UID: \"506c8214-179c-4cb1-91c2-6f282fdca948\") " pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:38.642649 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:38.642501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:38.642708 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:38.642646 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:09:38.642771 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:38.642711 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret podName:766e4d7c-1d51-4db8-bdc4-3be62175a3a6 nodeName:}" failed. No retries permitted until 2026-07-08 17:09:42.64269366 +0000 UTC m=+9.044198060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret") pod "global-pull-secret-syncer-9d4bs" (UID: "766e4d7c-1d51-4db8-bdc4-3be62175a3a6") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:09:38.643447 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:38.643109 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:09:38.643447 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:38.643178 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs podName:506c8214-179c-4cb1-91c2-6f282fdca948 nodeName:}" failed. No retries permitted until 2026-07-08 17:09:42.643145163 +0000 UTC m=+9.044649560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs") pod "network-metrics-daemon-f6jwj" (UID: "506c8214-179c-4cb1-91c2-6f282fdca948") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:09:38.744288 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:38.743529 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8v7c\" (UniqueName: \"kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c\") pod \"network-check-target-rrn89\" (UID: \"a9500b93-f23e-4463-b378-0cd8967cbaef\") " pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:38.744288 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:38.743810 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:09:38.744288 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:38.743836 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:09:38.744288 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:38.743863 2567 projected.go:196] Error preparing data for projected volume kube-api-access-k8v7c for pod openshift-network-diagnostics/network-check-target-rrn89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:09:38.744288 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:38.743922 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c podName:a9500b93-f23e-4463-b378-0cd8967cbaef nodeName:}" failed. No retries permitted until 2026-07-08 17:09:42.743903658 +0000 UTC m=+9.145408057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8v7c" (UniqueName: "kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c") pod "network-check-target-rrn89" (UID: "a9500b93-f23e-4463-b378-0cd8967cbaef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:09:39.254544 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:39.254460 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:39.254723 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:39.254607 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:09:40.254272 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:40.254234 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:40.254738 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:40.254234 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:40.254738 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:40.254396 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:09:40.254738 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:40.254482 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:09:41.254668 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:41.254634 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:41.255102 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:41.254773 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:09:42.254545 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:42.254514 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:42.254732 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:42.254687 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:09:42.255298 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:42.255111 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:42.255298 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:42.255255 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:09:42.676730 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:42.676691 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs\") pod \"network-metrics-daemon-f6jwj\" (UID: \"506c8214-179c-4cb1-91c2-6f282fdca948\") " pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:42.676894 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:42.676790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:42.676973 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:42.676907 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:09:42.676973 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:42.676919 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:09:42.677067 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:42.676979 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret podName:766e4d7c-1d51-4db8-bdc4-3be62175a3a6 nodeName:}" failed. No retries permitted until 2026-07-08 17:09:50.676960096 +0000 UTC m=+17.078464510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret") pod "global-pull-secret-syncer-9d4bs" (UID: "766e4d7c-1d51-4db8-bdc4-3be62175a3a6") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:09:42.677067 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:42.677000 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs podName:506c8214-179c-4cb1-91c2-6f282fdca948 nodeName:}" failed. No retries permitted until 2026-07-08 17:09:50.67698981 +0000 UTC m=+17.078494208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs") pod "network-metrics-daemon-f6jwj" (UID: "506c8214-179c-4cb1-91c2-6f282fdca948") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:09:42.778635 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:42.777935 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8v7c\" (UniqueName: \"kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c\") pod \"network-check-target-rrn89\" (UID: \"a9500b93-f23e-4463-b378-0cd8967cbaef\") " pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:42.778635 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:42.778189 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:09:42.778635 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:42.778211 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:09:42.778635 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:42.778224 2567 projected.go:196] Error preparing data for projected volume kube-api-access-k8v7c for pod openshift-network-diagnostics/network-check-target-rrn89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:09:42.778635 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:42.778287 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c podName:a9500b93-f23e-4463-b378-0cd8967cbaef nodeName:}" failed. No retries permitted until 2026-07-08 17:09:50.778266719 +0000 UTC m=+17.179771129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8v7c" (UniqueName: "kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c") pod "network-check-target-rrn89" (UID: "a9500b93-f23e-4463-b378-0cd8967cbaef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:09:43.254220 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:43.254146 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:43.254423 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:43.254297 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:09:44.255067 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:44.255033 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:44.255552 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:44.255166 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:09:44.255552 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:44.255222 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:44.255552 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:44.255329 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:09:45.253786 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:45.253706 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:45.253958 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:45.253834 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:09:46.254278 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:46.254242 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:46.254741 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:46.254242 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:46.254741 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:46.254379 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:09:46.254741 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:46.254476 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:09:47.253788 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:47.253758 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:47.253961 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:47.253871 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:09:48.254365 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:48.254327 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:48.254365 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:48.254368 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:48.254884 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:48.254496 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:09:48.254884 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:48.254597 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:09:49.254168 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:49.253983 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:49.254341 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:49.254308 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:09:50.254028 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:50.253985 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:50.254487 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:50.254138 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:09:50.254487 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:50.254186 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:50.254487 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:50.254296 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:09:50.733709 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:50.733666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:50.733709 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:50.733727 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs\") pod \"network-metrics-daemon-f6jwj\" (UID: \"506c8214-179c-4cb1-91c2-6f282fdca948\") " pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:50.733977 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:50.733828 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:09:50.733977 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:50.733889 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs podName:506c8214-179c-4cb1-91c2-6f282fdca948 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:06.733870095 +0000 UTC m=+33.135374494 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs") pod "network-metrics-daemon-f6jwj" (UID: "506c8214-179c-4cb1-91c2-6f282fdca948") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:09:50.733977 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:50.733826 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:09:50.733977 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:50.733977 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret podName:766e4d7c-1d51-4db8-bdc4-3be62175a3a6 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:06.733956208 +0000 UTC m=+33.135460621 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret") pod "global-pull-secret-syncer-9d4bs" (UID: "766e4d7c-1d51-4db8-bdc4-3be62175a3a6") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:09:50.834569 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:50.834537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8v7c\" (UniqueName: \"kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c\") pod \"network-check-target-rrn89\" (UID: \"a9500b93-f23e-4463-b378-0cd8967cbaef\") " pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:50.834730 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:50.834707 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:09:50.834730 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:50.834723 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:09:50.834730 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:50.834733 2567 projected.go:196] Error preparing data for projected volume kube-api-access-k8v7c for pod openshift-network-diagnostics/network-check-target-rrn89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:09:50.834861 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:50.834792 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c podName:a9500b93-f23e-4463-b378-0cd8967cbaef nodeName:}" failed. No retries permitted until 2026-07-08 17:10:06.834773965 +0000 UTC m=+33.236278451 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8v7c" (UniqueName: "kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c") pod "network-check-target-rrn89" (UID: "a9500b93-f23e-4463-b378-0cd8967cbaef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:09:51.254416 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:51.254385 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:51.254816 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:51.254510 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:09:52.253843 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:52.253809 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:52.254017 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:52.253826 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:52.254017 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:52.253941 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:09:52.254144 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:52.254031 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:09:53.254073 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:53.253853 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:53.254073 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:53.253990 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:09:54.254784 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:54.254749 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:54.255270 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:54.254937 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:54.255270 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:54.254895 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:09:54.257953 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:54.257914 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:09:55.253619 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:55.253585 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:55.253784 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:55.253686 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:09:56.254501 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.254276 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:56.255137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.254276 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:56.255137 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:56.254625 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:09:56.255137 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:56.254686 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:09:56.391226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.391201 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:09:56.394051 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.394026 2567 generic.go:356] "Generic (PLEG): container finished" podID="b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7" containerID="6ad790844c7b90ec97947436a1f7a370c0591955763461cf941058215c66e7b2" exitCode=1 Jul 08 17:09:56.394188 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.394096 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" event={"ID":"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7","Type":"ContainerStarted","Data":"802ccdedf95313a2f0ade55d0532bf8e90f475ced272cf5b095b986eb6fd167b"} Jul 08 17:09:56.394265 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.394201 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" event={"ID":"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7","Type":"ContainerStarted","Data":"0b2da288d45423762dcb5809afc3b762293407662a48cac57529f48d10af5413"} Jul 08 17:09:56.394324 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.394262 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" event={"ID":"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7","Type":"ContainerStarted","Data":"de947829b70a35b708553ad83333ed3e2ddd81d3143c70d853655794765180bf"} Jul 08 17:09:56.394324 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.394312 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" event={"ID":"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7","Type":"ContainerStarted","Data":"e252a39ea217877d89a6dcbc24257e762fae3e6e48d93fafe37410635cea352f"} Jul 08 17:09:56.394436 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.394360 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" event={"ID":"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7","Type":"ContainerDied","Data":"6ad790844c7b90ec97947436a1f7a370c0591955763461cf941058215c66e7b2"} Jul 08 17:09:56.394436 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.394411 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" event={"ID":"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7","Type":"ContainerStarted","Data":"e9e1221441849df520ce567eaca51c8ee33b89c5bcc722cc09155b7704483473"} Jul 08 17:09:56.395542 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.395520 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xlrfn" event={"ID":"8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3","Type":"ContainerStarted","Data":"c7efad5d207a3070f198fad7e85296bf6a91fd04b98e5222a56be5520a912402"} Jul 08 17:09:56.397052 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.397031 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" event={"ID":"6e901979-aed4-4211-a8d5-5730506e1c5d","Type":"ContainerStarted","Data":"bdca972c86fcd48ac2ca5ed8a42b38b3cd1e1816e06af3131d8310af27528b72"} Jul 08 17:09:56.398706 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.398679 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-180.ec2.internal" event={"ID":"5d6797f993b19877f01026719e994bf0","Type":"ContainerStarted","Data":"323083a4fa586f5272e0ba0b404256fe1003b979411db1e6970818f9acb2d85e"} Jul 08 17:09:56.414509 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.414456 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xlrfn" podStartSLOduration=2.29298776 podStartE2EDuration="22.414437392s" totalImagesPullingTime="20.121449632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:09:56.414133928 +0000 UTC m=+22.815638348" watchObservedRunningTime="2026-07-08 17:09:56.414437392 +0000 UTC m=+22.815941789" Jul 08 17:09:56.445714 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.445648 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cjgn9" podStartSLOduration=2.274951238 podStartE2EDuration="22.445627842s" totalImagesPullingTime="20.170676604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:09:56.445356144 +0000 UTC m=+22.846860564" watchObservedRunningTime="2026-07-08 17:09:56.445627842 +0000 UTC m=+22.847132262" Jul 08 17:09:56.446126 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:56.446093 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-180.ec2.internal" podStartSLOduration=22.446084626 podStartE2EDuration="22.446084626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:09:56.427592631 +0000 UTC m=+22.829097075" watchObservedRunningTime="2026-07-08 17:09:56.446084626 +0000 UTC m=+22.847589048" Jul 08 17:09:57.253826 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.253652 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:57.253990 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:57.253894 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:09:57.403229 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.403184 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xn4q8" event={"ID":"e8899e7f-6aab-4a26-9ada-63336b5a05d4","Type":"ContainerStarted","Data":"71d2f612d81aec80ff5561d85f039ca8f3824045b704f71288b43a83c388850f"} Jul 08 17:09:57.404846 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.404816 2567 generic.go:356] "Generic (PLEG): container finished" podID="c2050e983844161e2057b234e4718588" containerID="765bcf90e41191110e2553d48870ae053b9acfe113fb44deccec983252f0d8ab" exitCode=0 Jul 08 17:09:57.404975 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.404911 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" event={"ID":"c2050e983844161e2057b234e4718588","Type":"ContainerDied","Data":"765bcf90e41191110e2553d48870ae053b9acfe113fb44deccec983252f0d8ab"} Jul 08 17:09:57.406620 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.406596 2567 generic.go:356] "Generic (PLEG): container finished" podID="f653f2c8-1e71-4873-aa01-ff31a98cb14f" containerID="7d999214fb6811f568b0218f896da410285b99f9d38998edcddd90178dd9d918" exitCode=0 Jul 08 17:09:57.406743 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.406681 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmf67" event={"ID":"f653f2c8-1e71-4873-aa01-ff31a98cb14f","Type":"ContainerDied","Data":"7d999214fb6811f568b0218f896da410285b99f9d38998edcddd90178dd9d918"} Jul 08 17:09:57.408948 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.408927 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-687zq" event={"ID":"4357f9ee-c302-449a-ba96-678febe063ae","Type":"ContainerStarted","Data":"d66d629ed908bac6626c8e519e45ce5322cf0a7924b96d945c9d7a421f8829df"} Jul 08 17:09:57.410543 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.410518 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fbzfk" event={"ID":"6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e","Type":"ContainerStarted","Data":"ce892541c19177886c4da9c724ffe074d3d6180878787ff21bc5a106d82b6826"} Jul 08 17:09:57.412016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.411997 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" event={"ID":"e8310662-9b6b-481e-a746-2ad820ca153c","Type":"ContainerStarted","Data":"0cdb0f1fb5d0b236057d4f189843a77d2388a074dddac3f2428fce4e9cd48321"} Jul 08 17:09:57.413496 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.413452 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gp6fb" event={"ID":"6e808ac0-56f2-43de-820c-c788e873dbec","Type":"ContainerStarted","Data":"939e965940d5de2a22da8574a8c4a70785f4ff02b5ef839e285284a094851215"} Jul 08 17:09:57.419067 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.419032 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xn4q8" podStartSLOduration=3.379572481 podStartE2EDuration="23.419018301s" totalImagesPullingTime="20.03944582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:09:57.418764463 +0000 UTC m=+23.820268883" watchObservedRunningTime="2026-07-08 17:09:57.419018301 +0000 UTC m=+23.820522720" Jul 08 17:09:57.433228 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.433191 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gp6fb" podStartSLOduration=3.3070123909999998 podStartE2EDuration="23.433175483s" totalImagesPullingTime="20.126163092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:09:57.432916956 +0000 UTC m=+23.834421375" watchObservedRunningTime="2026-07-08 17:09:57.433175483 +0000 UTC m=+23.834679903" Jul 08 17:09:57.475117 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.474925 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fbzfk" podStartSLOduration=3.375945795 podStartE2EDuration="23.47490519s" totalImagesPullingTime="20.098959395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:09:57.474123561 +0000 UTC m=+23.875627979" watchObservedRunningTime="2026-07-08 17:09:57.47490519 +0000 UTC m=+23.876409611" Jul 08 17:09:57.509694 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.509650 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-687zq" podStartSLOduration=4.230319743 podStartE2EDuration="23.509633556s" totalImagesPullingTime="19.279313813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:09:57.50388605 +0000 UTC m=+23.905390469" watchObservedRunningTime="2026-07-08 17:09:57.509633556 +0000 UTC m=+23.911138001" Jul 08 17:09:57.867251 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:57.867223 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 17:09:58.090209 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:58.090055 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T17:09:57.867244453Z","UUID":"b34d0cab-d3a8-49ff-9999-4afbde763a4c","Handler":null,"Name":"","Endpoint":""} Jul 08 17:09:58.091487 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:58.091469 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 17:09:58.091589 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:58.091506 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 17:09:58.254744 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:58.254714 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:09:58.254996 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:58.254714 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:09:58.254996 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:58.254873 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:09:58.254996 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:58.254940 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:09:58.419232 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:58.419192 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" event={"ID":"e8310662-9b6b-481e-a746-2ad820ca153c","Type":"ContainerStarted","Data":"473a36a68c14752500acae3afbfde7b1fb1b908bf7cbd724aed924e28c053cc2"} Jul 08 17:09:58.422256 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:58.422210 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" event={"ID":"c2050e983844161e2057b234e4718588","Type":"ContainerStarted","Data":"981761993fb28010ec66f2113bea08fb76472c5740bf6a8db65a393fc52ec150"} Jul 08 17:09:58.436809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:58.436746 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-180.ec2.internal" podStartSLOduration=24.436733208 podStartE2EDuration="24.436733208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:09:58.436420078 +0000 UTC m=+24.837924498" watchObservedRunningTime="2026-07-08 17:09:58.436733208 +0000 UTC m=+24.838237628" Jul 08 17:09:59.254374 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:59.254305 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:09:59.254521 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:09:59.254406 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:09:59.428059 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:59.428028 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:09:59.428522 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:59.428475 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" event={"ID":"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7","Type":"ContainerStarted","Data":"50dec1367cec3abe18cc2a324386c5c0f807b8e83696be0d993678b6cac8d49f"} Jul 08 17:09:59.430694 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:59.430661 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" event={"ID":"e8310662-9b6b-481e-a746-2ad820ca153c","Type":"ContainerStarted","Data":"a78da2d78efdd324fb96ace8b31756801be2b9cc6f941976ca07d173058050e2"} Jul 08 17:09:59.448194 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:09:59.448134 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4q458" podStartSLOduration=3.357921408 podStartE2EDuration="25.448118597s" totalImagesPullingTime="22.090197189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:09:59.447789538 +0000 UTC m=+25.849293959" watchObservedRunningTime="2026-07-08 17:09:59.448118597 +0000 UTC m=+25.849623062" Jul 08 17:10:00.254280 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:00.254239 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:10:00.254471 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:00.254370 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:10:00.254471 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:00.254378 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:10:00.254586 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:00.254484 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:10:01.029530 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:01.029355 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-687zq" Jul 08 17:10:01.254635 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:01.254590 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:10:01.254791 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:01.254726 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:10:01.438532 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:01.438506 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:10:01.438880 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:01.438853 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" event={"ID":"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7","Type":"ContainerStarted","Data":"bd2d2029db0ecbd5c29e3a447a3ad08cb36d7eca09b1beac18e3d333fae6b91a"} Jul 08 17:10:01.439146 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:01.439125 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:10:01.439348 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:01.439334 2567 scope.go:117] "RemoveContainer" containerID="6ad790844c7b90ec97947436a1f7a370c0591955763461cf941058215c66e7b2" Jul 08 17:10:01.454546 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:01.454528 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:10:02.254653 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.254618 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:10:02.255339 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:02.254729 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:10:02.255339 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.254782 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:10:02.255339 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:02.254877 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:10:02.282201 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.282173 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-687zq" Jul 08 17:10:02.282772 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.282755 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-687zq" Jul 08 17:10:02.323372 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.323335 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:10:02.444721 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.444696 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:10:02.445186 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.445133 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" event={"ID":"b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7","Type":"ContainerStarted","Data":"3394840d8c0c292451d73b06b148d58059a1bfbf318c1b892eff368005234359"} Jul 08 17:10:02.445855 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.445654 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:10:02.446051 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.446033 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-687zq" Jul 08 17:10:02.463724 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.463695 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:10:02.473483 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.473438 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" podStartSLOduration=8.257875246 podStartE2EDuration="28.473424863s" totalImagesPullingTime="20.215549617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:02.473390506 +0000 UTC m=+28.874894936" watchObservedRunningTime="2026-07-08 17:10:02.473424863 +0000 UTC m=+28.874929281" Jul 08 17:10:02.629943 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.629911 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rrn89"] Jul 08 17:10:02.630099 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.630054 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:10:02.630179 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:02.630142 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:10:02.633223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.633192 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f6jwj"] Jul 08 17:10:02.633363 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.633320 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:10:02.633484 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:02.633462 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:10:02.633928 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.633907 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9d4bs"] Jul 08 17:10:02.634020 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:02.634008 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:10:02.634126 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:02.634105 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:10:04.255712 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:04.255491 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:10:04.256169 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:04.255552 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:10:04.256169 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:04.255795 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:10:04.256169 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:04.255877 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:10:04.256169 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:04.255568 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:10:04.256169 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:04.255950 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:10:06.254371 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:06.254334 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:10:06.254901 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:06.254336 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:10:06.254901 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:06.254474 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:10:06.254901 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:06.254336 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:10:06.254901 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:06.254533 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:10:06.254901 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:06.254588 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:10:06.455888 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:06.455856 2567 generic.go:356] "Generic (PLEG): container finished" podID="f653f2c8-1e71-4873-aa01-ff31a98cb14f" containerID="e3ce096d3fe3a4255c0a4f26b69e4cc091a62afafada1b66a70fa26bd6bd0f33" exitCode=0 Jul 08 17:10:06.456051 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:06.455911 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmf67" event={"ID":"f653f2c8-1e71-4873-aa01-ff31a98cb14f","Type":"ContainerDied","Data":"e3ce096d3fe3a4255c0a4f26b69e4cc091a62afafada1b66a70fa26bd6bd0f33"} Jul 08 17:10:06.739846 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:06.739811 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs\") pod \"network-metrics-daemon-f6jwj\" (UID: \"506c8214-179c-4cb1-91c2-6f282fdca948\") " pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:10:06.739990 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:06.739877 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:10:06.739990 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:06.739967 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:10:06.740050 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:06.740022 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret podName:766e4d7c-1d51-4db8-bdc4-3be62175a3a6 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:38.740009363 +0000 UTC m=+65.141513760 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret") pod "global-pull-secret-syncer-9d4bs" (UID: "766e4d7c-1d51-4db8-bdc4-3be62175a3a6") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:10:06.740050 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:06.739967 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:10:06.740135 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:06.740061 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs podName:506c8214-179c-4cb1-91c2-6f282fdca948 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:38.740051723 +0000 UTC m=+65.141556119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs") pod "network-metrics-daemon-f6jwj" (UID: "506c8214-179c-4cb1-91c2-6f282fdca948") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:10:06.840328 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:06.840299 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8v7c\" (UniqueName: \"kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c\") pod \"network-check-target-rrn89\" (UID: \"a9500b93-f23e-4463-b378-0cd8967cbaef\") " pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:10:06.840466 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:06.840429 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:10:06.840466 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:06.840444 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:10:06.840466 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:06.840453 2567 projected.go:196] Error preparing data for projected volume kube-api-access-k8v7c for pod openshift-network-diagnostics/network-check-target-rrn89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:10:06.840596 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:06.840508 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c podName:a9500b93-f23e-4463-b378-0cd8967cbaef nodeName:}" failed. No retries permitted until 2026-07-08 17:10:38.840490507 +0000 UTC m=+65.241994905 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k8v7c" (UniqueName: "kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c") pod "network-check-target-rrn89" (UID: "a9500b93-f23e-4463-b378-0cd8967cbaef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:10:08.254583 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.254489 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:10:08.254583 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.254506 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:10:08.255046 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.254503 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:10:08.255046 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.254618 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9d4bs" podUID="766e4d7c-1d51-4db8-bdc4-3be62175a3a6" Jul 08 17:10:08.255046 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.254726 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f6jwj" podUID="506c8214-179c-4cb1-91c2-6f282fdca948" Jul 08 17:10:08.255046 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.254847 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rrn89" podUID="a9500b93-f23e-4463-b378-0cd8967cbaef" Jul 08 17:10:08.408234 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.408203 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-180.ec2.internal" event="NodeReady" Jul 08 17:10:08.408412 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.408354 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 17:10:08.462704 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.462541 2567 generic.go:356] "Generic (PLEG): container finished" podID="f653f2c8-1e71-4873-aa01-ff31a98cb14f" containerID="d5b5f71d97e156f4812c9fb8937189eb0ad0647f7a2672fb65a1632bf9142b80" exitCode=0 Jul 08 17:10:08.462704 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.462627 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmf67" event={"ID":"f653f2c8-1e71-4873-aa01-ff31a98cb14f","Type":"ContainerDied","Data":"d5b5f71d97e156f4812c9fb8937189eb0ad0647f7a2672fb65a1632bf9142b80"} Jul 08 17:10:08.468058 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.467922 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bhsb4"] Jul 08 17:10:08.484292 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.484266 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g"] Jul 08 17:10:08.484437 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.484395 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:08.487385 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.487366 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:10:08.488078 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.488056 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 17:10:08.488078 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.488074 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 17:10:08.488255 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.488084 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 17:10:08.488255 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.488102 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gcl26\"" Jul 08 17:10:08.498322 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.498298 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-nmpch"] Jul 08 17:10:08.498460 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.498439 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:08.500486 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.500466 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 17:10:08.500914 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.500893 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 17:10:08.501011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.500977 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 17:10:08.501381 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.501365 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:10:08.501435 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.501365 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xfvlp\"" Jul 08 17:10:08.516393 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.516366 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr"] Jul 08 17:10:08.516561 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.516531 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.521018 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.520993 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 17:10:08.521184 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.521143 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 08 17:10:08.521370 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.521333 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rlbpw\"" Jul 08 17:10:08.521445 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.521389 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 08 17:10:08.523358 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.523256 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 17:10:08.534505 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.534483 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 08 17:10:08.538469 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.538452 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzhw5"] Jul 08 17:10:08.538584 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.538568 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:08.542654 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.542632 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 17:10:08.542768 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.542641 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 17:10:08.542822 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.542775 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 17:10:08.542970 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.542942 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7v2mr\"" Jul 08 17:10:08.550242 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.550220 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 17:10:08.554972 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.554609 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-klg5g\" (UID: \"1b237378-67fc-41c9-8053-915a5bc9f57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:08.555083 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.555015 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4a2a9da-2675-486c-8bef-b051037fb231-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.555184 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.555146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4a2a9da-2675-486c-8bef-b051037fb231-serving-cert\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.555239 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.555208 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pscmx\" (UniqueName: \"kubernetes.io/projected/e398959d-5b24-4304-af82-1a79e9faed29-kube-api-access-pscmx\") pod \"console-operator-68b757fb67-bhsb4\" (UID: \"e398959d-5b24-4304-af82-1a79e9faed29\") " pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:08.555290 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.555245 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4a2a9da-2675-486c-8bef-b051037fb231-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.555426 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.555404 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnt4f\" (UniqueName: \"kubernetes.io/projected/1b237378-67fc-41c9-8053-915a5bc9f57d-kube-api-access-mnt4f\") pod \"cluster-samples-operator-56fcf86bf-klg5g\" (UID: \"1b237378-67fc-41c9-8053-915a5bc9f57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:08.555488 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.555470 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e398959d-5b24-4304-af82-1a79e9faed29-config\") pod \"console-operator-68b757fb67-bhsb4\" (UID: \"e398959d-5b24-4304-af82-1a79e9faed29\") " pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:08.555601 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.555504 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e398959d-5b24-4304-af82-1a79e9faed29-serving-cert\") pod \"console-operator-68b757fb67-bhsb4\" (UID: \"e398959d-5b24-4304-af82-1a79e9faed29\") " pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:08.555661 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.555533 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e398959d-5b24-4304-af82-1a79e9faed29-trusted-ca\") pod \"console-operator-68b757fb67-bhsb4\" (UID: \"e398959d-5b24-4304-af82-1a79e9faed29\") " pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:08.555708 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.555665 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a9da-2675-486c-8bef-b051037fb231-tmp\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.557896 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.555843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv5xq\" (UniqueName: \"kubernetes.io/projected/e4a2a9da-2675-486c-8bef-b051037fb231-kube-api-access-xv5xq\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.557896 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.555965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a9da-2675-486c-8bef-b051037fb231-snapshots\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.562629 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.562605 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q"] Jul 08 17:10:08.562744 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.562727 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzhw5" Jul 08 17:10:08.565687 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.565664 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:10:08.566320 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.566302 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dv4nl\"" Jul 08 17:10:08.566416 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.566351 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 08 17:10:08.582654 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.582635 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d68bf77dc-pphvl"] Jul 08 17:10:08.582654 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.582650 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.594649 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.594631 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g"] Jul 08 17:10:08.594727 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.594663 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bhsb4"] Jul 08 17:10:08.594727 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.594679 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzhw5"] Jul 08 17:10:08.594727 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.594693 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d68bf77dc-pphvl"] Jul 08 17:10:08.594727 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.594706 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq"] Jul 08 17:10:08.594881 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.594736 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.616026 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.616007 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 17:10:08.616026 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.616019 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 17:10:08.616860 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.616844 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd"] Jul 08 17:10:08.616979 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.616965 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" Jul 08 17:10:08.625035 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.625020 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 08 17:10:08.625107 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.625067 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 17:10:08.629294 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.629278 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-98mqm"] Jul 08 17:10:08.629401 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.629388 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" Jul 08 17:10:08.636293 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.636277 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bhhk5\"" Jul 08 17:10:08.638058 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.638039 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr"] Jul 08 17:10:08.638139 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.638078 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-nmpch"] Jul 08 17:10:08.638139 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.638105 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q"] Jul 08 17:10:08.638139 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.638126 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq"] Jul 08 17:10:08.638286 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.638145 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-98mqm"] Jul 08 17:10:08.638286 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.638218 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-98mqm" Jul 08 17:10:08.638286 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.638264 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7v5fb"] Jul 08 17:10:08.646465 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.646449 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 08 17:10:08.649930 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.649912 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd"] Jul 08 17:10:08.650014 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.649945 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7v5fb"] Jul 08 17:10:08.650076 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.650051 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:08.656659 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.656641 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a9da-2675-486c-8bef-b051037fb231-tmp\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.656756 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.656670 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-bound-sa-token\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.656756 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.656690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmtmz\" (UniqueName: \"kubernetes.io/projected/0bbe62e9-bf21-4977-b63c-6173c46cf195-kube-api-access-bmtmz\") pod \"kube-storage-version-migrator-operator-846bf668f7-2kswq\" (UID: \"0bbe62e9-bf21-4977-b63c-6173c46cf195\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" Jul 08 17:10:08.656756 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.656708 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71207c79-9ccb-4904-b619-f3db80036b1e-trusted-ca\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.656756 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.656674 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:10:08.656756 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.656732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-default-certificate\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.657000 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.656780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4a2a9da-2675-486c-8bef-b051037fb231-serving-cert\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.657000 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.656842 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zzmf\" (UniqueName: \"kubernetes.io/projected/d5e4bf86-708e-4e08-a293-505c094abc70-kube-api-access-6zzmf\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.657000 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.656874 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71207c79-9ccb-4904-b619-f3db80036b1e-image-registry-private-configuration\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.657000 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.656916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.657000 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.656947 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-klg5g\" (UID: \"1b237378-67fc-41c9-8053-915a5bc9f57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:08.657000 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.656976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4w8n\" (UniqueName: \"kubernetes.io/projected/1232df85-ee3c-43d7-8c4b-35e54e42eb59-kube-api-access-h4w8n\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:08.657259 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657006 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71207c79-9ccb-4904-b619-f3db80036b1e-registry-certificates\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.657259 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.657031 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:10:08.657259 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.657083 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls podName:1b237378-67fc-41c9-8053-915a5bc9f57d nodeName:}" failed. No retries permitted until 2026-07-08 17:10:09.157068513 +0000 UTC m=+35.558572913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-klg5g" (UID: "1b237378-67fc-41c9-8053-915a5bc9f57d") : secret "samples-operator-tls" not found Jul 08 17:10:08.657259 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knjjf\" (UniqueName: \"kubernetes.io/projected/c471b244-f353-4ab3-8d23-25e0f26739fa-kube-api-access-knjjf\") pod \"volume-data-source-validator-5d456fdbcd-hzhw5\" (UID: \"c471b244-f353-4ab3-8d23-25e0f26739fa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzhw5" Jul 08 17:10:08.657259 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657143 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.657259 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657179 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a9da-2675-486c-8bef-b051037fb231-tmp\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.657259 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657191 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71207c79-9ccb-4904-b619-f3db80036b1e-installation-pull-secrets\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.657259 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657221 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e398959d-5b24-4304-af82-1a79e9faed29-serving-cert\") pod \"console-operator-68b757fb67-bhsb4\" (UID: \"e398959d-5b24-4304-af82-1a79e9faed29\") " pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:08.657259 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657238 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.657259 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657255 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0bbe62e9-bf21-4977-b63c-6173c46cf195-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-2kswq\" (UID: \"0bbe62e9-bf21-4977-b63c-6173c46cf195\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" Jul 08 17:10:08.657661 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657272 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1232df85-ee3c-43d7-8c4b-35e54e42eb59-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:08.657661 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657292 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv5xq\" (UniqueName: \"kubernetes.io/projected/e4a2a9da-2675-486c-8bef-b051037fb231-kube-api-access-xv5xq\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.657661 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657380 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-stats-auth\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.657661 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657475 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a9da-2675-486c-8bef-b051037fb231-snapshots\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.657661 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657503 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5jrb\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-kube-api-access-h5jrb\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.657661 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657540 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4a2a9da-2675-486c-8bef-b051037fb231-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.657661 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657567 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0bbe62e9-bf21-4977-b63c-6173c46cf195-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-2kswq\" (UID: \"0bbe62e9-bf21-4977-b63c-6173c46cf195\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" Jul 08 17:10:08.657661 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657602 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pscmx\" (UniqueName: \"kubernetes.io/projected/e398959d-5b24-4304-af82-1a79e9faed29-kube-api-access-pscmx\") pod \"console-operator-68b757fb67-bhsb4\" (UID: \"e398959d-5b24-4304-af82-1a79e9faed29\") " pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:08.657661 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657625 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71207c79-9ccb-4904-b619-f3db80036b1e-ca-trust-extracted\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.657661 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657649 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4a2a9da-2675-486c-8bef-b051037fb231-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.658001 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:08.658001 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657715 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnt4f\" (UniqueName: \"kubernetes.io/projected/1b237378-67fc-41c9-8053-915a5bc9f57d-kube-api-access-mnt4f\") pod \"cluster-samples-operator-56fcf86bf-klg5g\" (UID: \"1b237378-67fc-41c9-8053-915a5bc9f57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:08.658001 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657755 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e398959d-5b24-4304-af82-1a79e9faed29-trusted-ca\") pod \"console-operator-68b757fb67-bhsb4\" (UID: \"e398959d-5b24-4304-af82-1a79e9faed29\") " pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:08.658001 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e398959d-5b24-4304-af82-1a79e9faed29-config\") pod \"console-operator-68b757fb67-bhsb4\" (UID: \"e398959d-5b24-4304-af82-1a79e9faed29\") " pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:08.658001 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.657920 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e4a2a9da-2675-486c-8bef-b051037fb231-snapshots\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.658222 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.658145 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4a2a9da-2675-486c-8bef-b051037fb231-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.658395 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.658372 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e398959d-5b24-4304-af82-1a79e9faed29-config\") pod \"console-operator-68b757fb67-bhsb4\" (UID: \"e398959d-5b24-4304-af82-1a79e9faed29\") " pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:08.658499 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.658451 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4a2a9da-2675-486c-8bef-b051037fb231-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.658668 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.658651 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e398959d-5b24-4304-af82-1a79e9faed29-trusted-ca\") pod \"console-operator-68b757fb67-bhsb4\" (UID: \"e398959d-5b24-4304-af82-1a79e9faed29\") " pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:08.660014 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.660000 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zptlq\"" Jul 08 17:10:08.660980 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.660958 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4a2a9da-2675-486c-8bef-b051037fb231-serving-cert\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.661063 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.660988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e398959d-5b24-4304-af82-1a79e9faed29-serving-cert\") pod \"console-operator-68b757fb67-bhsb4\" (UID: \"e398959d-5b24-4304-af82-1a79e9faed29\") " pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:08.661142 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.661115 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 17:10:08.661933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.661916 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 08 17:10:08.675055 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.675034 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 08 17:10:08.675132 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.675065 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 08 17:10:08.681202 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.681184 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 17:10:08.682799 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.682787 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 17:10:08.683065 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.683054 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:10:08.684706 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.684692 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 17:10:08.685009 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.684998 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zfmcz\"" Jul 08 17:10:08.687764 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.687751 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 08 17:10:08.687906 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.687892 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qcgr4\"" Jul 08 17:10:08.728881 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.728851 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 17:10:08.729039 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.728957 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 17:10:08.729039 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.728957 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 17:10:08.729039 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.729015 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 17:10:08.729150 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.729049 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 17:10:08.758026 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.757955 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-s2n99\"" Jul 08 17:10:08.758026 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.757954 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t5877\"" Jul 08 17:10:08.758213 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758110 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcbk6\" (UniqueName: \"kubernetes.io/projected/1766255b-1365-4287-b81f-cf1c9c56a0da-kube-api-access-zcbk6\") pod \"service-ca-operator-5d46d9ffd4-jgxmd\" (UID: \"1766255b-1365-4287-b81f-cf1c9c56a0da\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" Jul 08 17:10:08.758213 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758136 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtsck\" (UniqueName: \"kubernetes.io/projected/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-kube-api-access-wtsck\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:08.758213 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758190 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0bbe62e9-bf21-4977-b63c-6173c46cf195-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-2kswq\" (UID: \"0bbe62e9-bf21-4977-b63c-6173c46cf195\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" Jul 08 17:10:08.758315 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758218 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71207c79-9ccb-4904-b619-f3db80036b1e-ca-trust-extracted\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.758315 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758240 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-tmp-dir\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:08.758315 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:08.758315 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758281 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1766255b-1365-4287-b81f-cf1c9c56a0da-config\") pod \"service-ca-operator-5d46d9ffd4-jgxmd\" (UID: \"1766255b-1365-4287-b81f-cf1c9c56a0da\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" Jul 08 17:10:08.758546 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758316 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pskc8\" (UniqueName: \"kubernetes.io/projected/1f02010d-066d-4a1b-8f67-e76b437f1b53-kube-api-access-pskc8\") pod \"network-check-source-989f8b8dc-98mqm\" (UID: \"1f02010d-066d-4a1b-8f67-e76b437f1b53\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-98mqm" Jul 08 17:10:08.758546 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758343 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-bound-sa-token\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.758546 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758360 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmtmz\" (UniqueName: \"kubernetes.io/projected/0bbe62e9-bf21-4977-b63c-6173c46cf195-kube-api-access-bmtmz\") pod \"kube-storage-version-migrator-operator-846bf668f7-2kswq\" (UID: \"0bbe62e9-bf21-4977-b63c-6173c46cf195\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" Jul 08 17:10:08.758546 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758383 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71207c79-9ccb-4904-b619-f3db80036b1e-trusted-ca\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.758546 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758401 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-default-certificate\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.758546 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758434 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zzmf\" (UniqueName: \"kubernetes.io/projected/d5e4bf86-708e-4e08-a293-505c094abc70-kube-api-access-6zzmf\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.758546 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758464 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71207c79-9ccb-4904-b619-f3db80036b1e-image-registry-private-configuration\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.758546 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.758359 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:10:08.758546 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.758550 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.758557 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls podName:1232df85-ee3c-43d7-8c4b-35e54e42eb59 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:09.258535879 +0000 UTC m=+35.660040276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q6qgr" (UID: "1232df85-ee3c-43d7-8c4b-35e54e42eb59") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.758565 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q: secret "image-registry-tls" not found Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758487 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.758618 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls podName:71207c79-9ccb-4904-b619-f3db80036b1e nodeName:}" failed. No retries permitted until 2026-07-08 17:10:09.258602387 +0000 UTC m=+35.660106785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls") pod "image-registry-5cbfbd8fbf-g7n8q" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e") : secret "image-registry-tls" not found Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758637 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4w8n\" (UniqueName: \"kubernetes.io/projected/1232df85-ee3c-43d7-8c4b-35e54e42eb59-kube-api-access-h4w8n\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758674 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71207c79-9ccb-4904-b619-f3db80036b1e-registry-certificates\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758705 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knjjf\" (UniqueName: \"kubernetes.io/projected/c471b244-f353-4ab3-8d23-25e0f26739fa-kube-api-access-knjjf\") pod \"volume-data-source-validator-5d456fdbcd-hzhw5\" (UID: \"c471b244-f353-4ab3-8d23-25e0f26739fa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzhw5" Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758754 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-config-volume\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758857 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71207c79-9ccb-4904-b619-f3db80036b1e-installation-pull-secrets\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758920 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0bbe62e9-bf21-4977-b63c-6173c46cf195-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-2kswq\" (UID: \"0bbe62e9-bf21-4977-b63c-6173c46cf195\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758945 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1766255b-1365-4287-b81f-cf1c9c56a0da-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jgxmd\" (UID: \"1766255b-1365-4287-b81f-cf1c9c56a0da\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" Jul 08 17:10:08.758984 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.758970 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:10:08.759718 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.758973 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1232df85-ee3c-43d7-8c4b-35e54e42eb59-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:08.759718 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.759006 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-stats-auth\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.759718 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.759024 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs podName:d5e4bf86-708e-4e08-a293-505c094abc70 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:09.25900852 +0000 UTC m=+35.660512926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs") pod "router-default-5d68bf77dc-pphvl" (UID: "d5e4bf86-708e-4e08-a293-505c094abc70") : secret "router-metrics-certs-default" not found Jul 08 17:10:08.759718 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.759064 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5jrb\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-kube-api-access-h5jrb\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.759718 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.759132 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle podName:d5e4bf86-708e-4e08-a293-505c094abc70 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:09.259116823 +0000 UTC m=+35.660621245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle") pod "router-default-5d68bf77dc-pphvl" (UID: "d5e4bf86-708e-4e08-a293-505c094abc70") : configmap references non-existent config key: service-ca.crt Jul 08 17:10:08.760063 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.760039 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1232df85-ee3c-43d7-8c4b-35e54e42eb59-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:08.761068 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.761048 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0bbe62e9-bf21-4977-b63c-6173c46cf195-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-2kswq\" (UID: \"0bbe62e9-bf21-4977-b63c-6173c46cf195\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" Jul 08 17:10:08.761194 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.761118 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-default-certificate\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.761254 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.761226 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71207c79-9ccb-4904-b619-f3db80036b1e-ca-trust-extracted\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.761385 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.761367 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71207c79-9ccb-4904-b619-f3db80036b1e-image-registry-private-configuration\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.761471 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.761452 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71207c79-9ccb-4904-b619-f3db80036b1e-registry-certificates\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.761508 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.761455 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-stats-auth\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.761615 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.761601 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71207c79-9ccb-4904-b619-f3db80036b1e-installation-pull-secrets\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.781194 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.781172 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fxrcw"] Jul 08 17:10:08.795499 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.795480 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fxrcw" Jul 08 17:10:08.818265 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.818241 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2r9gv\"" Jul 08 17:10:08.818534 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.818505 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 17:10:08.818751 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.818729 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fxrcw"] Jul 08 17:10:08.818933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.818919 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 17:10:08.819001 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.818982 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 17:10:08.823282 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.823261 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 08 17:10:08.825112 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.825091 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 17:10:08.825600 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.825582 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnt4f\" (UniqueName: \"kubernetes.io/projected/1b237378-67fc-41c9-8053-915a5bc9f57d-kube-api-access-mnt4f\") pod \"cluster-samples-operator-56fcf86bf-klg5g\" (UID: \"1b237378-67fc-41c9-8053-915a5bc9f57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:08.825684 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.825612 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pscmx\" (UniqueName: \"kubernetes.io/projected/e398959d-5b24-4304-af82-1a79e9faed29-kube-api-access-pscmx\") pod \"console-operator-68b757fb67-bhsb4\" (UID: \"e398959d-5b24-4304-af82-1a79e9faed29\") " pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:08.825857 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.825838 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4w8n\" (UniqueName: \"kubernetes.io/projected/1232df85-ee3c-43d7-8c4b-35e54e42eb59-kube-api-access-h4w8n\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:08.826811 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.826794 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv5xq\" (UniqueName: \"kubernetes.io/projected/e4a2a9da-2675-486c-8bef-b051037fb231-kube-api-access-xv5xq\") pod \"insights-operator-5c847dcfc4-nmpch\" (UID: \"e4a2a9da-2675-486c-8bef-b051037fb231\") " pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.827630 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.827605 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" Jul 08 17:10:08.829362 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.829343 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71207c79-9ccb-4904-b619-f3db80036b1e-trusted-ca\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.829658 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.829642 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0bbe62e9-bf21-4977-b63c-6173c46cf195-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-2kswq\" (UID: \"0bbe62e9-bf21-4977-b63c-6173c46cf195\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" Jul 08 17:10:08.845763 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.845740 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zzmf\" (UniqueName: \"kubernetes.io/projected/d5e4bf86-708e-4e08-a293-505c094abc70-kube-api-access-6zzmf\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:08.853608 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.853585 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-bound-sa-token\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.853717 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.853620 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5jrb\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-kube-api-access-h5jrb\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:08.853717 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.853649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knjjf\" (UniqueName: \"kubernetes.io/projected/c471b244-f353-4ab3-8d23-25e0f26739fa-kube-api-access-knjjf\") pod \"volume-data-source-validator-5d456fdbcd-hzhw5\" (UID: \"c471b244-f353-4ab3-8d23-25e0f26739fa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzhw5" Jul 08 17:10:08.861013 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.860984 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-config-volume\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:08.861111 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.861028 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:08.861111 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.861078 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1766255b-1365-4287-b81f-cf1c9c56a0da-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jgxmd\" (UID: \"1766255b-1365-4287-b81f-cf1c9c56a0da\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" Jul 08 17:10:08.861243 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.861190 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcbk6\" (UniqueName: \"kubernetes.io/projected/1766255b-1365-4287-b81f-cf1c9c56a0da-kube-api-access-zcbk6\") pod \"service-ca-operator-5d46d9ffd4-jgxmd\" (UID: \"1766255b-1365-4287-b81f-cf1c9c56a0da\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" Jul 08 17:10:08.861243 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.861222 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtsck\" (UniqueName: \"kubernetes.io/projected/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-kube-api-access-wtsck\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:08.861362 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.861282 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-tmp-dir\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:08.861362 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.861318 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1766255b-1365-4287-b81f-cf1c9c56a0da-config\") pod \"service-ca-operator-5d46d9ffd4-jgxmd\" (UID: \"1766255b-1365-4287-b81f-cf1c9c56a0da\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" Jul 08 17:10:08.861484 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.861367 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pskc8\" (UniqueName: \"kubernetes.io/projected/1f02010d-066d-4a1b-8f67-e76b437f1b53-kube-api-access-pskc8\") pod \"network-check-source-989f8b8dc-98mqm\" (UID: \"1f02010d-066d-4a1b-8f67-e76b437f1b53\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-98mqm" Jul 08 17:10:08.861484 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.861387 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw6fh\" (UniqueName: \"kubernetes.io/projected/935d2a80-4507-4c9d-aa0e-326c3bc25de7-kube-api-access-kw6fh\") pod \"ingress-canary-fxrcw\" (UID: \"935d2a80-4507-4c9d-aa0e-326c3bc25de7\") " pod="openshift-ingress-canary/ingress-canary-fxrcw" Jul 08 17:10:08.861484 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.861411 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/935d2a80-4507-4c9d-aa0e-326c3bc25de7-cert\") pod \"ingress-canary-fxrcw\" (UID: \"935d2a80-4507-4c9d-aa0e-326c3bc25de7\") " pod="openshift-ingress-canary/ingress-canary-fxrcw" Jul 08 17:10:08.862061 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.862037 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-config-volume\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:08.862508 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.862186 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:10:08.862508 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:08.862260 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls podName:c4ced9eb-4fb8-4539-9bcc-de27d6198e36 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:09.362236299 +0000 UTC m=+35.763740702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls") pod "dns-default-7v5fb" (UID: "c4ced9eb-4fb8-4539-9bcc-de27d6198e36") : secret "dns-default-metrics-tls" not found Jul 08 17:10:08.865067 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.864677 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1766255b-1365-4287-b81f-cf1c9c56a0da-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jgxmd\" (UID: \"1766255b-1365-4287-b81f-cf1c9c56a0da\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" Jul 08 17:10:08.865329 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.865311 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1766255b-1365-4287-b81f-cf1c9c56a0da-config\") pod \"service-ca-operator-5d46d9ffd4-jgxmd\" (UID: \"1766255b-1365-4287-b81f-cf1c9c56a0da\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" Jul 08 17:10:08.865400 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.865352 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-tmp-dir\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:08.867927 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.867897 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmtmz\" (UniqueName: \"kubernetes.io/projected/0bbe62e9-bf21-4977-b63c-6173c46cf195-kube-api-access-bmtmz\") pod \"kube-storage-version-migrator-operator-846bf668f7-2kswq\" (UID: \"0bbe62e9-bf21-4977-b63c-6173c46cf195\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" Jul 08 17:10:08.871736 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.871714 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzhw5" Jul 08 17:10:08.887973 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.887949 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcbk6\" (UniqueName: \"kubernetes.io/projected/1766255b-1365-4287-b81f-cf1c9c56a0da-kube-api-access-zcbk6\") pod \"service-ca-operator-5d46d9ffd4-jgxmd\" (UID: \"1766255b-1365-4287-b81f-cf1c9c56a0da\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" Jul 08 17:10:08.889824 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.889802 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtsck\" (UniqueName: \"kubernetes.io/projected/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-kube-api-access-wtsck\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:08.891410 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.891393 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pskc8\" (UniqueName: \"kubernetes.io/projected/1f02010d-066d-4a1b-8f67-e76b437f1b53-kube-api-access-pskc8\") pod \"network-check-source-989f8b8dc-98mqm\" (UID: \"1f02010d-066d-4a1b-8f67-e76b437f1b53\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-98mqm" Jul 08 17:10:08.925184 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.925020 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" Jul 08 17:10:08.945240 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.943235 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" Jul 08 17:10:08.945841 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.945607 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-98mqm" Jul 08 17:10:08.963706 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.963677 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6fh\" (UniqueName: \"kubernetes.io/projected/935d2a80-4507-4c9d-aa0e-326c3bc25de7-kube-api-access-kw6fh\") pod \"ingress-canary-fxrcw\" (UID: \"935d2a80-4507-4c9d-aa0e-326c3bc25de7\") " pod="openshift-ingress-canary/ingress-canary-fxrcw" Jul 08 17:10:08.963807 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.963720 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/935d2a80-4507-4c9d-aa0e-326c3bc25de7-cert\") pod \"ingress-canary-fxrcw\" (UID: \"935d2a80-4507-4c9d-aa0e-326c3bc25de7\") " pod="openshift-ingress-canary/ingress-canary-fxrcw" Jul 08 17:10:08.967089 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.966847 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/935d2a80-4507-4c9d-aa0e-326c3bc25de7-cert\") pod \"ingress-canary-fxrcw\" (UID: \"935d2a80-4507-4c9d-aa0e-326c3bc25de7\") " pod="openshift-ingress-canary/ingress-canary-fxrcw" Jul 08 17:10:08.986134 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:08.985980 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw6fh\" (UniqueName: \"kubernetes.io/projected/935d2a80-4507-4c9d-aa0e-326c3bc25de7-kube-api-access-kw6fh\") pod \"ingress-canary-fxrcw\" (UID: \"935d2a80-4507-4c9d-aa0e-326c3bc25de7\") " pod="openshift-ingress-canary/ingress-canary-fxrcw" Jul 08 17:10:09.020432 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.020327 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-nmpch"] Jul 08 17:10:09.029968 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:09.029336 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a2a9da_2675_486c_8bef_b051037fb231.slice/crio-699bc428ce89763e7527ee711f38c9152dc7da124903939eda8286977d64399d WatchSource:0}: Error finding container 699bc428ce89763e7527ee711f38c9152dc7da124903939eda8286977d64399d: Status 404 returned error can't find the container with id 699bc428ce89763e7527ee711f38c9152dc7da124903939eda8286977d64399d Jul 08 17:10:09.044445 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.044379 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzhw5"] Jul 08 17:10:09.093133 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.093105 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:09.104673 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.104644 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fxrcw" Jul 08 17:10:09.108919 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.108892 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq"] Jul 08 17:10:09.111677 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:09.111650 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bbe62e9_bf21_4977_b63c_6173c46cf195.slice/crio-14ce4c7365051f5759aa0dfba622efd46cf90e424ce5537d85a397499f13ba6e WatchSource:0}: Error finding container 14ce4c7365051f5759aa0dfba622efd46cf90e424ce5537d85a397499f13ba6e: Status 404 returned error can't find the container with id 14ce4c7365051f5759aa0dfba622efd46cf90e424ce5537d85a397499f13ba6e Jul 08 17:10:09.124490 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.124407 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd"] Jul 08 17:10:09.126231 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:09.126209 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1766255b_1365_4287_b81f_cf1c9c56a0da.slice/crio-8d5c6aa493729925d0064ba7db6884c1ef26731df0a04a2a02af24168bbcea03 WatchSource:0}: Error finding container 8d5c6aa493729925d0064ba7db6884c1ef26731df0a04a2a02af24168bbcea03: Status 404 returned error can't find the container with id 8d5c6aa493729925d0064ba7db6884c1ef26731df0a04a2a02af24168bbcea03 Jul 08 17:10:09.137607 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.137582 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-98mqm"] Jul 08 17:10:09.145380 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:09.145356 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f02010d_066d_4a1b_8f67_e76b437f1b53.slice/crio-f193d2e33fcb987afe4aefdadeaf7e266a179d1c3afb1e08d757f437d30d1b86 WatchSource:0}: Error finding container f193d2e33fcb987afe4aefdadeaf7e266a179d1c3afb1e08d757f437d30d1b86: Status 404 returned error can't find the container with id f193d2e33fcb987afe4aefdadeaf7e266a179d1c3afb1e08d757f437d30d1b86 Jul 08 17:10:09.165474 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.165386 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-klg5g\" (UID: \"1b237378-67fc-41c9-8053-915a5bc9f57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:09.165599 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:09.165537 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:10:09.165805 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:09.165778 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls podName:1b237378-67fc-41c9-8053-915a5bc9f57d nodeName:}" failed. No retries permitted until 2026-07-08 17:10:10.165750122 +0000 UTC m=+36.567254528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-klg5g" (UID: "1b237378-67fc-41c9-8053-915a5bc9f57d") : secret "samples-operator-tls" not found Jul 08 17:10:09.266436 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.266393 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:09.267293 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.266464 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:09.267293 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.266532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:09.267293 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:09.266536 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:10:09.267293 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:09.266587 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle podName:d5e4bf86-708e-4e08-a293-505c094abc70 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:10.266566549 +0000 UTC m=+36.668070959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle") pod "router-default-5d68bf77dc-pphvl" (UID: "d5e4bf86-708e-4e08-a293-505c094abc70") : configmap references non-existent config key: service-ca.crt Jul 08 17:10:09.267293 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:09.266640 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:10:09.267293 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:09.266654 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs podName:d5e4bf86-708e-4e08-a293-505c094abc70 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:10.266639221 +0000 UTC m=+36.668143622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs") pod "router-default-5d68bf77dc-pphvl" (UID: "d5e4bf86-708e-4e08-a293-505c094abc70") : secret "router-metrics-certs-default" not found Jul 08 17:10:09.267293 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:09.266686 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls podName:1232df85-ee3c-43d7-8c4b-35e54e42eb59 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:10.266674481 +0000 UTC m=+36.668178878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q6qgr" (UID: "1232df85-ee3c-43d7-8c4b-35e54e42eb59") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:10:09.267293 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.266700 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:09.267293 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:09.266803 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:10:09.267293 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:09.266817 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q: secret "image-registry-tls" not found Jul 08 17:10:09.267293 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:09.266859 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls podName:71207c79-9ccb-4904-b619-f3db80036b1e nodeName:}" failed. No retries permitted until 2026-07-08 17:10:10.266848143 +0000 UTC m=+36.668352542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls") pod "image-registry-5cbfbd8fbf-g7n8q" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e") : secret "image-registry-tls" not found Jul 08 17:10:09.281486 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.281425 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bhsb4"] Jul 08 17:10:09.286284 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:09.286259 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode398959d_5b24_4304_af82_1a79e9faed29.slice/crio-aacdfffaa5c9488697cd636c8821afac54765af993b86cb4bd073245cc2afcd3 WatchSource:0}: Error finding container aacdfffaa5c9488697cd636c8821afac54765af993b86cb4bd073245cc2afcd3: Status 404 returned error can't find the container with id aacdfffaa5c9488697cd636c8821afac54765af993b86cb4bd073245cc2afcd3 Jul 08 17:10:09.305441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.305418 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fxrcw"] Jul 08 17:10:09.309428 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:09.309405 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod935d2a80_4507_4c9d_aa0e_326c3bc25de7.slice/crio-bd6a92bdbf9f47f398c268643a741d2789009ee94a2e8b4b85e045ed26569d27 WatchSource:0}: Error finding container bd6a92bdbf9f47f398c268643a741d2789009ee94a2e8b4b85e045ed26569d27: Status 404 returned error can't find the container with id bd6a92bdbf9f47f398c268643a741d2789009ee94a2e8b4b85e045ed26569d27 Jul 08 17:10:09.367482 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.367451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:09.367656 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:09.367597 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:10:09.367714 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:09.367670 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls podName:c4ced9eb-4fb8-4539-9bcc-de27d6198e36 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:10.367649439 +0000 UTC m=+36.769153850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls") pod "dns-default-7v5fb" (UID: "c4ced9eb-4fb8-4539-9bcc-de27d6198e36") : secret "dns-default-metrics-tls" not found Jul 08 17:10:09.465798 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.465766 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fxrcw" event={"ID":"935d2a80-4507-4c9d-aa0e-326c3bc25de7","Type":"ContainerStarted","Data":"bd6a92bdbf9f47f398c268643a741d2789009ee94a2e8b4b85e045ed26569d27"} Jul 08 17:10:09.466823 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.466799 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-98mqm" event={"ID":"1f02010d-066d-4a1b-8f67-e76b437f1b53","Type":"ContainerStarted","Data":"f193d2e33fcb987afe4aefdadeaf7e266a179d1c3afb1e08d757f437d30d1b86"} Jul 08 17:10:09.467960 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.467927 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" event={"ID":"1766255b-1365-4287-b81f-cf1c9c56a0da","Type":"ContainerStarted","Data":"8d5c6aa493729925d0064ba7db6884c1ef26731df0a04a2a02af24168bbcea03"} Jul 08 17:10:09.468973 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.468954 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" event={"ID":"0bbe62e9-bf21-4977-b63c-6173c46cf195","Type":"ContainerStarted","Data":"14ce4c7365051f5759aa0dfba622efd46cf90e424ce5537d85a397499f13ba6e"} Jul 08 17:10:09.469955 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.469929 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzhw5" event={"ID":"c471b244-f353-4ab3-8d23-25e0f26739fa","Type":"ContainerStarted","Data":"37286b752b3bae943fbbf5d2eb686dbb1a7094b88a752889a670849ca182e8ff"} Jul 08 17:10:09.470874 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.470855 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" event={"ID":"e4a2a9da-2675-486c-8bef-b051037fb231","Type":"ContainerStarted","Data":"699bc428ce89763e7527ee711f38c9152dc7da124903939eda8286977d64399d"} Jul 08 17:10:09.472088 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:09.472068 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" event={"ID":"e398959d-5b24-4304-af82-1a79e9faed29","Type":"ContainerStarted","Data":"aacdfffaa5c9488697cd636c8821afac54765af993b86cb4bd073245cc2afcd3"} Jul 08 17:10:10.021545 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.021488 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:10.128583 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.128550 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:10.175480 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.175340 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-klg5g\" (UID: \"1b237378-67fc-41c9-8053-915a5bc9f57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:10.175665 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:10.175517 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:10:10.175665 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:10.175581 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls podName:1b237378-67fc-41c9-8053-915a5bc9f57d nodeName:}" failed. No retries permitted until 2026-07-08 17:10:12.175561796 +0000 UTC m=+38.577066194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-klg5g" (UID: "1b237378-67fc-41c9-8053-915a5bc9f57d") : secret "samples-operator-tls" not found Jul 08 17:10:10.256774 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.255802 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:10:10.256774 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.256259 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:10:10.257739 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.257396 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:10:10.263175 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.260573 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vc6hl\"" Jul 08 17:10:10.263175 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.260804 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:10:10.263175 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.260956 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s8l5v\"" Jul 08 17:10:10.264706 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.263520 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:10:10.276446 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.276361 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:10.276446 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.276427 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:10.276883 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.276480 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:10.276883 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.276561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:10.276883 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:10.276719 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:10:10.276883 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:10.276738 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:10:10.276883 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:10.276748 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:10:10.276883 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:10.276780 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls podName:1232df85-ee3c-43d7-8c4b-35e54e42eb59 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:12.276761595 +0000 UTC m=+38.678265992 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q6qgr" (UID: "1232df85-ee3c-43d7-8c4b-35e54e42eb59") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:10:10.276883 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:10.276804 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs podName:d5e4bf86-708e-4e08-a293-505c094abc70 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:12.276786633 +0000 UTC m=+38.678291030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs") pod "router-default-5d68bf77dc-pphvl" (UID: "d5e4bf86-708e-4e08-a293-505c094abc70") : secret "router-metrics-certs-default" not found Jul 08 17:10:10.276883 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:10.276750 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q: secret "image-registry-tls" not found Jul 08 17:10:10.276883 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:10.276824 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle podName:d5e4bf86-708e-4e08-a293-505c094abc70 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:12.276813983 +0000 UTC m=+38.678318380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle") pod "router-default-5d68bf77dc-pphvl" (UID: "d5e4bf86-708e-4e08-a293-505c094abc70") : configmap references non-existent config key: service-ca.crt Jul 08 17:10:10.276883 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:10.276868 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls podName:71207c79-9ccb-4904-b619-f3db80036b1e nodeName:}" failed. No retries permitted until 2026-07-08 17:10:12.276856429 +0000 UTC m=+38.678360839 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls") pod "image-registry-5cbfbd8fbf-g7n8q" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e") : secret "image-registry-tls" not found Jul 08 17:10:10.377619 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.377582 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:10.377812 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:10.377749 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:10:10.377888 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:10.377826 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls podName:c4ced9eb-4fb8-4539-9bcc-de27d6198e36 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:12.377805784 +0000 UTC m=+38.779310207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls") pod "dns-default-7v5fb" (UID: "c4ced9eb-4fb8-4539-9bcc-de27d6198e36") : secret "dns-default-metrics-tls" not found Jul 08 17:10:10.486120 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.486023 2567 generic.go:356] "Generic (PLEG): container finished" podID="f653f2c8-1e71-4873-aa01-ff31a98cb14f" containerID="5023a0d88e3c35e3775b7b38ecafae30e293fa03c6c762214175ee3887a92f44" exitCode=0 Jul 08 17:10:10.486120 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:10.486107 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmf67" event={"ID":"f653f2c8-1e71-4873-aa01-ff31a98cb14f","Type":"ContainerDied","Data":"5023a0d88e3c35e3775b7b38ecafae30e293fa03c6c762214175ee3887a92f44"} Jul 08 17:10:12.195749 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:12.195647 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-klg5g\" (UID: \"1b237378-67fc-41c9-8053-915a5bc9f57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:12.196274 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:12.195829 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:10:12.196274 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:12.195914 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls podName:1b237378-67fc-41c9-8053-915a5bc9f57d nodeName:}" failed. No retries permitted until 2026-07-08 17:10:16.195891276 +0000 UTC m=+42.597395695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-klg5g" (UID: "1b237378-67fc-41c9-8053-915a5bc9f57d") : secret "samples-operator-tls" not found Jul 08 17:10:12.297564 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:12.296801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:12.297564 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:12.296907 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:12.297564 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:12.296963 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:12.297564 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:12.297015 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:12.297564 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:12.297197 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle podName:d5e4bf86-708e-4e08-a293-505c094abc70 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:16.297176953 +0000 UTC m=+42.698681352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle") pod "router-default-5d68bf77dc-pphvl" (UID: "d5e4bf86-708e-4e08-a293-505c094abc70") : configmap references non-existent config key: service-ca.crt Jul 08 17:10:12.297564 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:12.297269 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:10:12.297564 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:12.297295 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q: secret "image-registry-tls" not found Jul 08 17:10:12.297564 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:12.297348 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls podName:71207c79-9ccb-4904-b619-f3db80036b1e nodeName:}" failed. No retries permitted until 2026-07-08 17:10:16.297330106 +0000 UTC m=+42.698834514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls") pod "image-registry-5cbfbd8fbf-g7n8q" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e") : secret "image-registry-tls" not found Jul 08 17:10:12.297564 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:12.297412 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:10:12.297564 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:12.297448 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls podName:1232df85-ee3c-43d7-8c4b-35e54e42eb59 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:16.297437272 +0000 UTC m=+42.698941670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q6qgr" (UID: "1232df85-ee3c-43d7-8c4b-35e54e42eb59") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:10:12.297564 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:12.297516 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:10:12.297564 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:12.297545 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs podName:d5e4bf86-708e-4e08-a293-505c094abc70 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:16.297535104 +0000 UTC m=+42.699039508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs") pod "router-default-5d68bf77dc-pphvl" (UID: "d5e4bf86-708e-4e08-a293-505c094abc70") : secret "router-metrics-certs-default" not found Jul 08 17:10:12.398254 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:12.398086 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:12.398434 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:12.398320 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:10:12.398434 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:12.398392 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls podName:c4ced9eb-4fb8-4539-9bcc-de27d6198e36 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:16.398373482 +0000 UTC m=+42.799877882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls") pod "dns-default-7v5fb" (UID: "c4ced9eb-4fb8-4539-9bcc-de27d6198e36") : secret "dns-default-metrics-tls" not found Jul 08 17:10:13.705696 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:13.705604 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:13.813290 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:13.813204 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:15.014465 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:15.014421 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:15.082788 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:15.082629 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:16.238069 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:16.238021 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-klg5g\" (UID: \"1b237378-67fc-41c9-8053-915a5bc9f57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:16.238560 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:16.238228 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:10:16.238560 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:16.238313 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls podName:1b237378-67fc-41c9-8053-915a5bc9f57d nodeName:}" failed. No retries permitted until 2026-07-08 17:10:24.238293522 +0000 UTC m=+50.639797920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-klg5g" (UID: "1b237378-67fc-41c9-8053-915a5bc9f57d") : secret "samples-operator-tls" not found Jul 08 17:10:16.338948 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:16.338913 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:16.339105 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:16.338969 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:16.339105 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:16.339040 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:16.339105 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:16.339084 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:10:16.339287 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:16.339106 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:16.339287 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:16.339150 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs podName:d5e4bf86-708e-4e08-a293-505c094abc70 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:24.339130399 +0000 UTC m=+50.740634875 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs") pod "router-default-5d68bf77dc-pphvl" (UID: "d5e4bf86-708e-4e08-a293-505c094abc70") : secret "router-metrics-certs-default" not found Jul 08 17:10:16.339287 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:16.339233 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle podName:d5e4bf86-708e-4e08-a293-505c094abc70 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:24.33920861 +0000 UTC m=+50.740713013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle") pod "router-default-5d68bf77dc-pphvl" (UID: "d5e4bf86-708e-4e08-a293-505c094abc70") : configmap references non-existent config key: service-ca.crt Jul 08 17:10:16.339287 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:16.339270 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:10:16.339473 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:16.339324 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls podName:1232df85-ee3c-43d7-8c4b-35e54e42eb59 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:24.339309376 +0000 UTC m=+50.740813777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q6qgr" (UID: "1232df85-ee3c-43d7-8c4b-35e54e42eb59") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:10:16.339473 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:16.339358 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:10:16.339473 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:16.339372 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q: secret "image-registry-tls" not found Jul 08 17:10:16.339473 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:16.339410 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls podName:71207c79-9ccb-4904-b619-f3db80036b1e nodeName:}" failed. No retries permitted until 2026-07-08 17:10:24.339396872 +0000 UTC m=+50.740901274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls") pod "image-registry-5cbfbd8fbf-g7n8q" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e") : secret "image-registry-tls" not found Jul 08 17:10:16.440300 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:16.440262 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:16.440481 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:16.440428 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:10:16.440547 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:16.440493 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls podName:c4ced9eb-4fb8-4539-9bcc-de27d6198e36 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:24.44047825 +0000 UTC m=+50.841982647 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls") pod "dns-default-7v5fb" (UID: "c4ced9eb-4fb8-4539-9bcc-de27d6198e36") : secret "dns-default-metrics-tls" not found Jul 08 17:10:18.823541 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:18.823505 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:18.880352 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:18.880316 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:19.430250 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.430204 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:19.515798 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.515693 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-98mqm" event={"ID":"1f02010d-066d-4a1b-8f67-e76b437f1b53","Type":"ContainerStarted","Data":"8b6ae8dd20642c651580805e8c44b827fd3340b9672b4edc2172cd545fa1bc59"} Jul 08 17:10:19.518727 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.518661 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" event={"ID":"1766255b-1365-4287-b81f-cf1c9c56a0da","Type":"ContainerStarted","Data":"c555a4c54cc73fb48d16217f632c252c2ef50cc48f2be734b2ea600b04f74bbb"} Jul 08 17:10:19.523180 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.523131 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmf67" event={"ID":"f653f2c8-1e71-4873-aa01-ff31a98cb14f","Type":"ContainerStarted","Data":"9267445228cacdb50876abdac54dbdb2a62b7d35dae5a2d9bc85a97f3f55a26a"} Jul 08 17:10:19.526555 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.526342 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" event={"ID":"0bbe62e9-bf21-4977-b63c-6173c46cf195","Type":"ContainerStarted","Data":"5b12a81951d5ba72e0a3f46e55536ff3ab29ce9590fa1908de3325657867acfb"} Jul 08 17:10:19.529179 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.528746 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzhw5" event={"ID":"c471b244-f353-4ab3-8d23-25e0f26739fa","Type":"ContainerStarted","Data":"d7f226267b7c91c8fc162eb466cc5deb1b6e788ba26e6552a282bab4b44d7140"} Jul 08 17:10:19.544816 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.544780 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" event={"ID":"e4a2a9da-2675-486c-8bef-b051037fb231","Type":"ContainerStarted","Data":"a027ed2aa01354de2288444577f29ce232f1196595b67db3e22f4bd479a776ef"} Jul 08 17:10:19.545886 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.545793 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:19.548481 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.547771 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/0.log" Jul 08 17:10:19.548481 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.547806 2567 generic.go:356] "Generic (PLEG): container finished" podID="e398959d-5b24-4304-af82-1a79e9faed29" containerID="252ea3d257f2cc551dee4026cd90406e954486a6acb64b7075b06448bbede775" exitCode=255 Jul 08 17:10:19.548481 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.547876 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" event={"ID":"e398959d-5b24-4304-af82-1a79e9faed29","Type":"ContainerDied","Data":"252ea3d257f2cc551dee4026cd90406e954486a6acb64b7075b06448bbede775"} Jul 08 17:10:19.548481 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.548173 2567 scope.go:117] "RemoveContainer" containerID="252ea3d257f2cc551dee4026cd90406e954486a6acb64b7075b06448bbede775" Jul 08 17:10:19.552534 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.552504 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fxrcw" event={"ID":"935d2a80-4507-4c9d-aa0e-326c3bc25de7","Type":"ContainerStarted","Data":"cd5c07d15f712157e7c879963cf2079bc32e31d0bf43fe5ee4db924796f70870"} Jul 08 17:10:19.554676 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.553999 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzhw5" podStartSLOduration=16.46757535 podStartE2EDuration="26.553983485s" totalImagesPullingTime="10.086408135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:19.553379352 +0000 UTC m=+45.954883773" watchObservedRunningTime="2026-07-08 17:10:19.553983485 +0000 UTC m=+45.955487903" Jul 08 17:10:19.555234 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.555195 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-98mqm" podStartSLOduration=8.631962172 podStartE2EDuration="18.555184199s" totalImagesPullingTime="9.923222027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:19.53676145 +0000 UTC m=+45.938265869" watchObservedRunningTime="2026-07-08 17:10:19.555184199 +0000 UTC m=+45.956688619" Jul 08 17:10:19.604923 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.603148 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" podStartSLOduration=9.578519534 podStartE2EDuration="19.603127342s" totalImagesPullingTime="10.024607808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:19.576885975 +0000 UTC m=+45.978390393" watchObservedRunningTime="2026-07-08 17:10:19.603127342 +0000 UTC m=+46.004631761" Jul 08 17:10:19.604923 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.603735 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" podStartSLOduration=11.647640691 podStartE2EDuration="21.60372218s" totalImagesPullingTime="9.956081489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:19.602763509 +0000 UTC m=+46.004267929" watchObservedRunningTime="2026-07-08 17:10:19.60372218 +0000 UTC m=+46.005226603" Jul 08 17:10:19.632304 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.632274 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:19.663449 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.663386 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" podStartSLOduration=16.62385158 podStartE2EDuration="26.66336384s" totalImagesPullingTime="10.03951226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:19.661284873 +0000 UTC m=+46.062789293" watchObservedRunningTime="2026-07-08 17:10:19.66336384 +0000 UTC m=+46.064868262" Jul 08 17:10:19.679184 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.677787 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fxrcw" podStartSLOduration=1.844729803 podStartE2EDuration="11.677767408s" totalImagesPullingTime="9.833037605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:19.677615704 +0000 UTC m=+46.079120169" watchObservedRunningTime="2026-07-08 17:10:19.677767408 +0000 UTC m=+46.079271828" Jul 08 17:10:19.732128 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:19.732090 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:20.558270 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.558192 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:10:20.558712 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.558694 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/0.log" Jul 08 17:10:20.558764 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.558739 2567 generic.go:356] "Generic (PLEG): container finished" podID="e398959d-5b24-4304-af82-1a79e9faed29" containerID="76cbfc5a70365f4f0f732bc90d03db11a138812fe116d42a4591e80c7b706ca9" exitCode=255 Jul 08 17:10:20.558855 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.558826 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" event={"ID":"e398959d-5b24-4304-af82-1a79e9faed29","Type":"ContainerDied","Data":"76cbfc5a70365f4f0f732bc90d03db11a138812fe116d42a4591e80c7b706ca9"} Jul 08 17:10:20.559055 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.559027 2567 scope.go:117] "RemoveContainer" containerID="252ea3d257f2cc551dee4026cd90406e954486a6acb64b7075b06448bbede775" Jul 08 17:10:20.559199 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.559183 2567 scope.go:117] "RemoveContainer" containerID="76cbfc5a70365f4f0f732bc90d03db11a138812fe116d42a4591e80c7b706ca9" Jul 08 17:10:20.559410 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:20.559386 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bhsb4_openshift-console-operator(e398959d-5b24-4304-af82-1a79e9faed29)\"" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" podUID="e398959d-5b24-4304-af82-1a79e9faed29" Jul 08 17:10:20.561945 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.561922 2567 generic.go:356] "Generic (PLEG): container finished" podID="f653f2c8-1e71-4873-aa01-ff31a98cb14f" containerID="9267445228cacdb50876abdac54dbdb2a62b7d35dae5a2d9bc85a97f3f55a26a" exitCode=0 Jul 08 17:10:20.562058 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.561947 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmf67" event={"ID":"f653f2c8-1e71-4873-aa01-ff31a98cb14f","Type":"ContainerDied","Data":"9267445228cacdb50876abdac54dbdb2a62b7d35dae5a2d9bc85a97f3f55a26a"} Jul 08 17:10:20.809834 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.809737 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l7xml"] Jul 08 17:10:20.823531 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.823504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:20.827802 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.826108 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l7xml"] Jul 08 17:10:20.827802 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.826275 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 17:10:20.827802 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.826291 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 17:10:20.827802 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.826550 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wwzzd\"" Jul 08 17:10:20.864600 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.864563 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:20.941205 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.941176 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:20.987675 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.987637 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:20.987862 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.987691 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc974593-c73d-4f6d-9b20-17de46a702b6-crio-socket\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:20.987862 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.987805 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:20.987970 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.987868 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc974593-c73d-4f6d-9b20-17de46a702b6-data-volume\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:20.987970 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:20.987897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gfxh\" (UniqueName: \"kubernetes.io/projected/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-api-access-2gfxh\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:21.051326 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.051287 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:21.088736 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.088657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc974593-c73d-4f6d-9b20-17de46a702b6-crio-socket\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:21.088736 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.088718 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:21.088953 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.088780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc974593-c73d-4f6d-9b20-17de46a702b6-data-volume\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:21.088953 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.088807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gfxh\" (UniqueName: \"kubernetes.io/projected/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-api-access-2gfxh\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:21.088953 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:21.088829 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:10:21.088953 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.088779 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc974593-c73d-4f6d-9b20-17de46a702b6-crio-socket\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:21.088953 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.088876 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:21.089314 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:21.089296 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls podName:cc974593-c73d-4f6d-9b20-17de46a702b6 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:21.588877643 +0000 UTC m=+47.990382044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l7xml" (UID: "cc974593-c73d-4f6d-9b20-17de46a702b6") : secret "insights-runtime-extractor-tls" not found Jul 08 17:10:21.089440 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.089418 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc974593-c73d-4f6d-9b20-17de46a702b6-data-volume\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:21.089504 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:21.089423 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:10:21.089570 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:21.089554 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm podName:cc974593-c73d-4f6d-9b20-17de46a702b6 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:21.58953729 +0000 UTC m=+47.991041691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l7xml" (UID: "cc974593-c73d-4f6d-9b20-17de46a702b6") : configmap "kube-rbac-proxy" not found Jul 08 17:10:21.101483 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.101454 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gfxh\" (UniqueName: \"kubernetes.io/projected/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-api-access-2gfxh\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:21.119604 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.119580 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:21.220681 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.220642 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:21.567317 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.567284 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:10:21.567738 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.567646 2567 scope.go:117] "RemoveContainer" containerID="76cbfc5a70365f4f0f732bc90d03db11a138812fe116d42a4591e80c7b706ca9" Jul 08 17:10:21.567857 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:21.567836 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bhsb4_openshift-console-operator(e398959d-5b24-4304-af82-1a79e9faed29)\"" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" podUID="e398959d-5b24-4304-af82-1a79e9faed29" Jul 08 17:10:21.570263 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.570239 2567 generic.go:356] "Generic (PLEG): container finished" podID="f653f2c8-1e71-4873-aa01-ff31a98cb14f" containerID="b995d2ad95d483fc0ccba4e3d50ca05c7a29208c84bbe55f62d46f0f0f153c5f" exitCode=0 Jul 08 17:10:21.570373 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.570295 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmf67" event={"ID":"f653f2c8-1e71-4873-aa01-ff31a98cb14f","Type":"ContainerDied","Data":"b995d2ad95d483fc0ccba4e3d50ca05c7a29208c84bbe55f62d46f0f0f153c5f"} Jul 08 17:10:21.594307 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.594286 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:21.594448 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.594423 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:21.594509 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:21.594437 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:10:21.594509 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:21.594480 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:10:21.594588 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:21.594525 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls podName:cc974593-c73d-4f6d-9b20-17de46a702b6 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:22.594506239 +0000 UTC m=+48.996010647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l7xml" (UID: "cc974593-c73d-4f6d-9b20-17de46a702b6") : secret "insights-runtime-extractor-tls" not found Jul 08 17:10:21.594588 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:21.594542 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm podName:cc974593-c73d-4f6d-9b20-17de46a702b6 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:22.594534123 +0000 UTC m=+48.996038523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l7xml" (UID: "cc974593-c73d-4f6d-9b20-17de46a702b6") : configmap "kube-rbac-proxy" not found Jul 08 17:10:21.725058 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.725034 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:21.827776 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:21.827699 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:22.578014 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:22.577976 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmf67" event={"ID":"f653f2c8-1e71-4873-aa01-ff31a98cb14f","Type":"ContainerStarted","Data":"2024fef5cfd89e5726d922159f3ef9f6758736328758b2ab080deff4ee1b3204"} Jul 08 17:10:22.602389 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:22.602334 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fmf67" podStartSLOduration=8.891930284 podStartE2EDuration="48.602317884s" totalImagesPullingTime="39.7103876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:22.600234468 +0000 UTC m=+49.001738888" watchObservedRunningTime="2026-07-08 17:10:22.602317884 +0000 UTC m=+49.003822302" Jul 08 17:10:22.604556 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:22.604531 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:22.604658 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:22.604643 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:22.604723 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:22.604705 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:10:22.604787 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:22.604777 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls podName:cc974593-c73d-4f6d-9b20-17de46a702b6 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:24.604758621 +0000 UTC m=+51.006263035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l7xml" (UID: "cc974593-c73d-4f6d-9b20-17de46a702b6") : secret "insights-runtime-extractor-tls" not found Jul 08 17:10:22.604824 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:22.604713 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:10:22.604864 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:22.604845 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm podName:cc974593-c73d-4f6d-9b20-17de46a702b6 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:24.604831872 +0000 UTC m=+51.006336290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l7xml" (UID: "cc974593-c73d-4f6d-9b20-17de46a702b6") : configmap "kube-rbac-proxy" not found Jul 08 17:10:22.606293 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:22.606274 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fbzfk_6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e/dns-node-resolver/0.log" Jul 08 17:10:22.723566 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:22.723515 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:22.823571 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:22.823518 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:23.206176 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:23.206130 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gp6fb_6e808ac0-56f2-43de-820c-c788e873dbec/node-ca/0.log" Jul 08 17:10:23.357732 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:23.357695 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:23.459191 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:23.459091 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:24.010029 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:24.009999 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fxrcw_935d2a80-4507-4c9d-aa0e-326c3bc25de7/serve-healthcheck-canary/0.log" Jul 08 17:10:24.319327 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:24.319240 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-klg5g\" (UID: \"1b237378-67fc-41c9-8053-915a5bc9f57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:24.319477 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.319393 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:10:24.319477 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.319463 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls podName:1b237378-67fc-41c9-8053-915a5bc9f57d nodeName:}" failed. No retries permitted until 2026-07-08 17:10:40.319446027 +0000 UTC m=+66.720950423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-klg5g" (UID: "1b237378-67fc-41c9-8053-915a5bc9f57d") : secret "samples-operator-tls" not found Jul 08 17:10:24.420498 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:24.420458 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:24.420655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:24.420515 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:24.420655 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.420601 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:10:24.420655 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.420654 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs podName:d5e4bf86-708e-4e08-a293-505c094abc70 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:40.420640118 +0000 UTC m=+66.822144518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs") pod "router-default-5d68bf77dc-pphvl" (UID: "d5e4bf86-708e-4e08-a293-505c094abc70") : secret "router-metrics-certs-default" not found Jul 08 17:10:24.420769 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.420665 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:10:24.420769 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.420683 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q: secret "image-registry-tls" not found Jul 08 17:10:24.420769 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.420734 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls podName:71207c79-9ccb-4904-b619-f3db80036b1e nodeName:}" failed. No retries permitted until 2026-07-08 17:10:40.420717827 +0000 UTC m=+66.822222225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls") pod "image-registry-5cbfbd8fbf-g7n8q" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e") : secret "image-registry-tls" not found Jul 08 17:10:24.420874 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:24.420787 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:24.420874 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:24.420859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:24.420949 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.420935 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle podName:d5e4bf86-708e-4e08-a293-505c094abc70 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:40.420907682 +0000 UTC m=+66.822412087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle") pod "router-default-5d68bf77dc-pphvl" (UID: "d5e4bf86-708e-4e08-a293-505c094abc70") : configmap references non-existent config key: service-ca.crt Jul 08 17:10:24.420996 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.420958 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:10:24.420996 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.420994 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls podName:1232df85-ee3c-43d7-8c4b-35e54e42eb59 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:40.420982587 +0000 UTC m=+66.822486987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-q6qgr" (UID: "1232df85-ee3c-43d7-8c4b-35e54e42eb59") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:10:24.487170 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:24.487117 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:24.522356 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:24.522322 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:24.522561 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.522495 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:10:24.522606 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.522563 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls podName:c4ced9eb-4fb8-4539-9bcc-de27d6198e36 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:40.522545672 +0000 UTC m=+66.924050070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls") pod "dns-default-7v5fb" (UID: "c4ced9eb-4fb8-4539-9bcc-de27d6198e36") : secret "dns-default-metrics-tls" not found Jul 08 17:10:24.623050 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:24.622955 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:24.623324 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:24.623097 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:24.623324 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.623105 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:10:24.623324 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.623184 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls podName:cc974593-c73d-4f6d-9b20-17de46a702b6 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:28.623166401 +0000 UTC m=+55.024670811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l7xml" (UID: "cc974593-c73d-4f6d-9b20-17de46a702b6") : secret "insights-runtime-extractor-tls" not found Jul 08 17:10:24.623324 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.623202 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:10:24.623324 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:24.623260 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm podName:cc974593-c73d-4f6d-9b20-17de46a702b6 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:28.623244401 +0000 UTC m=+55.024748801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l7xml" (UID: "cc974593-c73d-4f6d-9b20-17de46a702b6") : configmap "kube-rbac-proxy" not found Jul 08 17:10:25.054301 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:25.054264 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:27.432672 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:27.432638 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:28.657525 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:28.657489 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:28.657930 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:28.657593 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:28.657930 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:28.657641 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:10:28.657930 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:28.657701 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls podName:cc974593-c73d-4f6d-9b20-17de46a702b6 nodeName:}" failed. No retries permitted until 2026-07-08 17:10:36.657686731 +0000 UTC m=+63.059191128 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l7xml" (UID: "cc974593-c73d-4f6d-9b20-17de46a702b6") : secret "insights-runtime-extractor-tls" not found Jul 08 17:10:28.658043 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:28.658030 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc974593-c73d-4f6d-9b20-17de46a702b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:28.926555 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:28.926476 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:29.094125 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:29.094096 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:29.094311 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:29.094141 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:29.094537 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:29.094522 2567 scope.go:117] "RemoveContainer" containerID="76cbfc5a70365f4f0f732bc90d03db11a138812fe116d42a4591e80c7b706ca9" Jul 08 17:10:29.094696 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:10:29.094679 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bhsb4_openshift-console-operator(e398959d-5b24-4304-af82-1a79e9faed29)\"" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" podUID="e398959d-5b24-4304-af82-1a79e9faed29" Jul 08 17:10:29.125114 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:29.125093 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:29.222814 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:29.222738 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:29.329371 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:29.329341 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:29.436479 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:29.436439 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:29.530954 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:29.530876 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:29.827726 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:29.827634 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:30.025165 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:30.025121 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:31.224043 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:31.224012 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:31.423109 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:31.423068 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:31.629848 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:31.629822 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:31.823008 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:31.822976 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:32.021618 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:32.021546 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:32.629422 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:32.629391 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:32.783082 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:32.783050 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:33.025745 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:33.025654 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:33.254226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:33.254190 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:33.530402 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:33.530350 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:33.631375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:33.631344 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:33.694803 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:33.694771 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:33.838964 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:33.838882 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:33.901177 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:33.901126 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:34.228694 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:34.228662 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:34.460236 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:34.460209 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t7wkp" Jul 08 17:10:34.841100 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:34.841067 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:35.361628 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:35.361584 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:35.426172 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:35.426125 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:35.623007 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:35.622930 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:35.826835 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:35.826804 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:36.020646 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:36.020612 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:36.720811 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:36.720764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:36.723203 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:36.723170 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc974593-c73d-4f6d-9b20-17de46a702b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l7xml\" (UID: \"cc974593-c73d-4f6d-9b20-17de46a702b6\") " pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:36.737660 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:36.737635 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wwzzd\"" Jul 08 17:10:36.745507 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:36.745488 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l7xml" Jul 08 17:10:36.894394 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:36.894361 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:36.898724 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:36.898674 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l7xml"] Jul 08 17:10:36.901136 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:36.901112 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc974593_c73d_4f6d_9b20_17de46a702b6.slice/crio-afc1811131da969838ad7975313a6baa154b42dea00b5726174f8ca4a627f20f WatchSource:0}: Error finding container afc1811131da969838ad7975313a6baa154b42dea00b5726174f8ca4a627f20f: Status 404 returned error can't find the container with id afc1811131da969838ad7975313a6baa154b42dea00b5726174f8ca4a627f20f Jul 08 17:10:37.031060 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:37.030980 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:37.433147 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:37.433115 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:37.627134 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:37.627100 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l7xml" event={"ID":"cc974593-c73d-4f6d-9b20-17de46a702b6","Type":"ContainerStarted","Data":"afc1811131da969838ad7975313a6baa154b42dea00b5726174f8ca4a627f20f"} Jul 08 17:10:37.631921 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:37.631898 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:37.849222 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:37.849127 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:38.026719 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.026660 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:38.740286 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.740246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:10:38.740778 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.740300 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs\") pod \"network-metrics-daemon-f6jwj\" (UID: \"506c8214-179c-4cb1-91c2-6f282fdca948\") " pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:10:38.743243 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.743214 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:10:38.743377 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.743242 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:10:38.753700 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.753671 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/506c8214-179c-4cb1-91c2-6f282fdca948-metrics-certs\") pod \"network-metrics-daemon-f6jwj\" (UID: \"506c8214-179c-4cb1-91c2-6f282fdca948\") " pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:10:38.753935 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.753911 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/766e4d7c-1d51-4db8-bdc4-3be62175a3a6-original-pull-secret\") pod \"global-pull-secret-syncer-9d4bs\" (UID: \"766e4d7c-1d51-4db8-bdc4-3be62175a3a6\") " pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:10:38.777630 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.777604 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s8l5v\"" Jul 08 17:10:38.785722 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.785689 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f6jwj" Jul 08 17:10:38.788383 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.788363 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9d4bs" Jul 08 17:10:38.841650 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.841591 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8v7c\" (UniqueName: \"kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c\") pod \"network-check-target-rrn89\" (UID: \"a9500b93-f23e-4463-b378-0cd8967cbaef\") " pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:10:38.846736 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.846693 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8v7c\" (UniqueName: \"kubernetes.io/projected/a9500b93-f23e-4463-b378-0cd8967cbaef-kube-api-access-k8v7c\") pod \"network-check-target-rrn89\" (UID: \"a9500b93-f23e-4463-b378-0cd8967cbaef\") " pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:10:38.949189 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.949142 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9d4bs"] Jul 08 17:10:38.952352 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:38.952320 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod766e4d7c_1d51_4db8_bdc4_3be62175a3a6.slice/crio-7360ffb1c1a91018c3eaa3034b6935ce561fdbd13f88bf169fe5e2781bead60e WatchSource:0}: Error finding container 7360ffb1c1a91018c3eaa3034b6935ce561fdbd13f88bf169fe5e2781bead60e: Status 404 returned error can't find the container with id 7360ffb1c1a91018c3eaa3034b6935ce561fdbd13f88bf169fe5e2781bead60e Jul 08 17:10:38.961260 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:38.961234 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f6jwj"] Jul 08 17:10:38.964494 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:38.964459 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506c8214_179c_4cb1_91c2_6f282fdca948.slice/crio-4314b61d1866a1a95b9481ab4ce741d28448f1c274d4d640cccb1e806388cfee WatchSource:0}: Error finding container 4314b61d1866a1a95b9481ab4ce741d28448f1c274d4d640cccb1e806388cfee: Status 404 returned error can't find the container with id 4314b61d1866a1a95b9481ab4ce741d28448f1c274d4d640cccb1e806388cfee Jul 08 17:10:39.086520 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:39.086233 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vc6hl\"" Jul 08 17:10:39.094133 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:39.094105 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:10:39.243118 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:39.243041 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rrn89"] Jul 08 17:10:39.247020 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:39.246981 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9500b93_f23e_4463_b378_0cd8967cbaef.slice/crio-2fd1b03ab8d47b0d748e1debe26eb27632ba9eaf6c1dd87ea004b53cdbd094a7 WatchSource:0}: Error finding container 2fd1b03ab8d47b0d748e1debe26eb27632ba9eaf6c1dd87ea004b53cdbd094a7: Status 404 returned error can't find the container with id 2fd1b03ab8d47b0d748e1debe26eb27632ba9eaf6c1dd87ea004b53cdbd094a7 Jul 08 17:10:39.560257 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:39.560225 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:39.637647 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:39.637605 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f6jwj" event={"ID":"506c8214-179c-4cb1-91c2-6f282fdca948","Type":"ContainerStarted","Data":"4314b61d1866a1a95b9481ab4ce741d28448f1c274d4d640cccb1e806388cfee"} Jul 08 17:10:39.639451 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:39.639345 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rrn89" event={"ID":"a9500b93-f23e-4463-b378-0cd8967cbaef","Type":"ContainerStarted","Data":"f64189c457199f8942cdd0079b39a82b3a5e3801bd4ee1d3eafc25a88670e855"} Jul 08 17:10:39.639451 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:39.639401 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:10:39.639451 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:39.639423 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rrn89" event={"ID":"a9500b93-f23e-4463-b378-0cd8967cbaef","Type":"ContainerStarted","Data":"2fd1b03ab8d47b0d748e1debe26eb27632ba9eaf6c1dd87ea004b53cdbd094a7"} Jul 08 17:10:39.640557 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:39.640528 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9d4bs" event={"ID":"766e4d7c-1d51-4db8-bdc4-3be62175a3a6","Type":"ContainerStarted","Data":"7360ffb1c1a91018c3eaa3034b6935ce561fdbd13f88bf169fe5e2781bead60e"} Jul 08 17:10:39.655282 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:39.655232 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rrn89" podStartSLOduration=65.655215185 podStartE2EDuration="1m5.655215185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:39.653696818 +0000 UTC m=+66.055201250" watchObservedRunningTime="2026-07-08 17:10:39.655215185 +0000 UTC m=+66.056719604" Jul 08 17:10:39.658519 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:39.658498 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:39.718324 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:39.718288 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:40.254998 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.254921 2567 scope.go:117] "RemoveContainer" containerID="76cbfc5a70365f4f0f732bc90d03db11a138812fe116d42a4591e80c7b706ca9" Jul 08 17:10:40.358539 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.358432 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-klg5g\" (UID: \"1b237378-67fc-41c9-8053-915a5bc9f57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:40.361360 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.361327 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b237378-67fc-41c9-8053-915a5bc9f57d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-klg5g\" (UID: \"1b237378-67fc-41c9-8053-915a5bc9f57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:40.459608 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.459571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:40.459789 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.459643 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:40.459789 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.459707 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:40.459789 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.459757 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:40.460488 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.460436 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5e4bf86-708e-4e08-a293-505c094abc70-service-ca-bundle\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:40.462464 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.462432 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1232df85-ee3c-43d7-8c4b-35e54e42eb59-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-q6qgr\" (UID: \"1232df85-ee3c-43d7-8c4b-35e54e42eb59\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:40.462567 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.462474 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e4bf86-708e-4e08-a293-505c094abc70-metrics-certs\") pod \"router-default-5d68bf77dc-pphvl\" (UID: \"d5e4bf86-708e-4e08-a293-505c094abc70\") " pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:40.462567 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.462474 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls\") pod \"image-registry-5cbfbd8fbf-g7n8q\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:40.560759 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.560671 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:40.563063 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.563031 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4ced9eb-4fb8-4539-9bcc-de27d6198e36-metrics-tls\") pod \"dns-default-7v5fb\" (UID: \"c4ced9eb-4fb8-4539-9bcc-de27d6198e36\") " pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:40.612143 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.612111 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xfvlp\"" Jul 08 17:10:40.620070 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.620044 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" Jul 08 17:10:40.650005 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.649977 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7v2mr\"" Jul 08 17:10:40.658401 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.658377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" Jul 08 17:10:40.693118 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.693091 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bhhk5\"" Jul 08 17:10:40.701138 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.701108 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:40.704694 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.704675 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zptlq\"" Jul 08 17:10:40.712676 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.712649 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:40.759560 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.759516 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t5877\"" Jul 08 17:10:40.767658 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:40.767628 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:41.826824 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:41.826739 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d68bf77dc-pphvl"] Jul 08 17:10:41.850186 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:41.850084 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q"] Jul 08 17:10:41.867555 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:41.867470 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g"] Jul 08 17:10:41.891637 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:41.891607 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr"] Jul 08 17:10:41.915785 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:41.915707 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7v5fb"] Jul 08 17:10:42.031827 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:42.031792 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ced9eb_4fb8_4539_9bcc_de27d6198e36.slice/crio-8cae3dd741e19a627b9c51e0c3a43939cc2f9ff015cfebf654c37aaf9fd17276 WatchSource:0}: Error finding container 8cae3dd741e19a627b9c51e0c3a43939cc2f9ff015cfebf654c37aaf9fd17276: Status 404 returned error can't find the container with id 8cae3dd741e19a627b9c51e0c3a43939cc2f9ff015cfebf654c37aaf9fd17276 Jul 08 17:10:42.032898 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:42.032867 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e4bf86_708e_4e08_a293_505c094abc70.slice/crio-21db47dff66c746a8f31e9f4a49ca5d9a55ee4fc8883ab1260578f271baabe98 WatchSource:0}: Error finding container 21db47dff66c746a8f31e9f4a49ca5d9a55ee4fc8883ab1260578f271baabe98: Status 404 returned error can't find the container with id 21db47dff66c746a8f31e9f4a49ca5d9a55ee4fc8883ab1260578f271baabe98 Jul 08 17:10:42.046724 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:42.046675 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1232df85_ee3c_43d7_8c4b_35e54e42eb59.slice/crio-e07d17c1e2aede36fd8750d7920a4fe654dc77c1cc3d0f858420abefeadb6f37 WatchSource:0}: Error finding container e07d17c1e2aede36fd8750d7920a4fe654dc77c1cc3d0f858420abefeadb6f37: Status 404 returned error can't find the container with id e07d17c1e2aede36fd8750d7920a4fe654dc77c1cc3d0f858420abefeadb6f37 Jul 08 17:10:42.581792 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.581753 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:42.653621 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.653584 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l7xml" event={"ID":"cc974593-c73d-4f6d-9b20-17de46a702b6","Type":"ContainerStarted","Data":"7bd44ab6f645ab54c95ba43445a07ed33349a21d4f0fa53d6695577383fbbe6b"} Jul 08 17:10:42.655351 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.655327 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:10:42.655481 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.655427 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" event={"ID":"e398959d-5b24-4304-af82-1a79e9faed29","Type":"ContainerStarted","Data":"b0122bca73ebdfb09729e7d6e1865737bef6dee92dc1a39b0a472eca38f763fd"} Jul 08 17:10:42.655737 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.655715 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:42.657198 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.657169 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f6jwj" event={"ID":"506c8214-179c-4cb1-91c2-6f282fdca948","Type":"ContainerStarted","Data":"00b3b79e1d67ebb4dd3783d1bf2ecc4e7da2a5efbc03fbd79fc80a17647baf7d"} Jul 08 17:10:42.657299 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.657221 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f6jwj" event={"ID":"506c8214-179c-4cb1-91c2-6f282fdca948","Type":"ContainerStarted","Data":"141d73cc8b3cb789d82129bdbb727e7c7b0f89fd14458c2d6f978e7912be1b43"} Jul 08 17:10:42.658343 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.658324 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7v5fb" event={"ID":"c4ced9eb-4fb8-4539-9bcc-de27d6198e36","Type":"ContainerStarted","Data":"8cae3dd741e19a627b9c51e0c3a43939cc2f9ff015cfebf654c37aaf9fd17276"} Jul 08 17:10:42.659450 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.659427 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" event={"ID":"1232df85-ee3c-43d7-8c4b-35e54e42eb59","Type":"ContainerStarted","Data":"e07d17c1e2aede36fd8750d7920a4fe654dc77c1cc3d0f858420abefeadb6f37"} Jul 08 17:10:42.660538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.660513 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" event={"ID":"1b237378-67fc-41c9-8053-915a5bc9f57d","Type":"ContainerStarted","Data":"511bd79d58828839156b7b5e1657aec4f6b9f5d78b06ce9e29ffccba49c9596c"} Jul 08 17:10:42.661167 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.661133 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" Jul 08 17:10:42.661843 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.661816 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" event={"ID":"71207c79-9ccb-4904-b619-f3db80036b1e","Type":"ContainerStarted","Data":"6de020cb0f23b2b7c3e4f2f4d0ad4d9ce4d115546f16e9dec10ea39b40768041"} Jul 08 17:10:42.661935 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.661861 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" event={"ID":"71207c79-9ccb-4904-b619-f3db80036b1e","Type":"ContainerStarted","Data":"ed1128a8130389970059737804162152eee4463caec6c00879cf8b326cf54cdf"} Jul 08 17:10:42.661935 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.661886 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:10:42.663037 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.663020 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d68bf77dc-pphvl" event={"ID":"d5e4bf86-708e-4e08-a293-505c094abc70","Type":"ContainerStarted","Data":"198b437fc1d55fffa2774a0cbd432f64131f4681d364a9cc0d7d8b4491d05e4f"} Jul 08 17:10:42.663127 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.663050 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d68bf77dc-pphvl" event={"ID":"d5e4bf86-708e-4e08-a293-505c094abc70","Type":"ContainerStarted","Data":"21db47dff66c746a8f31e9f4a49ca5d9a55ee4fc8883ab1260578f271baabe98"} Jul 08 17:10:42.675792 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.675755 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-bhsb4" podStartSLOduration=38.893414126 podStartE2EDuration="48.675741128s" totalImagesPullingTime="9.782327002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:42.674661584 +0000 UTC m=+69.076166003" watchObservedRunningTime="2026-07-08 17:10:42.675741128 +0000 UTC m=+69.077245743" Jul 08 17:10:42.680292 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.680270 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:42.695961 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.695915 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" podStartSLOduration=68.695900967 podStartE2EDuration="1m8.695900967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:42.694892897 +0000 UTC m=+69.096397315" watchObservedRunningTime="2026-07-08 17:10:42.695900967 +0000 UTC m=+69.097405385" Jul 08 17:10:42.713604 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.713574 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:42.716745 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.716715 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:42.731421 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.731369 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f6jwj" podStartSLOduration=65.583093522 podStartE2EDuration="1m8.731350279s" totalImagesPullingTime="3.148256757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:42.730813573 +0000 UTC m=+69.132317994" watchObservedRunningTime="2026-07-08 17:10:42.731350279 +0000 UTC m=+69.132854699" Jul 08 17:10:42.753209 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.753125 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5d68bf77dc-pphvl" podStartSLOduration=49.753106452 podStartE2EDuration="49.753106452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:42.75228327 +0000 UTC m=+69.153787687" watchObservedRunningTime="2026-07-08 17:10:42.753106452 +0000 UTC m=+69.154610871" Jul 08 17:10:42.754766 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.754732 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:42.855498 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:42.855459 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:43.025582 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:43.025462 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:43.246478 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:43.246437 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:43.671950 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:43.671827 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l7xml" event={"ID":"cc974593-c73d-4f6d-9b20-17de46a702b6","Type":"ContainerStarted","Data":"ab5d0e6afe4a2ba2eac799f52d78ab5ab541e2358adc31a39625201b60197dda"} Jul 08 17:10:43.671950 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:43.671913 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:43.673355 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:43.673313 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d68bf77dc-pphvl" Jul 08 17:10:43.910749 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:43.910714 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:44.021554 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:44.021472 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:44.437819 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:44.437775 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:44.633004 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:44.632950 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:44.783804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:44.783723 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:45.017561 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.017488 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:45.047393 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.047315 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584"] Jul 08 17:10:45.073367 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.073332 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.077580 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.077554 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 17:10:45.077844 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.077809 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 17:10:45.078804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.078731 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 17:10:45.078804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.078787 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 08 17:10:45.078965 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.078874 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 08 17:10:45.078965 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.078734 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 08 17:10:45.085763 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.085743 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 08 17:10:45.098295 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.098239 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584"] Jul 08 17:10:45.098576 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.098549 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/438bf02d-3cb4-4943-a739-84bf5632c8aa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.098680 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.098599 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/438bf02d-3cb4-4943-a739-84bf5632c8aa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.098680 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.098649 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/438bf02d-3cb4-4943-a739-84bf5632c8aa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.098796 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.098680 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/438bf02d-3cb4-4943-a739-84bf5632c8aa-ca\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.098796 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.098738 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6s5h\" (UniqueName: \"kubernetes.io/projected/438bf02d-3cb4-4943-a739-84bf5632c8aa-kube-api-access-w6s5h\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.098796 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.098768 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/438bf02d-3cb4-4943-a739-84bf5632c8aa-hub\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.199448 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.199413 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/438bf02d-3cb4-4943-a739-84bf5632c8aa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.199628 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.199462 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/438bf02d-3cb4-4943-a739-84bf5632c8aa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.199628 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.199509 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/438bf02d-3cb4-4943-a739-84bf5632c8aa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.199628 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.199541 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/438bf02d-3cb4-4943-a739-84bf5632c8aa-ca\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.199628 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.199579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6s5h\" (UniqueName: \"kubernetes.io/projected/438bf02d-3cb4-4943-a739-84bf5632c8aa-kube-api-access-w6s5h\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.199628 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.199607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/438bf02d-3cb4-4943-a739-84bf5632c8aa-hub\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.200370 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.200344 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/438bf02d-3cb4-4943-a739-84bf5632c8aa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.202794 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.202702 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:45.202966 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.202943 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/438bf02d-3cb4-4943-a739-84bf5632c8aa-hub\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.203048 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.202992 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/438bf02d-3cb4-4943-a739-84bf5632c8aa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.203114 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.203061 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/438bf02d-3cb4-4943-a739-84bf5632c8aa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.203538 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.203518 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/438bf02d-3cb4-4943-a739-84bf5632c8aa-ca\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.213460 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.213433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6s5h\" (UniqueName: \"kubernetes.io/projected/438bf02d-3cb4-4943-a739-84bf5632c8aa-kube-api-access-w6s5h\") pod \"cluster-proxy-proxy-agent-65b75b4646-tr584\" (UID: \"438bf02d-3cb4-4943-a739-84bf5632c8aa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.390651 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.390611 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" Jul 08 17:10:45.407714 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.407636 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:45.515341 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.515304 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:45.600406 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:45.600370 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:47.684993 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:47.684964 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584"] Jul 08 17:10:48.828636 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:10:48.828586 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod438bf02d_3cb4_4943_a739_84bf5632c8aa.slice/crio-3498443b8bf0f8f4bc25f61b9033a3d14ad2e99cf6e6a8f92b66ed582e05eb0e WatchSource:0}: Error finding container 3498443b8bf0f8f4bc25f61b9033a3d14ad2e99cf6e6a8f92b66ed582e05eb0e: Status 404 returned error can't find the container with id 3498443b8bf0f8f4bc25f61b9033a3d14ad2e99cf6e6a8f92b66ed582e05eb0e Jul 08 17:10:48.870781 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:48.870706 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:48.975108 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:48.975075 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:49.252611 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.252584 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:49.340770 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.340331 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:49.416591 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.416555 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:49.671784 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.671732 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:49.697449 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.697415 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9d4bs" event={"ID":"766e4d7c-1d51-4db8-bdc4-3be62175a3a6","Type":"ContainerStarted","Data":"14bfe0a93d61cd2afeb45b30f33e706b8b261a39f89c10c9570e6cd623bf40d3"} Jul 08 17:10:49.698621 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.698598 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" event={"ID":"438bf02d-3cb4-4943-a739-84bf5632c8aa","Type":"ContainerStarted","Data":"3498443b8bf0f8f4bc25f61b9033a3d14ad2e99cf6e6a8f92b66ed582e05eb0e"} Jul 08 17:10:49.700547 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.700519 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l7xml" event={"ID":"cc974593-c73d-4f6d-9b20-17de46a702b6","Type":"ContainerStarted","Data":"955ba8f1e66f3da07bf367b8cd790f2af5d627355afcafe76cd011b93f265c12"} Jul 08 17:10:49.702296 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.702270 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7v5fb" event={"ID":"c4ced9eb-4fb8-4539-9bcc-de27d6198e36","Type":"ContainerStarted","Data":"b1204e97d8788504e7ba70e2cde4b0817cdea736138aa5e5354106820baa4668"} Jul 08 17:10:49.702381 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.702328 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7v5fb" Jul 08 17:10:49.702381 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.702357 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7v5fb" event={"ID":"c4ced9eb-4fb8-4539-9bcc-de27d6198e36","Type":"ContainerStarted","Data":"d8b7c01d5200eb5228fee0e450307226f03f66042a12d50909d244c5398a684d"} Jul 08 17:10:49.703812 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.703787 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" event={"ID":"1232df85-ee3c-43d7-8c4b-35e54e42eb59","Type":"ContainerStarted","Data":"5c0467afb4f037a6d1daf95e14228ce732033dd5eb2521becf91f7f4717b529e"} Jul 08 17:10:49.705321 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.705301 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" event={"ID":"1b237378-67fc-41c9-8053-915a5bc9f57d","Type":"ContainerStarted","Data":"73a21b1f51fda928c39d999982d0188a431a606b6cb1a7e6c1fd556bab06c45a"} Jul 08 17:10:49.705402 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.705341 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" event={"ID":"1b237378-67fc-41c9-8053-915a5bc9f57d","Type":"ContainerStarted","Data":"9d431e1517337c7a912d2ec4e0cb30f1d0a5a441e1e72e8370300f75bc3af155"} Jul 08 17:10:49.712493 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.712452 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9d4bs" podStartSLOduration=67.107577484 podStartE2EDuration="1m15.712440277s" totalImagesPullingTime="8.604862793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:49.71132325 +0000 UTC m=+76.112827678" watchObservedRunningTime="2026-07-08 17:10:49.712440277 +0000 UTC m=+76.113944695" Jul 08 17:10:49.726568 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.726526 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-q6qgr" podStartSLOduration=51.21291271 podStartE2EDuration="56.726514378s" totalImagesPullingTime="5.513601668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:49.726331909 +0000 UTC m=+76.127836328" watchObservedRunningTime="2026-07-08 17:10:49.726514378 +0000 UTC m=+76.128018797" Jul 08 17:10:49.746416 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.746371 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l7xml" podStartSLOduration=17.713505407 podStartE2EDuration="29.746349332s" totalImagesPullingTime="12.032843925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:10:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:49.744124135 +0000 UTC m=+76.145628554" watchObservedRunningTime="2026-07-08 17:10:49.746349332 +0000 UTC m=+76.147853775" Jul 08 17:10:49.760916 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.760851 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7v5fb" podStartSLOduration=36.241055813 podStartE2EDuration="41.760833476s" totalImagesPullingTime="5.519777663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:49.759582956 +0000 UTC m=+76.161087368" watchObservedRunningTime="2026-07-08 17:10:49.760833476 +0000 UTC m=+76.162337896" Jul 08 17:10:49.776518 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:49.776451 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-klg5g" podStartSLOduration=51.317686661 podStartE2EDuration="56.776427722s" totalImagesPullingTime="5.458741061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:49.775645382 +0000 UTC m=+76.177149800" watchObservedRunningTime="2026-07-08 17:10:49.776427722 +0000 UTC m=+76.177932142" Jul 08 17:10:50.443135 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:50.443101 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:50.522679 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:50.522603 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:50.648836 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:50.648778 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:50.749681 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:50.749589 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:53.724486 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:53.724448 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" event={"ID":"438bf02d-3cb4-4943-a739-84bf5632c8aa","Type":"ContainerStarted","Data":"340938a1e8ce1979130bc2b64a5c90749edd481b70143462670e5d1a6b786cbd"} Jul 08 17:10:53.724486 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:53.724493 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" event={"ID":"438bf02d-3cb4-4943-a739-84bf5632c8aa","Type":"ContainerStarted","Data":"b0b6b4ef3afaaa0ff66d7fc1467a9355f84589c987e614e9b1f8f89b52b69852"} Jul 08 17:10:53.724907 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:53.724506 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" event={"ID":"438bf02d-3cb4-4943-a739-84bf5632c8aa","Type":"ContainerStarted","Data":"d14dfd0891f5dad6e5fba79e401a52ee83bba02ead824bf28ac99be8cd65718c"} Jul 08 17:10:53.743235 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:53.743182 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65b75b4646-tr584" podStartSLOduration=5.847437729 podStartE2EDuration="9.743146103s" totalImagesPullingTime="3.895708374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:10:53.742120399 +0000 UTC m=+80.143624818" watchObservedRunningTime="2026-07-08 17:10:53.743146103 +0000 UTC m=+80.144650521" Jul 08 17:10:54.456869 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:54.456812 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:54.664638 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:54.664607 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:54.722838 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:54.722758 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:57.437178 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:57.437052 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:57.579139 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:57.579099 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:57.637725 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:57.637689 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:58.457176 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:58.457127 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:10:59.712857 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:10:59.712828 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7v5fb" Jul 08 17:11:00.706185 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:00.706131 2567 patch_prober.go:28] interesting pod/image-registry-5cbfbd8fbf-g7n8q container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 17:11:00.706353 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:00.706203 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" podUID="71207c79-9ccb-4904-b619-f3db80036b1e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 17:11:01.694179 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:01.694124 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:02.656675 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:02.656646 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:02.757861 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:02.757828 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:02.902574 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:02.902537 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:03.676690 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:03.676644 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:11:03.836468 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:03.836432 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:03.941338 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:03.941261 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:04.559214 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.559164 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:04.767052 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.767020 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:04.835442 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.835351 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6crv9"] Jul 08 17:11:04.839104 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.839080 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:04.841648 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.841623 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 17:11:04.841781 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.841643 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 17:11:04.841781 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.841646 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 17:11:04.842526 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.842501 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 17:11:04.842625 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.842511 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-62r67\"" Jul 08 17:11:04.849118 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.849097 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:04.929195 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.929130 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:04.974474 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.974439 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:04.974655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.974485 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-textfile\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:04.974655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.974515 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-metrics-client-ca\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:04.974655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.974572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-tls\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:04.974655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.974602 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-accelerators-collector-config\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:04.974655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.974630 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztx5t\" (UniqueName: \"kubernetes.io/projected/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-kube-api-access-ztx5t\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:04.974655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.974647 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-sys\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:04.974868 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.974697 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-root\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:04.974868 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:04.974721 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-wtmp\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.024995 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.024965 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:05.075759 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.075729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztx5t\" (UniqueName: \"kubernetes.io/projected/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-kube-api-access-ztx5t\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.075759 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.075761 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-sys\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.075998 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.075793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-root\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.075998 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.075817 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-wtmp\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.075998 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.075840 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.075998 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.075851 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-sys\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.075998 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.075872 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-root\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.075998 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.075879 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-textfile\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.075998 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.075926 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-metrics-client-ca\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.075998 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.075955 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-tls\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.075998 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.075970 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-wtmp\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.076456 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.075973 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-accelerators-collector-config\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.076456 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.076282 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-textfile\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.076670 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.076647 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-accelerators-collector-config\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.076742 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.076669 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-metrics-client-ca\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.078296 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.078277 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-tls\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.078388 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.078298 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.084816 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.084790 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztx5t\" (UniqueName: \"kubernetes.io/projected/46d24bc8-bab5-4a60-b24f-9d015bfa8f88-kube-api-access-ztx5t\") pod \"node-exporter-6crv9\" (UID: \"46d24bc8-bab5-4a60-b24f-9d015bfa8f88\") " pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.097432 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.097363 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:05.148264 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.148230 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6crv9" Jul 08 17:11:05.158541 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:11:05.158509 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d24bc8_bab5_4a60_b24f_9d015bfa8f88.slice/crio-c270544ee3d2c4ddcfe6ffa7cceaf2d01cbc5e3fbad642976c7db2b6c5b67cf4 WatchSource:0}: Error finding container c270544ee3d2c4ddcfe6ffa7cceaf2d01cbc5e3fbad642976c7db2b6c5b67cf4: Status 404 returned error can't find the container with id c270544ee3d2c4ddcfe6ffa7cceaf2d01cbc5e3fbad642976c7db2b6c5b67cf4 Jul 08 17:11:05.159011 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.158984 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:05.259556 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.259520 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:05.606304 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.606267 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:05.708688 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.708651 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:05.769364 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.769326 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6crv9" event={"ID":"46d24bc8-bab5-4a60-b24f-9d015bfa8f88","Type":"ContainerStarted","Data":"c270544ee3d2c4ddcfe6ffa7cceaf2d01cbc5e3fbad642976c7db2b6c5b67cf4"} Jul 08 17:11:05.808734 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.808703 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:05.960329 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:05.960291 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:06.053723 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:06.053684 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:06.775098 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:06.775058 2567 generic.go:356] "Generic (PLEG): container finished" podID="46d24bc8-bab5-4a60-b24f-9d015bfa8f88" containerID="e93f5a78dc8807b5e11117a4b91300bfc618aae081978bf220d176ba93be3f7f" exitCode=0 Jul 08 17:11:06.775295 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:06.775134 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6crv9" event={"ID":"46d24bc8-bab5-4a60-b24f-9d015bfa8f88","Type":"ContainerDied","Data":"e93f5a78dc8807b5e11117a4b91300bfc618aae081978bf220d176ba93be3f7f"} Jul 08 17:11:07.781398 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:07.781364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6crv9" event={"ID":"46d24bc8-bab5-4a60-b24f-9d015bfa8f88","Type":"ContainerStarted","Data":"4e48d1d9cee93c2db5c03a7fe51222b861d41c908aedbd92d221b4991df36c04"} Jul 08 17:11:07.781805 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:07.781425 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6crv9" event={"ID":"46d24bc8-bab5-4a60-b24f-9d015bfa8f88","Type":"ContainerStarted","Data":"3eca36a84fa608adcf613a5798a25455c9f46979f709ff2b925cb8b026a2fd1c"} Jul 08 17:11:07.805407 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:07.805359 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6crv9" podStartSLOduration=2.659448841 podStartE2EDuration="3.805344377s" totalImagesPullingTime="1.078535863s" totalInitContainerRuntime="67.359673ms" isStatefulPod=true podCreationTimestamp="2026-07-08 17:11:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:11:07.803239786 +0000 UTC m=+94.204744206" watchObservedRunningTime="2026-07-08 17:11:07.805344377 +0000 UTC m=+94.206848862" Jul 08 17:11:07.830061 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:07.830027 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:07.889193 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:07.889106 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:08.420918 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:08.420881 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:08.517237 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:08.517205 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:08.640420 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:08.640386 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:09.580450 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:09.580422 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:09.674017 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:09.673983 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:09.805133 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:09.805098 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:10.478621 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:10.478575 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q"] Jul 08 17:11:10.562052 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:10.562014 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:10.646943 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:10.646913 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rrn89" Jul 08 17:11:10.663263 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:10.663236 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:10.727278 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:10.727247 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:11.149671 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:11.149639 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:12.263207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:12.263148 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:12.331003 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:12.330970 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:12.503896 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:12.503819 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:12.562525 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:12.562486 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:13.238815 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:13.238758 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:13.297328 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:13.297291 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:14.065590 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:14.065558 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:14.193139 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:14.193105 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:14.860247 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:14.860216 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:15.348244 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:15.348207 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:15.701731 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:15.701704 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:15.792832 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:15.792796 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:17.377435 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:17.377399 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:17.481599 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:17.481564 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:17.577338 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:17.577311 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:17.678017 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:17.677983 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:18.825216 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:18.825185 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:18.925226 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:18.925184 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:21.329647 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:21.329609 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:21.432084 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:21.432047 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:25.854685 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:25.854648 2567 generic.go:356] "Generic (PLEG): container finished" podID="e4a2a9da-2675-486c-8bef-b051037fb231" containerID="a027ed2aa01354de2288444577f29ce232f1196595b67db3e22f4bd479a776ef" exitCode=0 Jul 08 17:11:25.855182 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:25.854711 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" event={"ID":"e4a2a9da-2675-486c-8bef-b051037fb231","Type":"ContainerDied","Data":"a027ed2aa01354de2288444577f29ce232f1196595b67db3e22f4bd479a776ef"} Jul 08 17:11:25.855272 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:25.855183 2567 scope.go:117] "RemoveContainer" containerID="a027ed2aa01354de2288444577f29ce232f1196595b67db3e22f4bd479a776ef" Jul 08 17:11:26.740972 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:26.740940 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:26.860541 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:26.860509 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-nmpch" event={"ID":"e4a2a9da-2675-486c-8bef-b051037fb231","Type":"ContainerStarted","Data":"2f99e2c75fa63d07b9532623f65a173ba799dc829ded4d7fe4c491d192fc9e37"} Jul 08 17:11:27.313879 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:27.313840 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:27.370100 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:27.370055 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:33.826668 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:33.826629 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:33.896381 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:33.896341 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:35.498829 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.498785 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" podUID="71207c79-9ccb-4904-b619-f3db80036b1e" containerName="registry" containerID="cri-o://6de020cb0f23b2b7c3e4f2f4d0ad4d9ce4d115546f16e9dec10ea39b40768041" gracePeriod=30 Jul 08 17:11:35.740950 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.740927 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:11:35.824835 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.824743 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71207c79-9ccb-4904-b619-f3db80036b1e-installation-pull-secrets\") pod \"71207c79-9ccb-4904-b619-f3db80036b1e\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " Jul 08 17:11:35.824835 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.824794 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71207c79-9ccb-4904-b619-f3db80036b1e-trusted-ca\") pod \"71207c79-9ccb-4904-b619-f3db80036b1e\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " Jul 08 17:11:35.824835 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.824820 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71207c79-9ccb-4904-b619-f3db80036b1e-image-registry-private-configuration\") pod \"71207c79-9ccb-4904-b619-f3db80036b1e\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " Jul 08 17:11:35.825111 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.824852 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71207c79-9ccb-4904-b619-f3db80036b1e-ca-trust-extracted\") pod \"71207c79-9ccb-4904-b619-f3db80036b1e\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " Jul 08 17:11:35.825111 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.824873 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-bound-sa-token\") pod \"71207c79-9ccb-4904-b619-f3db80036b1e\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " Jul 08 17:11:35.825111 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.824929 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls\") pod \"71207c79-9ccb-4904-b619-f3db80036b1e\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " Jul 08 17:11:35.825111 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.824975 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71207c79-9ccb-4904-b619-f3db80036b1e-registry-certificates\") pod \"71207c79-9ccb-4904-b619-f3db80036b1e\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " Jul 08 17:11:35.825111 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.825004 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5jrb\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-kube-api-access-h5jrb\") pod \"71207c79-9ccb-4904-b619-f3db80036b1e\" (UID: \"71207c79-9ccb-4904-b619-f3db80036b1e\") " Jul 08 17:11:35.825564 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.825413 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71207c79-9ccb-4904-b619-f3db80036b1e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "71207c79-9ccb-4904-b619-f3db80036b1e" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:11:35.825700 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.825608 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71207c79-9ccb-4904-b619-f3db80036b1e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "71207c79-9ccb-4904-b619-f3db80036b1e" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:11:35.827783 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.827740 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71207c79-9ccb-4904-b619-f3db80036b1e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "71207c79-9ccb-4904-b619-f3db80036b1e" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:11:35.827903 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.827782 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "71207c79-9ccb-4904-b619-f3db80036b1e" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:11:35.827903 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.827840 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "71207c79-9ccb-4904-b619-f3db80036b1e" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:11:35.827903 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.827876 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71207c79-9ccb-4904-b619-f3db80036b1e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "71207c79-9ccb-4904-b619-f3db80036b1e" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:11:35.828019 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.827914 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-kube-api-access-h5jrb" (OuterVolumeSpecName: "kube-api-access-h5jrb") pod "71207c79-9ccb-4904-b619-f3db80036b1e" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e"). InnerVolumeSpecName "kube-api-access-h5jrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:11:35.835619 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.835589 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71207c79-9ccb-4904-b619-f3db80036b1e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "71207c79-9ccb-4904-b619-f3db80036b1e" (UID: "71207c79-9ccb-4904-b619-f3db80036b1e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:11:35.893578 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.893542 2567 generic.go:356] "Generic (PLEG): container finished" podID="71207c79-9ccb-4904-b619-f3db80036b1e" containerID="6de020cb0f23b2b7c3e4f2f4d0ad4d9ce4d115546f16e9dec10ea39b40768041" exitCode=0 Jul 08 17:11:35.893578 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.893578 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" event={"ID":"71207c79-9ccb-4904-b619-f3db80036b1e","Type":"ContainerDied","Data":"6de020cb0f23b2b7c3e4f2f4d0ad4d9ce4d115546f16e9dec10ea39b40768041"} Jul 08 17:11:35.893789 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.893588 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" Jul 08 17:11:35.893789 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.893612 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q" event={"ID":"71207c79-9ccb-4904-b619-f3db80036b1e","Type":"ContainerDied","Data":"ed1128a8130389970059737804162152eee4463caec6c00879cf8b326cf54cdf"} Jul 08 17:11:35.893789 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.893630 2567 scope.go:117] "RemoveContainer" containerID="6de020cb0f23b2b7c3e4f2f4d0ad4d9ce4d115546f16e9dec10ea39b40768041" Jul 08 17:11:35.902364 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.902345 2567 scope.go:117] "RemoveContainer" containerID="6de020cb0f23b2b7c3e4f2f4d0ad4d9ce4d115546f16e9dec10ea39b40768041" Jul 08 17:11:35.902635 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:11:35.902611 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6de020cb0f23b2b7c3e4f2f4d0ad4d9ce4d115546f16e9dec10ea39b40768041\": container with ID starting with 6de020cb0f23b2b7c3e4f2f4d0ad4d9ce4d115546f16e9dec10ea39b40768041 not found: ID does not exist" containerID="6de020cb0f23b2b7c3e4f2f4d0ad4d9ce4d115546f16e9dec10ea39b40768041" Jul 08 17:11:35.902694 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.902645 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6de020cb0f23b2b7c3e4f2f4d0ad4d9ce4d115546f16e9dec10ea39b40768041"} err="failed to get container status \"6de020cb0f23b2b7c3e4f2f4d0ad4d9ce4d115546f16e9dec10ea39b40768041\": rpc error: code = NotFound desc = could not find container \"6de020cb0f23b2b7c3e4f2f4d0ad4d9ce4d115546f16e9dec10ea39b40768041\": container with ID starting with 6de020cb0f23b2b7c3e4f2f4d0ad4d9ce4d115546f16e9dec10ea39b40768041 not found: ID does not exist" Jul 08 17:11:35.913277 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.913252 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q"] Jul 08 17:11:35.921531 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.921508 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cbfbd8fbf-g7n8q"] Jul 08 17:11:35.926444 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.926425 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71207c79-9ccb-4904-b619-f3db80036b1e-registry-certificates\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:11:35.926501 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.926447 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5jrb\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-kube-api-access-h5jrb\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:11:35.926501 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.926457 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71207c79-9ccb-4904-b619-f3db80036b1e-installation-pull-secrets\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:11:35.926501 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.926466 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71207c79-9ccb-4904-b619-f3db80036b1e-trusted-ca\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:11:35.926501 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.926475 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71207c79-9ccb-4904-b619-f3db80036b1e-image-registry-private-configuration\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:11:35.926501 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.926485 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71207c79-9ccb-4904-b619-f3db80036b1e-ca-trust-extracted\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:11:35.926501 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.926493 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-bound-sa-token\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:11:35.926501 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:35.926501 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71207c79-9ccb-4904-b619-f3db80036b1e-registry-tls\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:11:36.258583 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:36.258553 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71207c79-9ccb-4904-b619-f3db80036b1e" path="/var/lib/kubelet/pods/71207c79-9ccb-4904-b619-f3db80036b1e/volumes" Jul 08 17:11:40.915069 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:40.915032 2567 generic.go:356] "Generic (PLEG): container finished" podID="0bbe62e9-bf21-4977-b63c-6173c46cf195" containerID="5b12a81951d5ba72e0a3f46e55536ff3ab29ce9590fa1908de3325657867acfb" exitCode=0 Jul 08 17:11:40.915453 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:40.915105 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" event={"ID":"0bbe62e9-bf21-4977-b63c-6173c46cf195","Type":"ContainerDied","Data":"5b12a81951d5ba72e0a3f46e55536ff3ab29ce9590fa1908de3325657867acfb"} Jul 08 17:11:40.915453 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:40.915424 2567 scope.go:117] "RemoveContainer" containerID="5b12a81951d5ba72e0a3f46e55536ff3ab29ce9590fa1908de3325657867acfb" Jul 08 17:11:41.919972 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:41.919940 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2kswq" event={"ID":"0bbe62e9-bf21-4977-b63c-6173c46cf195","Type":"ContainerStarted","Data":"fed6e5867a9ec2cef2fb703b5e78e99ae26b94fa850067516aa4c6caa4798513"} Jul 08 17:11:45.938009 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:45.937973 2567 generic.go:356] "Generic (PLEG): container finished" podID="1766255b-1365-4287-b81f-cf1c9c56a0da" containerID="c555a4c54cc73fb48d16217f632c252c2ef50cc48f2be734b2ea600b04f74bbb" exitCode=0 Jul 08 17:11:45.938413 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:45.938051 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" event={"ID":"1766255b-1365-4287-b81f-cf1c9c56a0da","Type":"ContainerDied","Data":"c555a4c54cc73fb48d16217f632c252c2ef50cc48f2be734b2ea600b04f74bbb"} Jul 08 17:11:45.938457 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:45.938425 2567 scope.go:117] "RemoveContainer" containerID="c555a4c54cc73fb48d16217f632c252c2ef50cc48f2be734b2ea600b04f74bbb" Jul 08 17:11:46.943446 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:46.943403 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jgxmd" event={"ID":"1766255b-1365-4287-b81f-cf1c9c56a0da","Type":"ContainerStarted","Data":"1c1943b67a57d7eb6dbbcd28a5cf299074e57e2ce87f143f5ea4f2b08d6d1a27"} Jul 08 17:11:47.676112 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:47.676078 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:11:47.729846 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:11:47.729814 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:02.102814 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:02.102777 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:20.937448 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:20.937409 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:21.037720 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:21.037686 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:28.152824 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:28.152746 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:28.253085 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:28.253052 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:28.302054 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:28.302022 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:28.871850 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:28.871816 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:32.947833 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:32.947767 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:33.048415 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:33.048383 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:39.067359 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:39.067327 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:39.120227 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:39.120195 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:39.179370 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:39.179334 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:48.838498 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:48.838457 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:48.978894 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:48.978859 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:12:56.811211 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:12:56.811175 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:13:05.943470 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:13:05.943435 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:13:28.945408 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:13:28.945374 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:13:44.552975 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:13:44.552934 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:13:44.653075 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:13:44.653039 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:11.232906 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:11.232825 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:12.178966 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:12.178937 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:15.077950 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:15.077883 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:15.180974 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:15.180936 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:16.476315 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:16.476284 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:16.598211 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:16.598178 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:16.709755 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:16.709724 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:18.860349 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:18.860318 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:19.117135 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:19.117052 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:21.838382 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:21.838348 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:21.967763 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:21.967732 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:25.457074 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:25.457043 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:25.526788 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:25.526759 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:26.179727 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:26.179694 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:29.371497 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:29.371443 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:29.511125 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:29.511087 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:34.006944 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:34.006915 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:14:34.016510 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:34.016480 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:14:34.017785 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:34.017668 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:14:34.023499 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:34.023475 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:14:34.024313 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:34.024295 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 17:14:34.056628 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:34.056490 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:34.233046 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:34.233010 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:36.357511 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:36.357473 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:51.089904 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:51.089864 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:52.050342 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.050307 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms"] Jul 08 17:14:52.050595 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.050582 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71207c79-9ccb-4904-b619-f3db80036b1e" containerName="registry" Jul 08 17:14:52.050638 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.050596 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="71207c79-9ccb-4904-b619-f3db80036b1e" containerName="registry" Jul 08 17:14:52.050679 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.050650 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="71207c79-9ccb-4904-b619-f3db80036b1e" containerName="registry" Jul 08 17:14:52.053489 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.053472 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.056838 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.056811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9124842-9568-4021-a70a-e02792d17ab9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.056971 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.056850 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9124842-9568-4021-a70a-e02792d17ab9-tmp\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.056971 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.056877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f9124842-9568-4021-a70a-e02792d17ab9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.056971 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.056960 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f9124842-9568-4021-a70a-e02792d17ab9-manifests\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.057139 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.056984 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlkxt\" (UniqueName: \"kubernetes.io/projected/f9124842-9568-4021-a70a-e02792d17ab9-kube-api-access-hlkxt\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.057139 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.057010 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fc7gb\"" Jul 08 17:14:52.057280 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.057203 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 17:14:52.057333 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.057296 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 17:14:52.057386 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.057350 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 17:14:52.057475 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.057460 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 17:14:52.075963 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.075935 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms"] Jul 08 17:14:52.157571 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.157535 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f9124842-9568-4021-a70a-e02792d17ab9-manifests\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.157571 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.157570 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlkxt\" (UniqueName: \"kubernetes.io/projected/f9124842-9568-4021-a70a-e02792d17ab9-kube-api-access-hlkxt\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.158084 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.157612 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9124842-9568-4021-a70a-e02792d17ab9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.158084 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.157629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9124842-9568-4021-a70a-e02792d17ab9-tmp\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.158084 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.157649 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f9124842-9568-4021-a70a-e02792d17ab9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.158084 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.157925 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f9124842-9568-4021-a70a-e02792d17ab9-manifests\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.160093 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.160061 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9124842-9568-4021-a70a-e02792d17ab9-tmp\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.160216 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.160109 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9124842-9568-4021-a70a-e02792d17ab9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.160261 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.160224 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f9124842-9568-4021-a70a-e02792d17ab9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.168757 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.168725 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlkxt\" (UniqueName: \"kubernetes.io/projected/f9124842-9568-4021-a70a-e02792d17ab9-kube-api-access-hlkxt\") pod \"opendatahub-operator-controller-manager-6778fbd4c5-sslms\" (UID: \"f9124842-9568-4021-a70a-e02792d17ab9\") " pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.363901 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.363808 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:52.511712 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.511672 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms"] Jul 08 17:14:52.515090 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:14:52.515056 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9124842_9568_4021_a70a_e02792d17ab9.slice/crio-7324f619cad928dfb03330a40b04cbaabc37596807297f25b1d6ee7fdb8acbab WatchSource:0}: Error finding container 7324f619cad928dfb03330a40b04cbaabc37596807297f25b1d6ee7fdb8acbab: Status 404 returned error can't find the container with id 7324f619cad928dfb03330a40b04cbaabc37596807297f25b1d6ee7fdb8acbab Jul 08 17:14:52.516895 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.516876 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:14:52.610421 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.610386 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" event={"ID":"f9124842-9568-4021-a70a-e02792d17ab9","Type":"ContainerStarted","Data":"7324f619cad928dfb03330a40b04cbaabc37596807297f25b1d6ee7fdb8acbab"} Jul 08 17:14:52.635610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.631648 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:52.736991 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:52.736957 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:14:56.628985 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:56.628938 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" event={"ID":"f9124842-9568-4021-a70a-e02792d17ab9","Type":"ContainerStarted","Data":"9abf019f30aa349a2a8d1ce6063bc20ac15a8bad19bf5b8efddd78551b83622c"} Jul 08 17:14:57.634330 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:57.634299 2567 generic.go:356] "Generic (PLEG): container finished" podID="f9124842-9568-4021-a70a-e02792d17ab9" containerID="9abf019f30aa349a2a8d1ce6063bc20ac15a8bad19bf5b8efddd78551b83622c" exitCode=0 Jul 08 17:14:57.634703 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:57.634384 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" event={"ID":"f9124842-9568-4021-a70a-e02792d17ab9","Type":"ContainerDied","Data":"9abf019f30aa349a2a8d1ce6063bc20ac15a8bad19bf5b8efddd78551b83622c"} Jul 08 17:14:58.639428 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:58.639384 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" event={"ID":"f9124842-9568-4021-a70a-e02792d17ab9","Type":"ContainerStarted","Data":"f5c55ad0afd4e65345c3e925df32dbd3c813484648bd9d0a7dcee322e9bc035e"} Jul 08 17:14:58.639802 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:58.639479 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:14:58.661822 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:14:58.661769 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" podStartSLOduration=1.7168378770000001 podStartE2EDuration="6.661754789s" totalImagesPullingTime="3.850778252s" totalInitContainerRuntime="1.09413866s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:14:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:14:58.660521623 +0000 UTC m=+325.062026043" watchObservedRunningTime="2026-07-08 17:14:58.661754789 +0000 UTC m=+325.063259208" Jul 08 17:15:00.576149 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:00.576114 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:00.676935 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:00.676900 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:09.646008 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:09.645973 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6778fbd4c5-sslms" Jul 08 17:15:11.220171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:11.220122 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:11.350786 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:11.350746 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:11.513957 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:11.513869 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:11.685800 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:11.685762 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:11.950690 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:11.950656 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:12.243450 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.243417 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5"] Jul 08 17:15:12.252584 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.252561 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" Jul 08 17:15:12.257457 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.257431 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 17:15:12.257584 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.257546 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 17:15:12.259043 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.259025 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x6482\"" Jul 08 17:15:12.267981 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.267956 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:12.277050 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.277026 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5"] Jul 08 17:15:12.303971 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.303937 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgcfv\" (UniqueName: \"kubernetes.io/projected/c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff-kube-api-access-mgcfv\") pod \"kube-auth-proxy-55b4df66b5-tj9x5\" (UID: \"c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff\") " pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" Jul 08 17:15:12.303971 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.303973 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff-tls-certs\") pod \"kube-auth-proxy-55b4df66b5-tj9x5\" (UID: \"c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff\") " pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" Jul 08 17:15:12.304192 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.304063 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff-tmp\") pod \"kube-auth-proxy-55b4df66b5-tj9x5\" (UID: \"c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff\") " pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" Jul 08 17:15:12.404443 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.404398 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgcfv\" (UniqueName: \"kubernetes.io/projected/c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff-kube-api-access-mgcfv\") pod \"kube-auth-proxy-55b4df66b5-tj9x5\" (UID: \"c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff\") " pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" Jul 08 17:15:12.404650 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.404452 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff-tls-certs\") pod \"kube-auth-proxy-55b4df66b5-tj9x5\" (UID: \"c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff\") " pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" Jul 08 17:15:12.404650 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.404543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff-tmp\") pod \"kube-auth-proxy-55b4df66b5-tj9x5\" (UID: \"c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff\") " pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" Jul 08 17:15:12.406801 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.406776 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff-tmp\") pod \"kube-auth-proxy-55b4df66b5-tj9x5\" (UID: \"c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff\") " pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" Jul 08 17:15:12.407012 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.406994 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff-tls-certs\") pod \"kube-auth-proxy-55b4df66b5-tj9x5\" (UID: \"c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff\") " pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" Jul 08 17:15:12.422987 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.422966 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgcfv\" (UniqueName: \"kubernetes.io/projected/c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff-kube-api-access-mgcfv\") pod \"kube-auth-proxy-55b4df66b5-tj9x5\" (UID: \"c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff\") " pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" Jul 08 17:15:12.557792 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.557708 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jltzl"] Jul 08 17:15:12.559936 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.559919 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" Jul 08 17:15:12.562163 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.562125 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" Jul 08 17:15:12.564689 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.564671 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rbmcr\"" Jul 08 17:15:12.564984 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.564963 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 08 17:15:12.582249 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.582218 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jltzl"] Jul 08 17:15:12.606717 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.606682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71eb22b0-86a6-41ee-bd62-e0b32bca36a8-cert\") pod \"odh-model-controller-7998c67dc4-jltzl\" (UID: \"71eb22b0-86a6-41ee-bd62-e0b32bca36a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" Jul 08 17:15:12.606871 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.606761 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djq8q\" (UniqueName: \"kubernetes.io/projected/71eb22b0-86a6-41ee-bd62-e0b32bca36a8-kube-api-access-djq8q\") pod \"odh-model-controller-7998c67dc4-jltzl\" (UID: \"71eb22b0-86a6-41ee-bd62-e0b32bca36a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" Jul 08 17:15:12.628864 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.628828 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:12.707601 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.707569 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71eb22b0-86a6-41ee-bd62-e0b32bca36a8-cert\") pod \"odh-model-controller-7998c67dc4-jltzl\" (UID: \"71eb22b0-86a6-41ee-bd62-e0b32bca36a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" Jul 08 17:15:12.707769 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.707635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djq8q\" (UniqueName: \"kubernetes.io/projected/71eb22b0-86a6-41ee-bd62-e0b32bca36a8-kube-api-access-djq8q\") pod \"odh-model-controller-7998c67dc4-jltzl\" (UID: \"71eb22b0-86a6-41ee-bd62-e0b32bca36a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" Jul 08 17:15:12.707769 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:15:12.707721 2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 08 17:15:12.707858 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:15:12.707784 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71eb22b0-86a6-41ee-bd62-e0b32bca36a8-cert podName:71eb22b0-86a6-41ee-bd62-e0b32bca36a8 nodeName:}" failed. No retries permitted until 2026-07-08 17:15:13.20776768 +0000 UTC m=+339.609272076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/71eb22b0-86a6-41ee-bd62-e0b32bca36a8-cert") pod "odh-model-controller-7998c67dc4-jltzl" (UID: "71eb22b0-86a6-41ee-bd62-e0b32bca36a8") : secret "odh-model-controller-webhook-cert" not found Jul 08 17:15:12.712231 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.712207 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5"] Jul 08 17:15:12.714869 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:15:12.714840 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d0bf1a_3a52_487e_8d6f_56b0e87af1ff.slice/crio-350bc2230386bd422f75ddac9a55796c560d18b69ef26cf827c167de421fcf9d WatchSource:0}: Error finding container 350bc2230386bd422f75ddac9a55796c560d18b69ef26cf827c167de421fcf9d: Status 404 returned error can't find the container with id 350bc2230386bd422f75ddac9a55796c560d18b69ef26cf827c167de421fcf9d Jul 08 17:15:12.720024 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.720004 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djq8q\" (UniqueName: \"kubernetes.io/projected/71eb22b0-86a6-41ee-bd62-e0b32bca36a8-kube-api-access-djq8q\") pod \"odh-model-controller-7998c67dc4-jltzl\" (UID: \"71eb22b0-86a6-41ee-bd62-e0b32bca36a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" Jul 08 17:15:12.739539 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.739515 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:12.902379 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.902342 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:12.999545 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:12.999509 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:13.212755 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.212666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71eb22b0-86a6-41ee-bd62-e0b32bca36a8-cert\") pod \"odh-model-controller-7998c67dc4-jltzl\" (UID: \"71eb22b0-86a6-41ee-bd62-e0b32bca36a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" Jul 08 17:15:13.215059 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.215033 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71eb22b0-86a6-41ee-bd62-e0b32bca36a8-cert\") pod \"odh-model-controller-7998c67dc4-jltzl\" (UID: \"71eb22b0-86a6-41ee-bd62-e0b32bca36a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" Jul 08 17:15:13.471442 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.471360 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" Jul 08 17:15:13.588709 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.588677 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:13.620359 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.620335 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jltzl"] Jul 08 17:15:13.622573 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:15:13.622542 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71eb22b0_86a6_41ee_bd62_e0b32bca36a8.slice/crio-7b28d96f3251dbeaa9cd862deb7819e12eac99e296eae4876f44bc24830f0f77 WatchSource:0}: Error finding container 7b28d96f3251dbeaa9cd862deb7819e12eac99e296eae4876f44bc24830f0f77: Status 404 returned error can't find the container with id 7b28d96f3251dbeaa9cd862deb7819e12eac99e296eae4876f44bc24830f0f77 Jul 08 17:15:13.637689 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.637654 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gp22x"] Jul 08 17:15:13.641307 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.641285 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gp22x" Jul 08 17:15:13.643890 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.643867 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-h2b9l\"" Jul 08 17:15:13.643890 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.643879 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 08 17:15:13.652127 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.652102 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gp22x"] Jul 08 17:15:13.694519 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.694484 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" event={"ID":"71eb22b0-86a6-41ee-bd62-e0b32bca36a8","Type":"ContainerStarted","Data":"7b28d96f3251dbeaa9cd862deb7819e12eac99e296eae4876f44bc24830f0f77"} Jul 08 17:15:13.695494 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.695470 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" event={"ID":"c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff","Type":"ContainerStarted","Data":"350bc2230386bd422f75ddac9a55796c560d18b69ef26cf827c167de421fcf9d"} Jul 08 17:15:13.717135 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.717106 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prvmz\" (UniqueName: \"kubernetes.io/projected/78f3520d-fa34-40ce-84b2-cab8628e0490-kube-api-access-prvmz\") pod \"model-serving-api-54d89bd5fc-gp22x\" (UID: \"78f3520d-fa34-40ce-84b2-cab8628e0490\") " pod="opendatahub/model-serving-api-54d89bd5fc-gp22x" Jul 08 17:15:13.717258 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.717141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78f3520d-fa34-40ce-84b2-cab8628e0490-tls-certs\") pod \"model-serving-api-54d89bd5fc-gp22x\" (UID: \"78f3520d-fa34-40ce-84b2-cab8628e0490\") " pod="opendatahub/model-serving-api-54d89bd5fc-gp22x" Jul 08 17:15:13.818454 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.818370 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78f3520d-fa34-40ce-84b2-cab8628e0490-tls-certs\") pod \"model-serving-api-54d89bd5fc-gp22x\" (UID: \"78f3520d-fa34-40ce-84b2-cab8628e0490\") " pod="opendatahub/model-serving-api-54d89bd5fc-gp22x" Jul 08 17:15:13.818590 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.818478 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvmz\" (UniqueName: \"kubernetes.io/projected/78f3520d-fa34-40ce-84b2-cab8628e0490-kube-api-access-prvmz\") pod \"model-serving-api-54d89bd5fc-gp22x\" (UID: \"78f3520d-fa34-40ce-84b2-cab8628e0490\") " pod="opendatahub/model-serving-api-54d89bd5fc-gp22x" Jul 08 17:15:13.820737 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.820708 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78f3520d-fa34-40ce-84b2-cab8628e0490-tls-certs\") pod \"model-serving-api-54d89bd5fc-gp22x\" (UID: \"78f3520d-fa34-40ce-84b2-cab8628e0490\") " pod="opendatahub/model-serving-api-54d89bd5fc-gp22x" Jul 08 17:15:13.829281 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.829255 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prvmz\" (UniqueName: \"kubernetes.io/projected/78f3520d-fa34-40ce-84b2-cab8628e0490-kube-api-access-prvmz\") pod \"model-serving-api-54d89bd5fc-gp22x\" (UID: \"78f3520d-fa34-40ce-84b2-cab8628e0490\") " pod="opendatahub/model-serving-api-54d89bd5fc-gp22x" Jul 08 17:15:13.853041 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.853001 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:13.952667 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.952616 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gp22x" Jul 08 17:15:13.986855 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:13.986825 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:14.096974 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:14.096946 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gp22x"] Jul 08 17:15:14.099627 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:15:14.099596 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f3520d_fa34_40ce_84b2_cab8628e0490.slice/crio-518d46d79ff149f8ec6f368ab2abee528d7da4053794245f236e7e79b2074e90 WatchSource:0}: Error finding container 518d46d79ff149f8ec6f368ab2abee528d7da4053794245f236e7e79b2074e90: Status 404 returned error can't find the container with id 518d46d79ff149f8ec6f368ab2abee528d7da4053794245f236e7e79b2074e90 Jul 08 17:15:14.701059 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:14.700961 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gp22x" event={"ID":"78f3520d-fa34-40ce-84b2-cab8628e0490","Type":"ContainerStarted","Data":"518d46d79ff149f8ec6f368ab2abee528d7da4053794245f236e7e79b2074e90"} Jul 08 17:15:15.046541 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:15.046452 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:18.207892 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.207853 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:18.293872 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.293840 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:18.410526 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.410489 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk"] Jul 08 17:15:18.414016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.413994 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.416339 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.416290 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qpbfp\"" Jul 08 17:15:18.416450 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.416412 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 17:15:18.424446 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.424418 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk"] Jul 08 17:15:18.450894 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.450864 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:18.461035 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.460972 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq6ns\" (UniqueName: \"kubernetes.io/projected/be11f07d-edab-46b2-9d20-0d5b2cf55835-kube-api-access-sq6ns\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.461035 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.461011 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.461192 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.461051 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.461192 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.461069 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.461192 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.461084 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be11f07d-edab-46b2-9d20-0d5b2cf55835-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.461192 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.461100 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.461327 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.461190 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be11f07d-edab-46b2-9d20-0d5b2cf55835-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.461327 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.461224 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.461327 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.461243 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be11f07d-edab-46b2-9d20-0d5b2cf55835-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.562568 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.562532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.562568 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.562576 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be11f07d-edab-46b2-9d20-0d5b2cf55835-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.562819 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.562629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq6ns\" (UniqueName: \"kubernetes.io/projected/be11f07d-edab-46b2-9d20-0d5b2cf55835-kube-api-access-sq6ns\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.562819 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.562662 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.562819 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.562728 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.562819 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.562754 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.562819 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.562780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be11f07d-edab-46b2-9d20-0d5b2cf55835-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.563052 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.563005 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.563133 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.563108 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.563233 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.563206 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.563289 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.563277 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.563346 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.563327 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be11f07d-edab-46b2-9d20-0d5b2cf55835-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.563660 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.563620 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.563815 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.563786 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:18.563999 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.563979 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be11f07d-edab-46b2-9d20-0d5b2cf55835-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.566018 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.565994 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be11f07d-edab-46b2-9d20-0d5b2cf55835-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.566241 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.566220 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be11f07d-edab-46b2-9d20-0d5b2cf55835-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.574338 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.574313 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq6ns\" (UniqueName: \"kubernetes.io/projected/be11f07d-edab-46b2-9d20-0d5b2cf55835-kube-api-access-sq6ns\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.577726 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.577697 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be11f07d-edab-46b2-9d20-0d5b2cf55835-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4486hk\" (UID: \"be11f07d-edab-46b2-9d20-0d5b2cf55835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.723778 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.723676 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:18.723778 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.723692 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" event={"ID":"c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff","Type":"ContainerStarted","Data":"1bb29c65d2c218c459af3d4a75a8f8cb7b9e1f0a6ed661fc2114bb58b37c4c7a"} Jul 08 17:15:18.725390 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.725362 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gp22x" event={"ID":"78f3520d-fa34-40ce-84b2-cab8628e0490","Type":"ContainerStarted","Data":"90f26d4ce3370213b4220e55640b4bfa87a8a6a51aa1850dead0894e7e3c4e41"} Jul 08 17:15:18.725497 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.725474 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gp22x" Jul 08 17:15:18.726754 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.726735 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" event={"ID":"71eb22b0-86a6-41ee-bd62-e0b32bca36a8","Type":"ContainerStarted","Data":"f0a41e6ac3020acb0bd9950c3070db5298bd07f4a4edd6306935530265ec8140"} Jul 08 17:15:18.726862 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.726850 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" Jul 08 17:15:18.745238 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.745197 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55b4df66b5-tj9x5" podStartSLOduration=1.590561039 podStartE2EDuration="6.745181078s" totalImagesPullingTime="5.154620039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:15:18.744299132 +0000 UTC m=+345.145803564" watchObservedRunningTime="2026-07-08 17:15:18.745181078 +0000 UTC m=+345.146685491" Jul 08 17:15:18.749806 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.749785 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:18.762854 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.762793 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gp22x" podStartSLOduration=1.998014633 podStartE2EDuration="5.762772144s" totalImagesPullingTime="3.764757511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:15:18.760584386 +0000 UTC m=+345.162088807" watchObservedRunningTime="2026-07-08 17:15:18.762772144 +0000 UTC m=+345.164276563" Jul 08 17:15:18.782327 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.782281 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" podStartSLOduration=2.529017735 podStartE2EDuration="6.782263676s" totalImagesPullingTime="4.253245941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:15:18.780305943 +0000 UTC m=+345.181810363" watchObservedRunningTime="2026-07-08 17:15:18.782263676 +0000 UTC m=+345.183768097" Jul 08 17:15:18.864980 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:18.864915 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk"] Jul 08 17:15:18.867441 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:15:18.867414 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe11f07d_edab_46b2_9d20_0d5b2cf55835.slice/crio-196033add1eb94244b80534e99cef5cf0e051fda83f5a62dfd853e4f088654ac WatchSource:0}: Error finding container 196033add1eb94244b80534e99cef5cf0e051fda83f5a62dfd853e4f088654ac: Status 404 returned error can't find the container with id 196033add1eb94244b80534e99cef5cf0e051fda83f5a62dfd853e4f088654ac Jul 08 17:15:19.732983 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:19.732941 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" event={"ID":"be11f07d-edab-46b2-9d20-0d5b2cf55835","Type":"ContainerStarted","Data":"196033add1eb94244b80534e99cef5cf0e051fda83f5a62dfd853e4f088654ac"} Jul 08 17:15:20.838247 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.838215 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh"] Jul 08 17:15:20.841468 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.841450 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.844028 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.844003 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 17:15:20.844139 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.844032 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 17:15:20.844139 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.844083 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b6r85\"" Jul 08 17:15:20.844139 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.844112 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 17:15:20.853769 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.853748 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh"] Jul 08 17:15:20.883000 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.882938 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7b9942d-7532-49dc-9b12-37df398b3fef-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.883000 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.882983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7b9942d-7532-49dc-9b12-37df398b3fef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.883382 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.883037 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nczm7\" (UniqueName: \"kubernetes.io/projected/f7b9942d-7532-49dc-9b12-37df398b3fef-kube-api-access-nczm7\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.883382 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.883099 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7b9942d-7532-49dc-9b12-37df398b3fef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.883382 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.883193 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7b9942d-7532-49dc-9b12-37df398b3fef-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.883382 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.883233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7b9942d-7532-49dc-9b12-37df398b3fef-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.883382 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.883324 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7b9942d-7532-49dc-9b12-37df398b3fef-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.984070 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.984036 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7b9942d-7532-49dc-9b12-37df398b3fef-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.984070 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.984070 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7b9942d-7532-49dc-9b12-37df398b3fef-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.984274 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.984104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7b9942d-7532-49dc-9b12-37df398b3fef-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.984274 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.984182 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7b9942d-7532-49dc-9b12-37df398b3fef-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.984444 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.984422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7b9942d-7532-49dc-9b12-37df398b3fef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.984497 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.984461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nczm7\" (UniqueName: \"kubernetes.io/projected/f7b9942d-7532-49dc-9b12-37df398b3fef-kube-api-access-nczm7\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.984549 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.984507 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7b9942d-7532-49dc-9b12-37df398b3fef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.985299 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.985271 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7b9942d-7532-49dc-9b12-37df398b3fef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.986408 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.986385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7b9942d-7532-49dc-9b12-37df398b3fef-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.986626 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.986604 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7b9942d-7532-49dc-9b12-37df398b3fef-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.986749 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.986726 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7b9942d-7532-49dc-9b12-37df398b3fef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.986802 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.986756 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7b9942d-7532-49dc-9b12-37df398b3fef-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.998638 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.998593 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7b9942d-7532-49dc-9b12-37df398b3fef-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:20.999210 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:20.999111 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nczm7\" (UniqueName: \"kubernetes.io/projected/f7b9942d-7532-49dc-9b12-37df398b3fef-kube-api-access-nczm7\") pod \"istiod-openshift-gateway-94bb8fbfd-7wrrh\" (UID: \"f7b9942d-7532-49dc-9b12-37df398b3fef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:21.151483 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:21.151445 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:21.330194 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:21.330144 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh"] Jul 08 17:15:21.334364 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:15:21.334327 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b9942d_7532_49dc_9b12_37df398b3fef.slice/crio-35ed1a80bb045dcaae48fbc407746dcaab09c8114ae100e122e804b650ddb7de WatchSource:0}: Error finding container 35ed1a80bb045dcaae48fbc407746dcaab09c8114ae100e122e804b650ddb7de: Status 404 returned error can't find the container with id 35ed1a80bb045dcaae48fbc407746dcaab09c8114ae100e122e804b650ddb7de Jul 08 17:15:21.742570 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:21.742532 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" event={"ID":"f7b9942d-7532-49dc-9b12-37df398b3fef","Type":"ContainerStarted","Data":"35ed1a80bb045dcaae48fbc407746dcaab09c8114ae100e122e804b650ddb7de"} Jul 08 17:15:23.899898 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:23.899850 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:23.998121 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:23.998071 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:24.083048 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:24.083012 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:24.218355 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:24.218268 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:24.573401 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:24.573332 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:25.274391 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:25.274301 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:25.426387 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:25.426340 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:25.464917 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:25.464878 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:15:25.465015 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:25.464978 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:15:25.465132 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:25.465021 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:15:25.466650 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:25.466623 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:15:25.466746 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:25.466687 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:15:25.525892 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:25.525836 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:25.763142 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:25.763103 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" event={"ID":"f7b9942d-7532-49dc-9b12-37df398b3fef","Type":"ContainerStarted","Data":"7a3fa436dcfca03e1bbf4e5fa3872bd61da933ea36dfa01f73bf33d0eb7aba9c"} Jul 08 17:15:25.763345 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:25.763189 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:25.765100 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:25.765068 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" event={"ID":"be11f07d-edab-46b2-9d20-0d5b2cf55835","Type":"ContainerStarted","Data":"ccadf954c1f468d57b443b5c2a43af8385f0f3cc856e9d5f2ea3ab6ebb82eda8"} Jul 08 17:15:25.809610 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:25.809487 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" podStartSLOduration=1.679705738 podStartE2EDuration="5.809465743s" totalImagesPullingTime="4.129760005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:15:25.808060104 +0000 UTC m=+352.209564517" watchObservedRunningTime="2026-07-08 17:15:25.809465743 +0000 UTC m=+352.210970163" Jul 08 17:15:25.843003 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:25.842945 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" podStartSLOduration=1.25291023 podStartE2EDuration="7.84292522s" totalImagesPullingTime="6.59001499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:15:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:15:25.841338237 +0000 UTC m=+352.242842656" watchObservedRunningTime="2026-07-08 17:15:25.84292522 +0000 UTC m=+352.244429641" Jul 08 17:15:26.620602 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:26.620570 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:26.722164 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:26.722104 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:26.724124 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:26.724108 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:26.728418 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:26.728393 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:26.769526 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:26.769493 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:26.770770 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:26.770712 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4486hk" Jul 08 17:15:26.771331 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:26.771307 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7wrrh" Jul 08 17:15:29.735133 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:29.735085 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jltzl" Jul 08 17:15:29.743646 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:29.743619 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gp22x" Jul 08 17:15:36.632127 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:36.632086 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:15:36.700887 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:15:36.700837 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:09.543671 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:09.543630 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:09.630728 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:09.630692 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:11.719716 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:11.719683 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:11.824378 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:11.824343 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:13.166785 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:13.166752 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:13.265249 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:13.265217 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:13.388108 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:13.388076 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:25.548025 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:25.547985 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:25.647221 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:25.647191 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:25.747357 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:25.747318 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:26.281361 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:26.281324 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:26.380758 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:26.380722 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:36.426893 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:36.426848 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:36.583294 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:36.583260 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:40.811317 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:40.811278 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:44.482246 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:44.482213 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:49.297801 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.297766 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv"] Jul 08 17:16:49.300373 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.300356 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:16:49.307399 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.307374 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 17:16:49.307512 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.307422 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 17:16:49.307512 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.307469 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gnzz5\"" Jul 08 17:16:49.343968 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.343929 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64c1d659-a7aa-4857-994f-a5c7c82f9045-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7tvnv\" (UID: \"64c1d659-a7aa-4857-994f-a5c7c82f9045\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:16:49.344106 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.344034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr6qs\" (UniqueName: \"kubernetes.io/projected/64c1d659-a7aa-4857-994f-a5c7c82f9045-kube-api-access-sr6qs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7tvnv\" (UID: \"64c1d659-a7aa-4857-994f-a5c7c82f9045\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:16:49.344357 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.344323 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv"] Jul 08 17:16:49.444628 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.444592 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr6qs\" (UniqueName: \"kubernetes.io/projected/64c1d659-a7aa-4857-994f-a5c7c82f9045-kube-api-access-sr6qs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7tvnv\" (UID: \"64c1d659-a7aa-4857-994f-a5c7c82f9045\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:16:49.444805 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.444695 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64c1d659-a7aa-4857-994f-a5c7c82f9045-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7tvnv\" (UID: \"64c1d659-a7aa-4857-994f-a5c7c82f9045\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:16:49.445057 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.445040 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64c1d659-a7aa-4857-994f-a5c7c82f9045-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7tvnv\" (UID: \"64c1d659-a7aa-4857-994f-a5c7c82f9045\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:16:49.463857 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.463828 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr6qs\" (UniqueName: \"kubernetes.io/projected/64c1d659-a7aa-4857-994f-a5c7c82f9045-kube-api-access-sr6qs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7tvnv\" (UID: \"64c1d659-a7aa-4857-994f-a5c7c82f9045\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:16:49.555260 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.555183 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:49.610101 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.610069 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:16:49.776405 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.776371 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv"] Jul 08 17:16:49.780548 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:16:49.780520 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c1d659_a7aa_4857_994f_a5c7c82f9045.slice/crio-e6302d2a18284c54bbddd3441c15e8cecb678d77f222bac33d559fd459faaabc WatchSource:0}: Error finding container e6302d2a18284c54bbddd3441c15e8cecb678d77f222bac33d559fd459faaabc: Status 404 returned error can't find the container with id e6302d2a18284c54bbddd3441c15e8cecb678d77f222bac33d559fd459faaabc Jul 08 17:16:49.877808 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:49.877720 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:50.113780 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:50.113747 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" event={"ID":"64c1d659-a7aa-4857-994f-a5c7c82f9045","Type":"ContainerStarted","Data":"e6302d2a18284c54bbddd3441c15e8cecb678d77f222bac33d559fd459faaabc"} Jul 08 17:16:50.115861 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:50.115836 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:51.307129 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:51.307092 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:54.167583 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:54.167552 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:54.426463 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:54.426382 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:55.886311 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:55.886281 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:56.896265 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:56.896223 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-25kg9"] Jul 08 17:16:56.899846 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:56.899819 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-25kg9" Jul 08 17:16:56.904036 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:56.904008 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 08 17:16:56.904192 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:56.904016 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-t6vj5\"" Jul 08 17:16:56.939936 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:56.939903 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-25kg9"] Jul 08 17:16:57.007646 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:57.007601 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zv82\" (UniqueName: \"kubernetes.io/projected/62db82c1-9a13-4345-9a47-9f22c0c21e75-kube-api-access-7zv82\") pod \"dns-operator-controller-manager-864dd78c4c-25kg9\" (UID: \"62db82c1-9a13-4345-9a47-9f22c0c21e75\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-25kg9" Jul 08 17:16:57.108249 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:57.108211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zv82\" (UniqueName: \"kubernetes.io/projected/62db82c1-9a13-4345-9a47-9f22c0c21e75-kube-api-access-7zv82\") pod \"dns-operator-controller-manager-864dd78c4c-25kg9\" (UID: \"62db82c1-9a13-4345-9a47-9f22c0c21e75\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-25kg9" Jul 08 17:16:57.140042 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:57.140006 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zv82\" (UniqueName: \"kubernetes.io/projected/62db82c1-9a13-4345-9a47-9f22c0c21e75-kube-api-access-7zv82\") pod \"dns-operator-controller-manager-864dd78c4c-25kg9\" (UID: \"62db82c1-9a13-4345-9a47-9f22c0c21e75\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-25kg9" Jul 08 17:16:57.212567 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:57.212494 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-25kg9" Jul 08 17:16:57.490820 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:57.490741 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-25kg9"] Jul 08 17:16:57.493067 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:16:57.493034 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62db82c1_9a13_4345_9a47_9f22c0c21e75.slice/crio-c6ce791709d8e99b194ac20de35fe2160685ca9deb9096e3fcc192f8017c8108 WatchSource:0}: Error finding container c6ce791709d8e99b194ac20de35fe2160685ca9deb9096e3fcc192f8017c8108: Status 404 returned error can't find the container with id c6ce791709d8e99b194ac20de35fe2160685ca9deb9096e3fcc192f8017c8108 Jul 08 17:16:57.993709 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:57.993675 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:58.148869 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:58.148828 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:16:58.151841 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:58.151764 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" event={"ID":"64c1d659-a7aa-4857-994f-a5c7c82f9045","Type":"ContainerStarted","Data":"ca056f75f6b590590be4c79a9201ce0b1bd7b6d5394efe629bac9a51ac8bfd47"} Jul 08 17:16:58.151989 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:58.151906 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:16:58.153143 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:58.153118 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-25kg9" event={"ID":"62db82c1-9a13-4345-9a47-9f22c0c21e75","Type":"ContainerStarted","Data":"c6ce791709d8e99b194ac20de35fe2160685ca9deb9096e3fcc192f8017c8108"} Jul 08 17:16:58.193576 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:16:58.193525 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" podStartSLOduration=1.594628464 podStartE2EDuration="9.19350758s" totalImagesPullingTime="7.598879116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:58.193228252 +0000 UTC m=+444.594732663" watchObservedRunningTime="2026-07-08 17:16:58.19350758 +0000 UTC m=+444.595011998" Jul 08 17:17:00.682748 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:00.682707 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:01.167770 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:01.167732 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-25kg9" event={"ID":"62db82c1-9a13-4345-9a47-9f22c0c21e75","Type":"ContainerStarted","Data":"200144bd98f76e827e5e83faef88f7626a8309b3081f75a6068934e36e1a6529"} Jul 08 17:17:01.167960 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:01.167886 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-25kg9" Jul 08 17:17:01.191385 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:01.191328 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-25kg9" podStartSLOduration=2.501048226 podStartE2EDuration="5.191311778s" totalImagesPullingTime="2.690263552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:17:01.190270529 +0000 UTC m=+447.591774947" watchObservedRunningTime="2026-07-08 17:17:01.191311778 +0000 UTC m=+447.592816250" Jul 08 17:17:01.298413 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:01.298380 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:01.431507 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:01.431413 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:01.529974 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:01.529936 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:09.160796 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:09.160760 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:17:09.516563 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:09.516466 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:09.724914 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:09.724880 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:09.915350 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:09.915304 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:11.147130 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.147088 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv"] Jul 08 17:17:11.147616 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.147342 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" podUID="64c1d659-a7aa-4857-994f-a5c7c82f9045" containerName="manager" containerID="cri-o://ca056f75f6b590590be4c79a9201ce0b1bd7b6d5394efe629bac9a51ac8bfd47" gracePeriod=2 Jul 08 17:17:11.155275 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.155213 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv"] Jul 08 17:17:11.223604 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.223573 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps"] Jul 08 17:17:11.224022 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.224004 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64c1d659-a7aa-4857-994f-a5c7c82f9045" containerName="manager" Jul 08 17:17:11.224091 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.224025 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="64c1d659-a7aa-4857-994f-a5c7c82f9045" containerName="manager" Jul 08 17:17:11.224091 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.224086 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="64c1d659-a7aa-4857-994f-a5c7c82f9045" containerName="manager" Jul 08 17:17:11.227002 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.226979 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" Jul 08 17:17:11.237031 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:17:11.236997 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7tvnv\" is forbidden: User \"system:node:ip-10-0-138-180.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-180.ec2.internal' and this object" podUID="64c1d659-a7aa-4857-994f-a5c7c82f9045" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:17:11.258607 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.258579 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps"] Jul 08 17:17:11.330033 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.329989 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6mgn\" (UniqueName: \"kubernetes.io/projected/288fa0a8-3b86-4309-a8fe-4aaad531e042-kube-api-access-j6mgn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t5hps\" (UID: \"288fa0a8-3b86-4309-a8fe-4aaad531e042\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" Jul 08 17:17:11.330253 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.330177 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/288fa0a8-3b86-4309-a8fe-4aaad531e042-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t5hps\" (UID: \"288fa0a8-3b86-4309-a8fe-4aaad531e042\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" Jul 08 17:17:11.403992 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.403938 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:17:11.407909 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:17:11.407881 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7tvnv\" is forbidden: User \"system:node:ip-10-0-138-180.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-180.ec2.internal' and this object" podUID="64c1d659-a7aa-4857-994f-a5c7c82f9045" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:17:11.431293 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.431262 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/288fa0a8-3b86-4309-a8fe-4aaad531e042-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t5hps\" (UID: \"288fa0a8-3b86-4309-a8fe-4aaad531e042\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" Jul 08 17:17:11.431429 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.431415 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6mgn\" (UniqueName: \"kubernetes.io/projected/288fa0a8-3b86-4309-a8fe-4aaad531e042-kube-api-access-j6mgn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t5hps\" (UID: \"288fa0a8-3b86-4309-a8fe-4aaad531e042\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" Jul 08 17:17:11.431635 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.431615 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/288fa0a8-3b86-4309-a8fe-4aaad531e042-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t5hps\" (UID: \"288fa0a8-3b86-4309-a8fe-4aaad531e042\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" Jul 08 17:17:11.452405 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.452374 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6mgn\" (UniqueName: \"kubernetes.io/projected/288fa0a8-3b86-4309-a8fe-4aaad531e042-kube-api-access-j6mgn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t5hps\" (UID: \"288fa0a8-3b86-4309-a8fe-4aaad531e042\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" Jul 08 17:17:11.532406 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.532364 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr6qs\" (UniqueName: \"kubernetes.io/projected/64c1d659-a7aa-4857-994f-a5c7c82f9045-kube-api-access-sr6qs\") pod \"64c1d659-a7aa-4857-994f-a5c7c82f9045\" (UID: \"64c1d659-a7aa-4857-994f-a5c7c82f9045\") " Jul 08 17:17:11.532599 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.532452 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64c1d659-a7aa-4857-994f-a5c7c82f9045-extensions-socket-volume\") pod \"64c1d659-a7aa-4857-994f-a5c7c82f9045\" (UID: \"64c1d659-a7aa-4857-994f-a5c7c82f9045\") " Jul 08 17:17:11.532913 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.532889 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c1d659-a7aa-4857-994f-a5c7c82f9045-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "64c1d659-a7aa-4857-994f-a5c7c82f9045" (UID: "64c1d659-a7aa-4857-994f-a5c7c82f9045"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:17:11.534706 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.534686 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c1d659-a7aa-4857-994f-a5c7c82f9045-kube-api-access-sr6qs" (OuterVolumeSpecName: "kube-api-access-sr6qs") pod "64c1d659-a7aa-4857-994f-a5c7c82f9045" (UID: "64c1d659-a7aa-4857-994f-a5c7c82f9045"). InnerVolumeSpecName "kube-api-access-sr6qs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:17:11.539366 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.539349 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" Jul 08 17:17:11.633889 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.633852 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64c1d659-a7aa-4857-994f-a5c7c82f9045-extensions-socket-volume\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:17:11.633889 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.633889 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr6qs\" (UniqueName: \"kubernetes.io/projected/64c1d659-a7aa-4857-994f-a5c7c82f9045-kube-api-access-sr6qs\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:17:11.680165 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.680067 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps"] Jul 08 17:17:11.683020 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:17:11.682989 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod288fa0a8_3b86_4309_a8fe_4aaad531e042.slice/crio-1aa87648bf1055fc012559013f49c418d034712d8b61a964a3047bc8448aec54 WatchSource:0}: Error finding container 1aa87648bf1055fc012559013f49c418d034712d8b61a964a3047bc8448aec54: Status 404 returned error can't find the container with id 1aa87648bf1055fc012559013f49c418d034712d8b61a964a3047bc8448aec54 Jul 08 17:17:11.974675 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:11.974585 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:12.078730 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.078700 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:12.174380 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.174351 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-25kg9" Jul 08 17:17:12.207442 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:17:12.207400 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7tvnv\" is forbidden: User \"system:node:ip-10-0-138-180.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-180.ec2.internal' and this object" podUID="64c1d659-a7aa-4857-994f-a5c7c82f9045" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:17:12.220407 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.220368 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" event={"ID":"288fa0a8-3b86-4309-a8fe-4aaad531e042","Type":"ContainerStarted","Data":"510d06f881d609ee13a409683a9f96f8aa83156175ad7edff254332b428b5e4c"} Jul 08 17:17:12.220560 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.220439 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" event={"ID":"288fa0a8-3b86-4309-a8fe-4aaad531e042","Type":"ContainerStarted","Data":"1aa87648bf1055fc012559013f49c418d034712d8b61a964a3047bc8448aec54"} Jul 08 17:17:12.220560 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.220470 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" Jul 08 17:17:12.221881 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.221856 2567 generic.go:356] "Generic (PLEG): container finished" podID="64c1d659-a7aa-4857-994f-a5c7c82f9045" containerID="ca056f75f6b590590be4c79a9201ce0b1bd7b6d5394efe629bac9a51ac8bfd47" exitCode=0 Jul 08 17:17:12.222012 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.221910 2567 scope.go:117] "RemoveContainer" containerID="ca056f75f6b590590be4c79a9201ce0b1bd7b6d5394efe629bac9a51ac8bfd47" Jul 08 17:17:12.222012 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.221925 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:17:12.224833 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:17:12.224658 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7tvnv\" is forbidden: User \"system:node:ip-10-0-138-180.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-180.ec2.internal' and this object" podUID="64c1d659-a7aa-4857-994f-a5c7c82f9045" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7tvnv" Jul 08 17:17:12.233470 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.233410 2567 scope.go:117] "RemoveContainer" containerID="ca056f75f6b590590be4c79a9201ce0b1bd7b6d5394efe629bac9a51ac8bfd47" Jul 08 17:17:12.233893 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:17:12.233860 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca056f75f6b590590be4c79a9201ce0b1bd7b6d5394efe629bac9a51ac8bfd47\": container with ID starting with ca056f75f6b590590be4c79a9201ce0b1bd7b6d5394efe629bac9a51ac8bfd47 not found: ID does not exist" containerID="ca056f75f6b590590be4c79a9201ce0b1bd7b6d5394efe629bac9a51ac8bfd47" Jul 08 17:17:12.233991 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.233904 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca056f75f6b590590be4c79a9201ce0b1bd7b6d5394efe629bac9a51ac8bfd47"} err="failed to get container status \"ca056f75f6b590590be4c79a9201ce0b1bd7b6d5394efe629bac9a51ac8bfd47\": rpc error: code = NotFound desc = could not find container \"ca056f75f6b590590be4c79a9201ce0b1bd7b6d5394efe629bac9a51ac8bfd47\": container with ID starting with ca056f75f6b590590be4c79a9201ce0b1bd7b6d5394efe629bac9a51ac8bfd47 not found: ID does not exist" Jul 08 17:17:12.260495 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.260456 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64c1d659-a7aa-4857-994f-a5c7c82f9045" path="/var/lib/kubelet/pods/64c1d659-a7aa-4857-994f-a5c7c82f9045/volumes" Jul 08 17:17:12.272667 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.272622 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" podStartSLOduration=1.272606944 podStartE2EDuration="1.272606944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:17:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:17:12.270225437 +0000 UTC m=+458.671729855" watchObservedRunningTime="2026-07-08 17:17:12.272606944 +0000 UTC m=+458.674111363" Jul 08 17:17:12.345059 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.345025 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5"] Jul 08 17:17:12.349829 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.349807 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" Jul 08 17:17:12.376945 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.376918 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5"] Jul 08 17:17:12.442348 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.442309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb2f4\" (UniqueName: \"kubernetes.io/projected/9074ac82-b460-4a52-9913-0979e54b1c3e-kube-api-access-vb2f4\") pod \"kuadrant-operator-controller-manager-86878c769f-6gfr5\" (UID: \"9074ac82-b460-4a52-9913-0979e54b1c3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" Jul 08 17:17:12.442553 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.442386 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9074ac82-b460-4a52-9913-0979e54b1c3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6gfr5\" (UID: \"9074ac82-b460-4a52-9913-0979e54b1c3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" Jul 08 17:17:12.544214 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.544066 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb2f4\" (UniqueName: \"kubernetes.io/projected/9074ac82-b460-4a52-9913-0979e54b1c3e-kube-api-access-vb2f4\") pod \"kuadrant-operator-controller-manager-86878c769f-6gfr5\" (UID: \"9074ac82-b460-4a52-9913-0979e54b1c3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" Jul 08 17:17:12.544214 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.544183 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9074ac82-b460-4a52-9913-0979e54b1c3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6gfr5\" (UID: \"9074ac82-b460-4a52-9913-0979e54b1c3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" Jul 08 17:17:12.545187 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.545126 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9074ac82-b460-4a52-9913-0979e54b1c3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6gfr5\" (UID: \"9074ac82-b460-4a52-9913-0979e54b1c3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" Jul 08 17:17:12.560515 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.560481 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb2f4\" (UniqueName: \"kubernetes.io/projected/9074ac82-b460-4a52-9913-0979e54b1c3e-kube-api-access-vb2f4\") pod \"kuadrant-operator-controller-manager-86878c769f-6gfr5\" (UID: \"9074ac82-b460-4a52-9913-0979e54b1c3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" Jul 08 17:17:12.659816 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.659785 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" Jul 08 17:17:12.829249 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:17:12.829192 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9074ac82_b460_4a52_9913_0979e54b1c3e.slice/crio-900b31693cde01cf298f120a1730e05014dda93698070f2c9ee4b0c40642d5d4 WatchSource:0}: Error finding container 900b31693cde01cf298f120a1730e05014dda93698070f2c9ee4b0c40642d5d4: Status 404 returned error can't find the container with id 900b31693cde01cf298f120a1730e05014dda93698070f2c9ee4b0c40642d5d4 Jul 08 17:17:12.833027 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:12.833002 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5"] Jul 08 17:17:13.229112 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:13.229057 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" event={"ID":"9074ac82-b460-4a52-9913-0979e54b1c3e","Type":"ContainerStarted","Data":"54c37eb2b6afbe70dfea7ef7d206fa496fc02f8609fbe22ff92bc41ed2ccaab5"} Jul 08 17:17:13.229598 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:13.229127 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" event={"ID":"9074ac82-b460-4a52-9913-0979e54b1c3e","Type":"ContainerStarted","Data":"900b31693cde01cf298f120a1730e05014dda93698070f2c9ee4b0c40642d5d4"} Jul 08 17:17:13.229598 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:13.229485 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" Jul 08 17:17:13.287516 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:13.287458 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" podStartSLOduration=1.287442896 podStartE2EDuration="1.287442896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:17:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:17:13.284860093 +0000 UTC m=+459.686364513" watchObservedRunningTime="2026-07-08 17:17:13.287442896 +0000 UTC m=+459.688947315" Jul 08 17:17:16.373731 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:16.373696 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:16.522749 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:16.522715 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:19.539333 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:19.539296 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:19.622019 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:19.621984 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:23.232519 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:23.232481 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" Jul 08 17:17:24.236653 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:24.236624 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" Jul 08 17:17:24.338585 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:24.338549 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps"] Jul 08 17:17:24.338790 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:24.338766 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" podUID="288fa0a8-3b86-4309-a8fe-4aaad531e042" containerName="manager" containerID="cri-o://510d06f881d609ee13a409683a9f96f8aa83156175ad7edff254332b428b5e4c" gracePeriod=10 Jul 08 17:17:24.584806 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:24.584771 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" Jul 08 17:17:24.756422 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:24.756392 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/288fa0a8-3b86-4309-a8fe-4aaad531e042-extensions-socket-volume\") pod \"288fa0a8-3b86-4309-a8fe-4aaad531e042\" (UID: \"288fa0a8-3b86-4309-a8fe-4aaad531e042\") " Jul 08 17:17:24.756632 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:24.756449 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6mgn\" (UniqueName: \"kubernetes.io/projected/288fa0a8-3b86-4309-a8fe-4aaad531e042-kube-api-access-j6mgn\") pod \"288fa0a8-3b86-4309-a8fe-4aaad531e042\" (UID: \"288fa0a8-3b86-4309-a8fe-4aaad531e042\") " Jul 08 17:17:24.756795 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:24.756770 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/288fa0a8-3b86-4309-a8fe-4aaad531e042-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "288fa0a8-3b86-4309-a8fe-4aaad531e042" (UID: "288fa0a8-3b86-4309-a8fe-4aaad531e042"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:17:24.758527 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:24.758476 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/288fa0a8-3b86-4309-a8fe-4aaad531e042-kube-api-access-j6mgn" (OuterVolumeSpecName: "kube-api-access-j6mgn") pod "288fa0a8-3b86-4309-a8fe-4aaad531e042" (UID: "288fa0a8-3b86-4309-a8fe-4aaad531e042"). InnerVolumeSpecName "kube-api-access-j6mgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:17:24.857174 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:24.857122 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/288fa0a8-3b86-4309-a8fe-4aaad531e042-extensions-socket-volume\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:17:24.857174 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:24.857179 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6mgn\" (UniqueName: \"kubernetes.io/projected/288fa0a8-3b86-4309-a8fe-4aaad531e042-kube-api-access-j6mgn\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:17:25.285310 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:25.285274 2567 generic.go:356] "Generic (PLEG): container finished" podID="288fa0a8-3b86-4309-a8fe-4aaad531e042" containerID="510d06f881d609ee13a409683a9f96f8aa83156175ad7edff254332b428b5e4c" exitCode=0 Jul 08 17:17:25.285710 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:25.285324 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" Jul 08 17:17:25.285710 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:25.285366 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" event={"ID":"288fa0a8-3b86-4309-a8fe-4aaad531e042","Type":"ContainerDied","Data":"510d06f881d609ee13a409683a9f96f8aa83156175ad7edff254332b428b5e4c"} Jul 08 17:17:25.285710 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:25.285423 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps" event={"ID":"288fa0a8-3b86-4309-a8fe-4aaad531e042","Type":"ContainerDied","Data":"1aa87648bf1055fc012559013f49c418d034712d8b61a964a3047bc8448aec54"} Jul 08 17:17:25.285710 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:25.285450 2567 scope.go:117] "RemoveContainer" containerID="510d06f881d609ee13a409683a9f96f8aa83156175ad7edff254332b428b5e4c" Jul 08 17:17:25.294148 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:25.294131 2567 scope.go:117] "RemoveContainer" containerID="510d06f881d609ee13a409683a9f96f8aa83156175ad7edff254332b428b5e4c" Jul 08 17:17:25.294426 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:17:25.294406 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"510d06f881d609ee13a409683a9f96f8aa83156175ad7edff254332b428b5e4c\": container with ID starting with 510d06f881d609ee13a409683a9f96f8aa83156175ad7edff254332b428b5e4c not found: ID does not exist" containerID="510d06f881d609ee13a409683a9f96f8aa83156175ad7edff254332b428b5e4c" Jul 08 17:17:25.294484 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:25.294435 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"510d06f881d609ee13a409683a9f96f8aa83156175ad7edff254332b428b5e4c"} err="failed to get container status \"510d06f881d609ee13a409683a9f96f8aa83156175ad7edff254332b428b5e4c\": rpc error: code = NotFound desc = could not find container \"510d06f881d609ee13a409683a9f96f8aa83156175ad7edff254332b428b5e4c\": container with ID starting with 510d06f881d609ee13a409683a9f96f8aa83156175ad7edff254332b428b5e4c not found: ID does not exist" Jul 08 17:17:25.309677 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:25.309652 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps"] Jul 08 17:17:25.316524 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:25.316502 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5hps"] Jul 08 17:17:26.259481 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:26.259440 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="288fa0a8-3b86-4309-a8fe-4aaad531e042" path="/var/lib/kubelet/pods/288fa0a8-3b86-4309-a8fe-4aaad531e042/volumes" Jul 08 17:17:28.851889 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:28.851855 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:28.950680 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:28.950647 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:31.305793 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:31.305754 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:31.380393 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:31.380359 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:34.540878 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:34.540841 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:40.919642 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:40.919608 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm"] Jul 08 17:17:40.920000 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:40.919930 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="288fa0a8-3b86-4309-a8fe-4aaad531e042" containerName="manager" Jul 08 17:17:40.920000 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:40.919942 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="288fa0a8-3b86-4309-a8fe-4aaad531e042" containerName="manager" Jul 08 17:17:40.920071 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:40.920002 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="288fa0a8-3b86-4309-a8fe-4aaad531e042" containerName="manager" Jul 08 17:17:40.923808 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:40.923788 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:40.926925 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:40.926903 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-v5l8p\"" Jul 08 17:17:40.938535 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:40.938508 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm"] Jul 08 17:17:40.968387 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:40.968359 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:41.065266 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.065234 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:41.089433 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.089400 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb8bf282-11a3-41f7-8ade-be41be353e88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.089601 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.089442 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.089601 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.089511 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.089601 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.089538 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.089601 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.089571 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.089601 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.089587 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp8km\" (UniqueName: \"kubernetes.io/projected/bb8bf282-11a3-41f7-8ade-be41be353e88-kube-api-access-vp8km\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.089790 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.089605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.089790 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.089647 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb8bf282-11a3-41f7-8ade-be41be353e88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.089790 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.089669 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb8bf282-11a3-41f7-8ade-be41be353e88-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.190739 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.190652 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.190739 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.190696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.190739 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.190732 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.191064 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.190759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp8km\" (UniqueName: \"kubernetes.io/projected/bb8bf282-11a3-41f7-8ade-be41be353e88-kube-api-access-vp8km\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.191064 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.190784 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.191064 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.190822 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb8bf282-11a3-41f7-8ade-be41be353e88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.191064 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.190842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb8bf282-11a3-41f7-8ade-be41be353e88-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.191064 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.190868 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb8bf282-11a3-41f7-8ade-be41be353e88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.191064 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.190904 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.191392 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.191256 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.191392 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.191377 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.191501 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.191418 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.191558 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.191534 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.191710 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.191691 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb8bf282-11a3-41f7-8ade-be41be353e88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.193060 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.193032 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb8bf282-11a3-41f7-8ade-be41be353e88-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.193227 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.193208 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb8bf282-11a3-41f7-8ade-be41be353e88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.199403 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.199377 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb8bf282-11a3-41f7-8ade-be41be353e88-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.199826 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.199805 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp8km\" (UniqueName: \"kubernetes.io/projected/bb8bf282-11a3-41f7-8ade-be41be353e88-kube-api-access-vp8km\") pod \"maas-default-gateway-openshift-default-56654dcf7-ltxfm\" (UID: \"bb8bf282-11a3-41f7-8ade-be41be353e88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.234640 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.234612 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:41.371731 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.371698 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm"] Jul 08 17:17:41.374775 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:17:41.374743 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb8bf282_11a3_41f7_8ade_be41be353e88.slice/crio-64bd621a085719386243c88847233576b3fcd56ef15318e3f3ced34febc17c67 WatchSource:0}: Error finding container 64bd621a085719386243c88847233576b3fcd56ef15318e3f3ced34febc17c67: Status 404 returned error can't find the container with id 64bd621a085719386243c88847233576b3fcd56ef15318e3f3ced34febc17c67 Jul 08 17:17:41.379459 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.379418 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:17:41.379584 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.379491 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:17:41.379584 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:41.379540 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:17:42.361655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:42.361615 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" event={"ID":"bb8bf282-11a3-41f7-8ade-be41be353e88","Type":"ContainerStarted","Data":"50c3a892990070c4350b618544b2bd6c781c3867f0976dc6d34758fdaca4df37"} Jul 08 17:17:42.362111 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:42.361673 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" event={"ID":"bb8bf282-11a3-41f7-8ade-be41be353e88","Type":"ContainerStarted","Data":"64bd621a085719386243c88847233576b3fcd56ef15318e3f3ced34febc17c67"} Jul 08 17:17:42.385784 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:42.385709 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" podStartSLOduration=2.385685929 podStartE2EDuration="2.385685929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:17:42.384572005 +0000 UTC m=+488.786076423" watchObservedRunningTime="2026-07-08 17:17:42.385685929 +0000 UTC m=+488.787190349" Jul 08 17:17:42.555231 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:42.555200 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:42.656202 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:42.656129 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:43.235475 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.235436 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:43.240123 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.240093 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:43.365780 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.365751 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:43.366640 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.366620 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:17:43.474713 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.474679 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:43.557324 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.557240 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:43.634654 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.634617 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:43.808708 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.808630 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:17:43.812109 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.812087 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-rxlnb" Jul 08 17:17:43.814427 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.814406 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 08 17:17:43.814544 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.814424 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-285zs\" (UniqueName: \"kubernetes.io/projected/dc77dde0-2238-4a53-bd63-67b402dff1f5-kube-api-access-285zs\") pod \"limitador-limitador-54d6d988d5-rxlnb\" (UID: \"dc77dde0-2238-4a53-bd63-67b402dff1f5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rxlnb" Jul 08 17:17:43.814617 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.814536 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w8rj8\"" Jul 08 17:17:43.814617 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.814556 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc77dde0-2238-4a53-bd63-67b402dff1f5-config-file\") pod \"limitador-limitador-54d6d988d5-rxlnb\" (UID: \"dc77dde0-2238-4a53-bd63-67b402dff1f5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rxlnb" Jul 08 17:17:43.820247 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.820224 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:17:43.850108 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.850082 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:17:43.915071 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.915035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc77dde0-2238-4a53-bd63-67b402dff1f5-config-file\") pod \"limitador-limitador-54d6d988d5-rxlnb\" (UID: \"dc77dde0-2238-4a53-bd63-67b402dff1f5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rxlnb" Jul 08 17:17:43.915071 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.915074 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-285zs\" (UniqueName: \"kubernetes.io/projected/dc77dde0-2238-4a53-bd63-67b402dff1f5-kube-api-access-285zs\") pod \"limitador-limitador-54d6d988d5-rxlnb\" (UID: \"dc77dde0-2238-4a53-bd63-67b402dff1f5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rxlnb" Jul 08 17:17:43.915683 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.915663 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc77dde0-2238-4a53-bd63-67b402dff1f5-config-file\") pod \"limitador-limitador-54d6d988d5-rxlnb\" (UID: \"dc77dde0-2238-4a53-bd63-67b402dff1f5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rxlnb" Jul 08 17:17:43.925040 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:43.925014 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-285zs\" (UniqueName: \"kubernetes.io/projected/dc77dde0-2238-4a53-bd63-67b402dff1f5-kube-api-access-285zs\") pod \"limitador-limitador-54d6d988d5-rxlnb\" (UID: \"dc77dde0-2238-4a53-bd63-67b402dff1f5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rxlnb" Jul 08 17:17:44.124225 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:44.124120 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-rxlnb" Jul 08 17:17:44.269079 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:44.269055 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:17:44.271514 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:17:44.271483 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc77dde0_2238_4a53_bd63_67b402dff1f5.slice/crio-eecc1a8c2e117bed7d16a97713ab581f98707930ac0511ff285f3c1b658074f2 WatchSource:0}: Error finding container eecc1a8c2e117bed7d16a97713ab581f98707930ac0511ff285f3c1b658074f2: Status 404 returned error can't find the container with id eecc1a8c2e117bed7d16a97713ab581f98707930ac0511ff285f3c1b658074f2 Jul 08 17:17:44.293989 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:44.293962 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:44.370865 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:44.370824 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-rxlnb" event={"ID":"dc77dde0-2238-4a53-bd63-67b402dff1f5","Type":"ContainerStarted","Data":"eecc1a8c2e117bed7d16a97713ab581f98707930ac0511ff285f3c1b658074f2"} Jul 08 17:17:44.472922 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:44.472886 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:47.388275 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:47.388226 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-rxlnb" event={"ID":"dc77dde0-2238-4a53-bd63-67b402dff1f5","Type":"ContainerStarted","Data":"ae1615ffabbe158a47b3200889e65a177cee7b9bf46b1eed7be49e824f8fa4c4"} Jul 08 17:17:47.388639 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:47.388330 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-rxlnb" Jul 08 17:17:47.406608 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:47.406549 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-rxlnb" podStartSLOduration=1.733074064 podStartE2EDuration="4.406533929s" totalImagesPullingTime="2.673459865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:17:47.404493876 +0000 UTC m=+493.805998293" watchObservedRunningTime="2026-07-08 17:17:47.406533929 +0000 UTC m=+493.808038371" Jul 08 17:17:58.393576 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:58.393547 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-rxlnb" Jul 08 17:17:59.644183 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:59.644125 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:17:59.741519 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:17:59.741491 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:00.118298 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:00.118220 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:11.798739 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:11.798699 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:12.100356 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:12.100267 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:17.941503 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:17.941463 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:18.037191 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:18.037143 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:18.129281 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:18.129237 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:18.208683 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:18.208594 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:21.436246 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:21.436201 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:21.531180 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:21.531121 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:24.308192 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:24.308139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:24.409575 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:24.409541 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:31.387402 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:31.387325 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:31.448765 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:31.448730 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:51.765724 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:51.765682 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:51.867919 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:51.867882 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:52.189432 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:52.189398 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:52.476380 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:52.476305 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:52.655918 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:52.655877 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:52.745740 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:52.745648 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:18:52.860911 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:52.860872 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:18:59.408328 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:59.408284 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ltxfm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 17:18:59.408817 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:18:59.408358 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" podUID="bb8bf282-11a3-41f7-8ade-be41be353e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 17:19:00.721692 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:00.721609 2567 generic.go:356] "Generic (PLEG): container finished" podID="bb8bf282-11a3-41f7-8ade-be41be353e88" containerID="50c3a892990070c4350b618544b2bd6c781c3867f0976dc6d34758fdaca4df37" exitCode=0 Jul 08 17:19:00.722083 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:00.721685 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" event={"ID":"bb8bf282-11a3-41f7-8ade-be41be353e88","Type":"ContainerDied","Data":"50c3a892990070c4350b618544b2bd6c781c3867f0976dc6d34758fdaca4df37"} Jul 08 17:19:00.722083 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:00.722064 2567 scope.go:117] "RemoveContainer" containerID="50c3a892990070c4350b618544b2bd6c781c3867f0976dc6d34758fdaca4df37" Jul 08 17:19:00.723048 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:00.723020 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:19:00.723097 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:00.723086 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:19:00.723132 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:00.723124 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:19:01.729080 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:01.729031 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" event={"ID":"bb8bf282-11a3-41f7-8ade-be41be353e88","Type":"ContainerStarted","Data":"a228131d4bde7f17b87c80558a433266aa162e4d41dfcb85c22dfaecf7cfc66e"} Jul 08 17:19:02.236356 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:02.235881 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:19:02.236356 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:02.236015 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ltxfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 08 17:19:02.236356 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:02.236062 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" podUID="bb8bf282-11a3-41f7-8ade-be41be353e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 08 17:19:02.696913 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:02.696880 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:02.796751 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:02.796711 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:03.236135 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:03.236091 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ltxfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 08 17:19:03.236491 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:03.236457 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" podUID="bb8bf282-11a3-41f7-8ade-be41be353e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 08 17:19:04.235107 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:04.235072 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ltxfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 08 17:19:04.235710 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:04.235677 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" podUID="bb8bf282-11a3-41f7-8ade-be41be353e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 08 17:19:05.235760 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:05.235716 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ltxfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 08 17:19:05.236363 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:05.236324 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" podUID="bb8bf282-11a3-41f7-8ade-be41be353e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 08 17:19:06.239065 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:06.239031 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:19:06.239483 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:06.239391 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:19:06.240140 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:06.240122 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ltxfm" Jul 08 17:19:34.040400 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:34.040360 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:19:34.045227 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:34.045192 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:19:34.046472 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:34.046449 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:19:34.050960 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:34.050942 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:19:36.100550 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.100519 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r"] Jul 08 17:19:36.103833 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.103814 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.106330 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.106307 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 17:19:36.107510 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.107493 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xrz8g\"" Jul 08 17:19:36.107566 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.107513 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 17:19:36.107811 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.107794 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 08 17:19:36.113958 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.113937 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r"] Jul 08 17:19:36.120447 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.120417 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:36.190792 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.190754 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp7vl\" (UniqueName: \"kubernetes.io/projected/fda02442-5f06-4a83-b69b-2f5e87fca332-kube-api-access-xp7vl\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.190792 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.190795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fda02442-5f06-4a83-b69b-2f5e87fca332-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.190988 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.190813 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fda02442-5f06-4a83-b69b-2f5e87fca332-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.190988 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.190830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fda02442-5f06-4a83-b69b-2f5e87fca332-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.190988 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.190918 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fda02442-5f06-4a83-b69b-2f5e87fca332-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.190988 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.190950 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fda02442-5f06-4a83-b69b-2f5e87fca332-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.291879 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.291839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fda02442-5f06-4a83-b69b-2f5e87fca332-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.291879 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.291881 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fda02442-5f06-4a83-b69b-2f5e87fca332-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.292112 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.291946 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp7vl\" (UniqueName: \"kubernetes.io/projected/fda02442-5f06-4a83-b69b-2f5e87fca332-kube-api-access-xp7vl\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.292112 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.291972 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fda02442-5f06-4a83-b69b-2f5e87fca332-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.292112 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.291994 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fda02442-5f06-4a83-b69b-2f5e87fca332-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.292112 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.292017 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fda02442-5f06-4a83-b69b-2f5e87fca332-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.292372 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.292353 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fda02442-5f06-4a83-b69b-2f5e87fca332-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.292429 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.292375 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fda02442-5f06-4a83-b69b-2f5e87fca332-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.292706 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.292680 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fda02442-5f06-4a83-b69b-2f5e87fca332-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.294504 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.294469 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fda02442-5f06-4a83-b69b-2f5e87fca332-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.294808 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.294790 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fda02442-5f06-4a83-b69b-2f5e87fca332-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.299745 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.299726 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp7vl\" (UniqueName: \"kubernetes.io/projected/fda02442-5f06-4a83-b69b-2f5e87fca332-kube-api-access-xp7vl\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r\" (UID: \"fda02442-5f06-4a83-b69b-2f5e87fca332\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.414172 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.414117 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:36.548437 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.548408 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r"] Jul 08 17:19:36.550811 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:19:36.550779 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda02442_5f06_4a83_b69b_2f5e87fca332.slice/crio-4991f6120355bf2ba8e0898ce50ed3e4a6d703fdad016e83098c03915f260afc WatchSource:0}: Error finding container 4991f6120355bf2ba8e0898ce50ed3e4a6d703fdad016e83098c03915f260afc: Status 404 returned error can't find the container with id 4991f6120355bf2ba8e0898ce50ed3e4a6d703fdad016e83098c03915f260afc Jul 08 17:19:36.677960 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.677874 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:19:36.889746 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:36.889701 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" event={"ID":"fda02442-5f06-4a83-b69b-2f5e87fca332","Type":"ContainerStarted","Data":"4991f6120355bf2ba8e0898ce50ed3e4a6d703fdad016e83098c03915f260afc"} Jul 08 17:19:37.895867 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:37.895825 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" event={"ID":"fda02442-5f06-4a83-b69b-2f5e87fca332","Type":"ContainerStarted","Data":"5018f615a84b96f2d96e91f6e95de9ae0416abb2a57f93ea11a524f7e179c510"} Jul 08 17:19:37.914755 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:37.914699 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" podStartSLOduration=0.697070294 podStartE2EDuration="1.914684441s" totalImagesPullingTime="1.217614147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:37.913118985 +0000 UTC m=+604.314623404" watchObservedRunningTime="2026-07-08 17:19:37.914684441 +0000 UTC m=+604.316188859" Jul 08 17:19:46.415049 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:46.415009 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:46.415461 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:46.415069 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:46.427483 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:46.427458 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:46.948268 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:46.948235 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r" Jul 08 17:19:47.022094 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:47.022061 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:47.781882 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:47.781849 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:19:57.086539 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:57.086456 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:58.186911 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:19:58.186875 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:20:00.818300 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:00.818267 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:02.391331 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:02.391290 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:20:09.689515 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.689477 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm"] Jul 08 17:20:09.699979 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.699812 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.701684 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.701652 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm"] Jul 08 17:20:09.702725 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.702702 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 08 17:20:09.793692 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.793644 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk7bj\" (UniqueName: \"kubernetes.io/projected/9c89a7c4-1162-4898-bd1d-93e676672934-kube-api-access-rk7bj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.793692 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.793696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c89a7c4-1162-4898-bd1d-93e676672934-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.793941 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.793751 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c89a7c4-1162-4898-bd1d-93e676672934-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.793941 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.793841 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c89a7c4-1162-4898-bd1d-93e676672934-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.793941 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.793869 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c89a7c4-1162-4898-bd1d-93e676672934-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.793941 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.793918 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c89a7c4-1162-4898-bd1d-93e676672934-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.891057 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.891013 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:09.894376 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.894352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c89a7c4-1162-4898-bd1d-93e676672934-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.894455 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.894388 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c89a7c4-1162-4898-bd1d-93e676672934-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.894455 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.894436 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c89a7c4-1162-4898-bd1d-93e676672934-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.894556 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.894452 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c89a7c4-1162-4898-bd1d-93e676672934-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.894556 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.894511 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c89a7c4-1162-4898-bd1d-93e676672934-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.894556 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.894545 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk7bj\" (UniqueName: \"kubernetes.io/projected/9c89a7c4-1162-4898-bd1d-93e676672934-kube-api-access-rk7bj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.894935 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.894912 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c89a7c4-1162-4898-bd1d-93e676672934-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.895036 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.894943 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c89a7c4-1162-4898-bd1d-93e676672934-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.895036 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.894979 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c89a7c4-1162-4898-bd1d-93e676672934-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.896716 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.896691 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c89a7c4-1162-4898-bd1d-93e676672934-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.896849 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.896833 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c89a7c4-1162-4898-bd1d-93e676672934-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:09.902688 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:09.902666 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk7bj\" (UniqueName: \"kubernetes.io/projected/9c89a7c4-1162-4898-bd1d-93e676672934-kube-api-access-rk7bj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twflm\" (UID: \"9c89a7c4-1162-4898-bd1d-93e676672934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:10.010846 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:10.010762 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:10.149458 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:10.149426 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm"] Jul 08 17:20:10.153113 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:20:10.153075 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c89a7c4_1162_4898_bd1d_93e676672934.slice/crio-db49267f50fbb899c23895ecd74041748d5acbe951a4d62065ec9e3c743d0c09 WatchSource:0}: Error finding container db49267f50fbb899c23895ecd74041748d5acbe951a4d62065ec9e3c743d0c09: Status 404 returned error can't find the container with id db49267f50fbb899c23895ecd74041748d5acbe951a4d62065ec9e3c743d0c09 Jul 08 17:20:10.154989 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:10.154971 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:20:11.050296 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:11.050258 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" event={"ID":"9c89a7c4-1162-4898-bd1d-93e676672934","Type":"ContainerStarted","Data":"7bbe9c81900eb1597a3c0803163582c5a2c8739e01605b86e3247a4c1dbea2a5"} Jul 08 17:20:11.050681 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:11.050318 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" event={"ID":"9c89a7c4-1162-4898-bd1d-93e676672934","Type":"ContainerStarted","Data":"db49267f50fbb899c23895ecd74041748d5acbe951a4d62065ec9e3c743d0c09"} Jul 08 17:20:11.069184 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:11.069117 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" podStartSLOduration=1.855822185 podStartE2EDuration="2.069100063s" totalImagesPullingTime="213.277878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:11.068019677 +0000 UTC m=+637.469524109" watchObservedRunningTime="2026-07-08 17:20:11.069100063 +0000 UTC m=+637.470604482" Jul 08 17:20:11.984417 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:11.984383 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:20:20.011377 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:20.011338 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:20.011831 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:20.011400 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:20.023980 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:20.023949 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:20.100385 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:20.100355 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twflm" Jul 08 17:20:35.460135 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:35.460098 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:37.894246 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:20:37.894207 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:21:00.538683 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:21:00.538649 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:52.456530 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:21:52.456477 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:54.567603 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:21:54.567562 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:07.922701 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:22:07.922638 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:08.023725 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:22:08.023694 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:17.159792 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:22:17.159753 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:17.253467 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:22:17.253432 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:18.336202 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:22:18.336166 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:18.439132 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:22:18.439096 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:24.888796 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:22:24.888758 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:45.490722 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:22:45.490681 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:22:55.603682 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:22:55.603644 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:23:06.598834 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:23:06.598756 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:23:16.301519 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:23:16.301482 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:23:27.099408 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:23:27.099370 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:23:28.901263 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:23:28.901222 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:30.666674 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:23:30.666614 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:54.408328 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:23:54.408291 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:24:05.838946 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:05.838905 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:24:13.190012 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:13.189963 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:24:14.066706 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:14.066628 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:14.192229 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:14.192190 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:14.305528 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:14.305491 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:20.166065 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:20.166032 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:20.288350 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:20.288312 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:20.393716 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:20.393681 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:20.556410 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:20.556324 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:25.291463 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:25.291421 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:24:26.190402 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:26.190330 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:26.256395 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:26.256352 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:34.070384 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:34.070347 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:24:34.072941 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:34.072915 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:24:34.074911 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:34.074893 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:24:34.077691 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:34.077672 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:24:44.581972 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:44.581930 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:24:53.983295 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:24:53.983258 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:25:03.296062 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:25:03.296021 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:25:09.085288 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:25:09.085252 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:25:20.933786 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:25:20.933748 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:25:31.589253 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:25:31.589212 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:25:43.780829 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:25:43.780790 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:25:53.683254 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:25:53.683220 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:25:57.934731 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:25:57.934650 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:59.698667 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:25:59.698633 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:08.811049 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:26:08.811008 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:18.289990 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:26:18.289951 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:26:30.103673 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:26:30.103634 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:26:54.387404 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:26:54.387364 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:27:04.986680 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:27:04.986649 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:27:20.389572 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:27:20.389519 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:27:26.608251 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:27:26.608166 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:26.690774 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:27:26.690742 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:31.087837 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:27:31.087800 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:27:40.686259 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:27:40.686219 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:27:49.786078 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:27:49.786035 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:27:59.187948 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:27:59.187907 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:28:09.370977 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:09.370939 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:25.682592 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:25.682554 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5"] Jul 08 17:28:25.683027 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:25.682744 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" podUID="9074ac82-b460-4a52-9913-0979e54b1c3e" containerName="manager" containerID="cri-o://54c37eb2b6afbe70dfea7ef7d206fa496fc02f8609fbe22ff92bc41ed2ccaab5" gracePeriod=10 Jul 08 17:28:28.244542 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.244511 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" Jul 08 17:28:28.359615 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.359532 2567 generic.go:356] "Generic (PLEG): container finished" podID="9074ac82-b460-4a52-9913-0979e54b1c3e" containerID="54c37eb2b6afbe70dfea7ef7d206fa496fc02f8609fbe22ff92bc41ed2ccaab5" exitCode=0 Jul 08 17:28:28.359615 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.359578 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" Jul 08 17:28:28.359803 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.359621 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" event={"ID":"9074ac82-b460-4a52-9913-0979e54b1c3e","Type":"ContainerDied","Data":"54c37eb2b6afbe70dfea7ef7d206fa496fc02f8609fbe22ff92bc41ed2ccaab5"} Jul 08 17:28:28.359803 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.359678 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5" event={"ID":"9074ac82-b460-4a52-9913-0979e54b1c3e","Type":"ContainerDied","Data":"900b31693cde01cf298f120a1730e05014dda93698070f2c9ee4b0c40642d5d4"} Jul 08 17:28:28.359803 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.359696 2567 scope.go:117] "RemoveContainer" containerID="54c37eb2b6afbe70dfea7ef7d206fa496fc02f8609fbe22ff92bc41ed2ccaab5" Jul 08 17:28:28.369334 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.369314 2567 scope.go:117] "RemoveContainer" containerID="54c37eb2b6afbe70dfea7ef7d206fa496fc02f8609fbe22ff92bc41ed2ccaab5" Jul 08 17:28:28.369595 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:28:28.369575 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54c37eb2b6afbe70dfea7ef7d206fa496fc02f8609fbe22ff92bc41ed2ccaab5\": container with ID starting with 54c37eb2b6afbe70dfea7ef7d206fa496fc02f8609fbe22ff92bc41ed2ccaab5 not found: ID does not exist" containerID="54c37eb2b6afbe70dfea7ef7d206fa496fc02f8609fbe22ff92bc41ed2ccaab5" Jul 08 17:28:28.369643 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.369606 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54c37eb2b6afbe70dfea7ef7d206fa496fc02f8609fbe22ff92bc41ed2ccaab5"} err="failed to get container status \"54c37eb2b6afbe70dfea7ef7d206fa496fc02f8609fbe22ff92bc41ed2ccaab5\": rpc error: code = NotFound desc = could not find container \"54c37eb2b6afbe70dfea7ef7d206fa496fc02f8609fbe22ff92bc41ed2ccaab5\": container with ID starting with 54c37eb2b6afbe70dfea7ef7d206fa496fc02f8609fbe22ff92bc41ed2ccaab5 not found: ID does not exist" Jul 08 17:28:28.374935 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.374915 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb2f4\" (UniqueName: \"kubernetes.io/projected/9074ac82-b460-4a52-9913-0979e54b1c3e-kube-api-access-vb2f4\") pod \"9074ac82-b460-4a52-9913-0979e54b1c3e\" (UID: \"9074ac82-b460-4a52-9913-0979e54b1c3e\") " Jul 08 17:28:28.375035 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.374963 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9074ac82-b460-4a52-9913-0979e54b1c3e-extensions-socket-volume\") pod \"9074ac82-b460-4a52-9913-0979e54b1c3e\" (UID: \"9074ac82-b460-4a52-9913-0979e54b1c3e\") " Jul 08 17:28:28.375397 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.375377 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9074ac82-b460-4a52-9913-0979e54b1c3e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9074ac82-b460-4a52-9913-0979e54b1c3e" (UID: "9074ac82-b460-4a52-9913-0979e54b1c3e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:28:28.376838 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.376815 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9074ac82-b460-4a52-9913-0979e54b1c3e-kube-api-access-vb2f4" (OuterVolumeSpecName: "kube-api-access-vb2f4") pod "9074ac82-b460-4a52-9913-0979e54b1c3e" (UID: "9074ac82-b460-4a52-9913-0979e54b1c3e"). InnerVolumeSpecName "kube-api-access-vb2f4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:28:28.475566 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.475532 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb2f4\" (UniqueName: \"kubernetes.io/projected/9074ac82-b460-4a52-9913-0979e54b1c3e-kube-api-access-vb2f4\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:28:28.475566 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.475560 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9074ac82-b460-4a52-9913-0979e54b1c3e-extensions-socket-volume\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:28:28.684096 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.684063 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5"] Jul 08 17:28:28.692675 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:28.692644 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6gfr5"] Jul 08 17:28:30.259542 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:28:30.259503 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9074ac82-b460-4a52-9913-0979e54b1c3e" path="/var/lib/kubelet/pods/9074ac82-b460-4a52-9913-0979e54b1c3e/volumes" Jul 08 17:29:26.857483 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:26.857447 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd"] Jul 08 17:29:26.859628 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:26.857797 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9074ac82-b460-4a52-9913-0979e54b1c3e" containerName="manager" Jul 08 17:29:26.859628 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:26.857810 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9074ac82-b460-4a52-9913-0979e54b1c3e" containerName="manager" Jul 08 17:29:26.859628 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:26.857884 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9074ac82-b460-4a52-9913-0979e54b1c3e" containerName="manager" Jul 08 17:29:26.860631 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:26.860600 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd" Jul 08 17:29:26.863198 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:26.863179 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gnzz5\"" Jul 08 17:29:26.873048 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:26.873024 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd"] Jul 08 17:29:26.995909 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:26.995870 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fdcdeb7-3af0-4395-aa61-4850b715a569-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rtjdd\" (UID: \"0fdcdeb7-3af0-4395-aa61-4850b715a569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd" Jul 08 17:29:26.996113 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:26.995921 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74n4b\" (UniqueName: \"kubernetes.io/projected/0fdcdeb7-3af0-4395-aa61-4850b715a569-kube-api-access-74n4b\") pod \"kuadrant-operator-controller-manager-86878c769f-rtjdd\" (UID: \"0fdcdeb7-3af0-4395-aa61-4850b715a569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd" Jul 08 17:29:27.096671 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:27.096628 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74n4b\" (UniqueName: \"kubernetes.io/projected/0fdcdeb7-3af0-4395-aa61-4850b715a569-kube-api-access-74n4b\") pod \"kuadrant-operator-controller-manager-86878c769f-rtjdd\" (UID: \"0fdcdeb7-3af0-4395-aa61-4850b715a569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd" Jul 08 17:29:27.096835 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:27.096772 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fdcdeb7-3af0-4395-aa61-4850b715a569-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rtjdd\" (UID: \"0fdcdeb7-3af0-4395-aa61-4850b715a569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd" Jul 08 17:29:27.097227 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:27.097207 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0fdcdeb7-3af0-4395-aa61-4850b715a569-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rtjdd\" (UID: \"0fdcdeb7-3af0-4395-aa61-4850b715a569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd" Jul 08 17:29:27.106203 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:27.106175 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74n4b\" (UniqueName: \"kubernetes.io/projected/0fdcdeb7-3af0-4395-aa61-4850b715a569-kube-api-access-74n4b\") pod \"kuadrant-operator-controller-manager-86878c769f-rtjdd\" (UID: \"0fdcdeb7-3af0-4395-aa61-4850b715a569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd" Jul 08 17:29:27.170171 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:27.170111 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd" Jul 08 17:29:27.310189 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:27.305322 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd"] Jul 08 17:29:27.314035 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:29:27.314003 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fdcdeb7_3af0_4395_aa61_4850b715a569.slice/crio-65bc2973fa30126bb60af4033c0129c3a51478822a7af0632a880dff5d0bcd58 WatchSource:0}: Error finding container 65bc2973fa30126bb60af4033c0129c3a51478822a7af0632a880dff5d0bcd58: Status 404 returned error can't find the container with id 65bc2973fa30126bb60af4033c0129c3a51478822a7af0632a880dff5d0bcd58 Jul 08 17:29:27.630065 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:27.630029 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd" event={"ID":"0fdcdeb7-3af0-4395-aa61-4850b715a569","Type":"ContainerStarted","Data":"93ba67d94ec42f60a843a7f57664aee4c95f80067ec8a2e593b86e69fdd17f77"} Jul 08 17:29:27.630529 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:27.630097 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd" event={"ID":"0fdcdeb7-3af0-4395-aa61-4850b715a569","Type":"ContainerStarted","Data":"65bc2973fa30126bb60af4033c0129c3a51478822a7af0632a880dff5d0bcd58"} Jul 08 17:29:27.630529 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:27.630139 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd" Jul 08 17:29:27.650436 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:27.650369 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd" podStartSLOduration=1.650348851 podStartE2EDuration="1.650348851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:29:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:29:27.649218475 +0000 UTC m=+1194.050722895" watchObservedRunningTime="2026-07-08 17:29:27.650348851 +0000 UTC m=+1194.051853262" Jul 08 17:29:34.100725 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:34.100691 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:29:34.101203 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:34.100778 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:29:34.108059 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:34.108029 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:29:34.108337 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:34.108320 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:29:38.636992 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:38.636951 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rtjdd" Jul 08 17:29:49.788056 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:49.788011 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:29:58.999143 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:29:58.999101 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:30:00.143724 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:00.143689 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd"] Jul 08 17:30:00.147333 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:00.147309 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd" Jul 08 17:30:00.149836 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:00.149808 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ft2sr\"" Jul 08 17:30:00.149958 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:00.149813 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 17:30:00.150716 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:00.150693 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 17:30:00.153450 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:00.153425 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd"] Jul 08 17:30:00.287494 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:00.287458 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn8xx\" (UniqueName: \"kubernetes.io/projected/95a92ceb-81a2-4ba4-aa78-361d734e9d83-kube-api-access-tn8xx\") pod \"maas-api-key-cleanup-29725530-b6ljd\" (UID: \"95a92ceb-81a2-4ba4-aa78-361d734e9d83\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd" Jul 08 17:30:00.388328 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:00.388288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn8xx\" (UniqueName: \"kubernetes.io/projected/95a92ceb-81a2-4ba4-aa78-361d734e9d83-kube-api-access-tn8xx\") pod \"maas-api-key-cleanup-29725530-b6ljd\" (UID: \"95a92ceb-81a2-4ba4-aa78-361d734e9d83\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd" Jul 08 17:30:00.396959 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:00.396893 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn8xx\" (UniqueName: \"kubernetes.io/projected/95a92ceb-81a2-4ba4-aa78-361d734e9d83-kube-api-access-tn8xx\") pod \"maas-api-key-cleanup-29725530-b6ljd\" (UID: \"95a92ceb-81a2-4ba4-aa78-361d734e9d83\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd" Jul 08 17:30:00.459984 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:00.459935 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd" Jul 08 17:30:00.592555 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:00.592524 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd"] Jul 08 17:30:00.595143 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:30:00.595111 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a92ceb_81a2_4ba4_aa78_361d734e9d83.slice/crio-a70777421b5279204e68902cdf1b1a96109b9263cba2ce7c0e8b448a0edfb702 WatchSource:0}: Error finding container a70777421b5279204e68902cdf1b1a96109b9263cba2ce7c0e8b448a0edfb702: Status 404 returned error can't find the container with id a70777421b5279204e68902cdf1b1a96109b9263cba2ce7c0e8b448a0edfb702 Jul 08 17:30:00.596939 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:00.596922 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:30:00.783409 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:00.783325 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd" event={"ID":"95a92ceb-81a2-4ba4-aa78-361d734e9d83","Type":"ContainerStarted","Data":"a70777421b5279204e68902cdf1b1a96109b9263cba2ce7c0e8b448a0edfb702"} Jul 08 17:30:03.806067 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:03.806019 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd" event={"ID":"95a92ceb-81a2-4ba4-aa78-361d734e9d83","Type":"ContainerStarted","Data":"b2b0f37af2852170facd0b2f56602efba1ef4d25fae7dd3076c01cdd827f6419"} Jul 08 17:30:03.825918 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:03.825854 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd" podStartSLOduration=1.437525796 podStartE2EDuration="3.825834027s" totalImagesPullingTime="2.388308231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:30:03.822931664 +0000 UTC m=+1230.224436083" watchObservedRunningTime="2026-07-08 17:30:03.825834027 +0000 UTC m=+1230.227338447" Jul 08 17:30:04.812089 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:04.812050 2567 generic.go:356] "Generic (PLEG): container finished" podID="95a92ceb-81a2-4ba4-aa78-361d734e9d83" containerID="b2b0f37af2852170facd0b2f56602efba1ef4d25fae7dd3076c01cdd827f6419" exitCode=0 Jul 08 17:30:04.812565 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:04.812098 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd" event={"ID":"95a92ceb-81a2-4ba4-aa78-361d734e9d83","Type":"ContainerDied","Data":"b2b0f37af2852170facd0b2f56602efba1ef4d25fae7dd3076c01cdd827f6419"} Jul 08 17:30:05.953504 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:05.953476 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd" Jul 08 17:30:06.039524 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:06.039476 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tn8xx\" (UniqueName: \"kubernetes.io/projected/95a92ceb-81a2-4ba4-aa78-361d734e9d83-kube-api-access-tn8xx\") pod \"95a92ceb-81a2-4ba4-aa78-361d734e9d83\" (UID: \"95a92ceb-81a2-4ba4-aa78-361d734e9d83\") " Jul 08 17:30:06.041626 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:06.041595 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95a92ceb-81a2-4ba4-aa78-361d734e9d83-kube-api-access-tn8xx" (OuterVolumeSpecName: "kube-api-access-tn8xx") pod "95a92ceb-81a2-4ba4-aa78-361d734e9d83" (UID: "95a92ceb-81a2-4ba4-aa78-361d734e9d83"). InnerVolumeSpecName "kube-api-access-tn8xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:30:06.141050 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:06.141010 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tn8xx\" (UniqueName: \"kubernetes.io/projected/95a92ceb-81a2-4ba4-aa78-361d734e9d83-kube-api-access-tn8xx\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:30:06.821693 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:06.821663 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd" Jul 08 17:30:06.821858 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:06.821699 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725530-b6ljd" event={"ID":"95a92ceb-81a2-4ba4-aa78-361d734e9d83","Type":"ContainerDied","Data":"a70777421b5279204e68902cdf1b1a96109b9263cba2ce7c0e8b448a0edfb702"} Jul 08 17:30:06.821858 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:06.821750 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a70777421b5279204e68902cdf1b1a96109b9263cba2ce7c0e8b448a0edfb702" Jul 08 17:30:10.985224 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:10.985189 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:30:21.085870 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:21.085830 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:30:33.285248 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:33.285162 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:30:42.487714 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:42.487672 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:30:44.635891 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:44.635852 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:30:53.098385 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:30:53.098349 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:31:03.587731 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:31:03.587689 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:31:15.087525 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:31:15.087477 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:31:23.782764 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:31:23.782720 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:31:34.295601 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:31:34.295560 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:31:55.795149 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:31:55.795112 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:32:05.294703 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:32:05.294660 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:32:14.596482 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:32:14.596446 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:32:27.780170 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:32:27.780123 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:32:43.501640 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:32:43.501602 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:32:50.910452 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:32:50.910415 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:32:52.792292 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:32:52.792250 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:33:02.617259 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:33:02.617219 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:33:10.485553 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:33:10.485512 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:33:20.389768 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:33:20.389726 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:33:29.780459 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:33:29.780378 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:33:43.694732 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:33:43.694696 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:33:53.490337 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:33:53.490298 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:34:02.882995 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:34:02.882955 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:34:13.385007 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:34:13.384971 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:34:23.188206 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:34:23.188167 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:34:31.121100 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:34:31.121063 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:32.194216 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:34:32.194181 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:34:34.131890 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:34:34.131861 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:34:34.132336 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:34:34.131930 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:34:34.136257 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:34:34.136235 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:34:34.136439 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:34:34.136417 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:34:43.299601 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:34:43.299563 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:34:55.283783 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:34:55.283748 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:35:05.884406 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:05.884327 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:35:08.110357 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:08.110317 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:15.634642 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:15.634603 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:19.274603 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:19.274566 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:35:23.885364 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:23.885326 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:27.983740 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:27.983704 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:35:29.020398 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:29.020364 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:31.980727 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:31.980693 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:32.078429 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:32.078355 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:32.443438 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:32.443388 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:37.884196 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:37.884135 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:35:38.144520 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.144430 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:38.238982 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.238949 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:38.324062 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.324024 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr"] Jul 08 17:35:38.324569 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.324546 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95a92ceb-81a2-4ba4-aa78-361d734e9d83" containerName="cleanup" Jul 08 17:35:38.324680 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.324573 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="95a92ceb-81a2-4ba4-aa78-361d734e9d83" containerName="cleanup" Jul 08 17:35:38.324680 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.324664 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="95a92ceb-81a2-4ba4-aa78-361d734e9d83" containerName="cleanup" Jul 08 17:35:38.327876 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.327854 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.330295 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.330273 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-27f79031-openshift-default-dockercfg-k7djl\"" Jul 08 17:35:38.354050 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.354016 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr"] Jul 08 17:35:38.360492 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.360463 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:38.426905 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.426406 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:38.451174 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.451123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-workload-socket\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.451341 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.451194 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-data\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.451341 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.451240 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-workload-certs\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.451341 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.451259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-podinfo\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.451341 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.451328 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istiod-ca-cert\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.451479 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.451393 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdzpn\" (UniqueName: \"kubernetes.io/projected/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-kube-api-access-sdzpn\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.451479 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.451411 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-credential-socket\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.451479 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.451432 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-token\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.451479 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.451460 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-envoy\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.552900 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.552855 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdzpn\" (UniqueName: \"kubernetes.io/projected/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-kube-api-access-sdzpn\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.553095 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.552908 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-credential-socket\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.553095 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.553043 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-token\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.553477 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.553092 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-envoy\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.553477 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.553138 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-workload-socket\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.553477 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.553184 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-data\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.553477 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.553243 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-workload-certs\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.553477 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.553272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-podinfo\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.553477 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.553352 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-credential-socket\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.553477 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.553365 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istiod-ca-cert\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.553834 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.553530 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-workload-socket\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.553834 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.553578 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-data\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.553834 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.553691 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-workload-certs\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.553963 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.553944 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istiod-ca-cert\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.555384 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.555362 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-envoy\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.555760 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.555739 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-podinfo\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.562586 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.562564 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-token\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.562750 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.562729 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdzpn\" (UniqueName: \"kubernetes.io/projected/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-kube-api-access-sdzpn\") pod \"e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.639391 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.639353 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:38.778636 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.778612 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr"] Jul 08 17:35:38.780943 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:35:38.780911 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f4923c_e665_4ae9_97f7_7eb7d04ff019.slice/crio-e4ac8c9e834219b0a8b2fd8e4c3f317cbe6dc54644a901891cb8cdb5bc13cd26 WatchSource:0}: Error finding container e4ac8c9e834219b0a8b2fd8e4c3f317cbe6dc54644a901891cb8cdb5bc13cd26: Status 404 returned error can't find the container with id e4ac8c9e834219b0a8b2fd8e4c3f317cbe6dc54644a901891cb8cdb5bc13cd26 Jul 08 17:35:38.783087 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.783048 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:35:38.783166 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.783123 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:35:38.783217 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:38.783172 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:35:39.380861 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:39.380808 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" event={"ID":"b8f4923c-e665-4ae9-97f7-7eb7d04ff019","Type":"ContainerStarted","Data":"f7eb0dbffc2dbb25b7d486e62d8356d70a6911fff54123f532643dbaecd9f448"} Jul 08 17:35:39.381296 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:39.380878 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" event={"ID":"b8f4923c-e665-4ae9-97f7-7eb7d04ff019","Type":"ContainerStarted","Data":"e4ac8c9e834219b0a8b2fd8e4c3f317cbe6dc54644a901891cb8cdb5bc13cd26"} Jul 08 17:35:39.400417 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:39.400340 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" podStartSLOduration=1.400318879 podStartE2EDuration="1.400318879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:35:39.399109515 +0000 UTC m=+1565.800613947" watchObservedRunningTime="2026-07-08 17:35:39.400318879 +0000 UTC m=+1565.801823362" Jul 08 17:35:39.551300 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:39.551263 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:39.640429 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:39.640353 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:39.645490 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:39.645465 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:40.102427 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:40.102344 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:40.202386 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:40.202347 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:40.302524 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:40.302487 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:40.385078 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:40.385050 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:40.386147 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:40.386130 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:40.403812 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:40.403782 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:42.476523 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:42.476493 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:49.685415 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:49.685378 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:35:51.441534 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:51.441494 2567 generic.go:356] "Generic (PLEG): container finished" podID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" containerID="f7eb0dbffc2dbb25b7d486e62d8356d70a6911fff54123f532643dbaecd9f448" exitCode=0 Jul 08 17:35:51.441967 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:51.441586 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" event={"ID":"b8f4923c-e665-4ae9-97f7-7eb7d04ff019","Type":"ContainerDied","Data":"f7eb0dbffc2dbb25b7d486e62d8356d70a6911fff54123f532643dbaecd9f448"} Jul 08 17:35:51.442122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:51.442105 2567 scope.go:117] "RemoveContainer" containerID="f7eb0dbffc2dbb25b7d486e62d8356d70a6911fff54123f532643dbaecd9f448" Jul 08 17:35:51.443242 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:51.443199 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:35:51.443355 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:51.443269 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:35:51.443355 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:51.443309 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:35:52.453606 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:52.453567 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" event={"ID":"b8f4923c-e665-4ae9-97f7-7eb7d04ff019","Type":"ContainerStarted","Data":"a5e66dc856baf4f949da0cb11709121ceea2ee1a7a28c82502ab569ebf83a11c"} Jul 08 17:35:52.639582 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:52.639532 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:52.641030 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:52.640992 2567 patch_prober.go:28] interesting pod/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 08 17:35:52.641206 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:52.641068 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" podUID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 08 17:35:53.641174 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:53.640674 2567 patch_prober.go:28] interesting pod/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 08 17:35:53.641174 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:53.640744 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" podUID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 08 17:35:54.640756 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:54.640715 2567 patch_prober.go:28] interesting pod/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 08 17:35:54.641083 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:54.641049 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" podUID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 08 17:35:55.385148 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:55.385113 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:55.640722 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:55.640615 2567 patch_prober.go:28] interesting pod/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 08 17:35:55.640722 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:55.640686 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" podUID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 08 17:35:56.643802 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:56.643766 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:35:56.644953 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:35:56.644928 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:36:36.270701 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:36.270626 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:36.372028 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:36.371987 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:44.667062 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:44.667027 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr"] Jul 08 17:36:44.667500 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:44.667234 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" podUID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" containerName="istio-proxy" containerID="cri-o://a5e66dc856baf4f949da0cb11709121ceea2ee1a7a28c82502ab569ebf83a11c" gracePeriod=30 Jul 08 17:36:44.693910 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:44.693876 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:44.809969 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:44.809936 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:47.387006 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:47.386965 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:36:49.928449 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:49.928391 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:36:50.015639 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.015612 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-envoy\") pod \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " Jul 08 17:36:50.015812 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.015653 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-workload-socket\") pod \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " Jul 08 17:36:50.015812 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.015716 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-podinfo\") pod \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " Jul 08 17:36:50.015812 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.015734 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdzpn\" (UniqueName: \"kubernetes.io/projected/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-kube-api-access-sdzpn\") pod \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " Jul 08 17:36:50.015812 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.015763 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-data\") pod \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " Jul 08 17:36:50.015812 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.015786 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istiod-ca-cert\") pod \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " Jul 08 17:36:50.016087 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.015857 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-workload-certs\") pod \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " Jul 08 17:36:50.016087 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.015883 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-credential-socket\") pod \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " Jul 08 17:36:50.016087 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.015910 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-token\") pod \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\" (UID: \"b8f4923c-e665-4ae9-97f7-7eb7d04ff019\") " Jul 08 17:36:50.016087 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.016035 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8f4923c-e665-4ae9-97f7-7eb7d04ff019" (UID: "b8f4923c-e665-4ae9-97f7-7eb7d04ff019"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:36:50.016384 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.016312 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8f4923c-e665-4ae9-97f7-7eb7d04ff019" (UID: "b8f4923c-e665-4ae9-97f7-7eb7d04ff019"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:36:50.016384 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.016327 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-workload-socket\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:36:50.016384 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.016362 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8f4923c-e665-4ae9-97f7-7eb7d04ff019" (UID: "b8f4923c-e665-4ae9-97f7-7eb7d04ff019"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:36:50.016562 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.016489 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8f4923c-e665-4ae9-97f7-7eb7d04ff019" (UID: "b8f4923c-e665-4ae9-97f7-7eb7d04ff019"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:36:50.017137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.017104 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8f4923c-e665-4ae9-97f7-7eb7d04ff019" (UID: "b8f4923c-e665-4ae9-97f7-7eb7d04ff019"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:36:50.018379 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.018342 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8f4923c-e665-4ae9-97f7-7eb7d04ff019" (UID: "b8f4923c-e665-4ae9-97f7-7eb7d04ff019"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:36:50.018487 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.018432 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8f4923c-e665-4ae9-97f7-7eb7d04ff019" (UID: "b8f4923c-e665-4ae9-97f7-7eb7d04ff019"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:36:50.018487 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.018437 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8f4923c-e665-4ae9-97f7-7eb7d04ff019" (UID: "b8f4923c-e665-4ae9-97f7-7eb7d04ff019"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:36:50.018797 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.018776 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-kube-api-access-sdzpn" (OuterVolumeSpecName: "kube-api-access-sdzpn") pod "b8f4923c-e665-4ae9-97f7-7eb7d04ff019" (UID: "b8f4923c-e665-4ae9-97f7-7eb7d04ff019"). InnerVolumeSpecName "kube-api-access-sdzpn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:36:50.117282 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.117244 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-workload-certs\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:36:50.117282 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.117277 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-credential-socket\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:36:50.117505 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.117292 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-token\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:36:50.117505 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.117303 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-envoy\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:36:50.117505 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.117315 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-podinfo\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:36:50.117505 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.117326 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdzpn\" (UniqueName: \"kubernetes.io/projected/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-kube-api-access-sdzpn\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:36:50.117505 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.117337 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istio-data\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:36:50.117505 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.117348 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f4923c-e665-4ae9-97f7-7eb7d04ff019-istiod-ca-cert\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:36:50.400863 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.400825 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:50.678738 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.678700 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:50.737765 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.737728 2567 generic.go:356] "Generic (PLEG): container finished" podID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" containerID="a5e66dc856baf4f949da0cb11709121ceea2ee1a7a28c82502ab569ebf83a11c" exitCode=0 Jul 08 17:36:50.737934 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.737780 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" Jul 08 17:36:50.737934 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.737818 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" event={"ID":"b8f4923c-e665-4ae9-97f7-7eb7d04ff019","Type":"ContainerDied","Data":"a5e66dc856baf4f949da0cb11709121ceea2ee1a7a28c82502ab569ebf83a11c"} Jul 08 17:36:50.737934 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.737873 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr" event={"ID":"b8f4923c-e665-4ae9-97f7-7eb7d04ff019","Type":"ContainerDied","Data":"e4ac8c9e834219b0a8b2fd8e4c3f317cbe6dc54644a901891cb8cdb5bc13cd26"} Jul 08 17:36:50.737934 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.737896 2567 scope.go:117] "RemoveContainer" containerID="a5e66dc856baf4f949da0cb11709121ceea2ee1a7a28c82502ab569ebf83a11c" Jul 08 17:36:50.746966 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.746946 2567 scope.go:117] "RemoveContainer" containerID="f7eb0dbffc2dbb25b7d486e62d8356d70a6911fff54123f532643dbaecd9f448" Jul 08 17:36:50.754837 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.754816 2567 scope.go:117] "RemoveContainer" containerID="a5e66dc856baf4f949da0cb11709121ceea2ee1a7a28c82502ab569ebf83a11c" Jul 08 17:36:50.755174 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:36:50.755124 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5e66dc856baf4f949da0cb11709121ceea2ee1a7a28c82502ab569ebf83a11c\": container with ID starting with a5e66dc856baf4f949da0cb11709121ceea2ee1a7a28c82502ab569ebf83a11c not found: ID does not exist" containerID="a5e66dc856baf4f949da0cb11709121ceea2ee1a7a28c82502ab569ebf83a11c" Jul 08 17:36:50.755295 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.755181 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e66dc856baf4f949da0cb11709121ceea2ee1a7a28c82502ab569ebf83a11c"} err="failed to get container status \"a5e66dc856baf4f949da0cb11709121ceea2ee1a7a28c82502ab569ebf83a11c\": rpc error: code = NotFound desc = could not find container \"a5e66dc856baf4f949da0cb11709121ceea2ee1a7a28c82502ab569ebf83a11c\": container with ID starting with a5e66dc856baf4f949da0cb11709121ceea2ee1a7a28c82502ab569ebf83a11c not found: ID does not exist" Jul 08 17:36:50.755295 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.755205 2567 scope.go:117] "RemoveContainer" containerID="f7eb0dbffc2dbb25b7d486e62d8356d70a6911fff54123f532643dbaecd9f448" Jul 08 17:36:50.755509 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:36:50.755487 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7eb0dbffc2dbb25b7d486e62d8356d70a6911fff54123f532643dbaecd9f448\": container with ID starting with f7eb0dbffc2dbb25b7d486e62d8356d70a6911fff54123f532643dbaecd9f448 not found: ID does not exist" containerID="f7eb0dbffc2dbb25b7d486e62d8356d70a6911fff54123f532643dbaecd9f448" Jul 08 17:36:50.755550 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.755534 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7eb0dbffc2dbb25b7d486e62d8356d70a6911fff54123f532643dbaecd9f448"} err="failed to get container status \"f7eb0dbffc2dbb25b7d486e62d8356d70a6911fff54123f532643dbaecd9f448\": rpc error: code = NotFound desc = could not find container \"f7eb0dbffc2dbb25b7d486e62d8356d70a6911fff54123f532643dbaecd9f448\": container with ID starting with f7eb0dbffc2dbb25b7d486e62d8356d70a6911fff54123f532643dbaecd9f448 not found: ID does not exist" Jul 08 17:36:50.757197 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.757176 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr"] Jul 08 17:36:50.762979 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:50.762949 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-27f79031-openshift-default-547d48c4cc-mggsr"] Jul 08 17:36:51.037066 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:51.037031 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:52.259789 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:52.259753 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" path="/var/lib/kubelet/pods/b8f4923c-e665-4ae9-97f7-7eb7d04ff019/volumes" Jul 08 17:36:56.119536 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.119502 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:56.220030 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.219996 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:56.410734 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.410697 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4"] Jul 08 17:36:56.411059 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.411047 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" containerName="istio-proxy" Jul 08 17:36:56.411113 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.411061 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" containerName="istio-proxy" Jul 08 17:36:56.411113 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.411069 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" containerName="istio-proxy" Jul 08 17:36:56.411113 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.411075 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" containerName="istio-proxy" Jul 08 17:36:56.411227 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.411142 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" containerName="istio-proxy" Jul 08 17:36:56.411227 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.411177 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8f4923c-e665-4ae9-97f7-7eb7d04ff019" containerName="istio-proxy" Jul 08 17:36:56.414696 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.414674 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.417829 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.417778 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-220a4915-openshift-default-dockercfg-qz8jh\"" Jul 08 17:36:56.446170 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.446132 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4"] Jul 08 17:36:56.504818 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.504786 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:56.575368 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.575336 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7zrn\" (UniqueName: \"kubernetes.io/projected/dd629e33-af0e-4f72-b787-a40efd75bdbf-kube-api-access-z7zrn\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.575536 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.575387 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-podinfo\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.575536 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.575435 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-workload-certs\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.575536 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.575474 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-envoy\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.575536 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.575499 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-data\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.575536 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.575526 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-workload-socket\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.575701 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.575540 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-credential-socket\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.575701 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.575599 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd629e33-af0e-4f72-b787-a40efd75bdbf-istiod-ca-cert\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.575701 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.575628 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-token\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.594217 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.594142 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:56.676683 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.676600 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7zrn\" (UniqueName: \"kubernetes.io/projected/dd629e33-af0e-4f72-b787-a40efd75bdbf-kube-api-access-z7zrn\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.676683 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.676652 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-podinfo\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.676886 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.676763 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-workload-certs\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.676886 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.676800 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-envoy\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.676886 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.676818 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-data\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.676886 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.676838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-workload-socket\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.676886 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.676859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-credential-socket\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.677186 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.676921 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd629e33-af0e-4f72-b787-a40efd75bdbf-istiod-ca-cert\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.677186 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.676952 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-token\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.677329 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.677203 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-workload-certs\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.677329 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.677287 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-data\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.677433 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.677349 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-credential-socket\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.677514 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.677491 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-workload-socket\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.677662 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.677643 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd629e33-af0e-4f72-b787-a40efd75bdbf-istiod-ca-cert\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.679220 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.679200 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-envoy\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.679364 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.679348 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-podinfo\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.684815 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.684792 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-token\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.684904 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.684861 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7zrn\" (UniqueName: \"kubernetes.io/projected/dd629e33-af0e-4f72-b787-a40efd75bdbf-kube-api-access-z7zrn\") pod \"e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.725308 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.725281 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:56.868362 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.868312 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4"] Jul 08 17:36:56.870606 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:36:56.870576 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd629e33_af0e_4f72_b787_a40efd75bdbf.slice/crio-d02f70e44543458cd8a2e83980c288dede0ff10b750a47136ade35f27d96aaa3 WatchSource:0}: Error finding container d02f70e44543458cd8a2e83980c288dede0ff10b750a47136ade35f27d96aaa3: Status 404 returned error can't find the container with id d02f70e44543458cd8a2e83980c288dede0ff10b750a47136ade35f27d96aaa3 Jul 08 17:36:56.872778 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.872739 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:36:56.872848 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.872812 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:36:56.872848 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:56.872839 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:36:57.773880 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:57.773841 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" event={"ID":"dd629e33-af0e-4f72-b787-a40efd75bdbf","Type":"ContainerStarted","Data":"95fd1d20579cf23161d0fd08b8c74391cecc7cf12666ebe8b3155ce4b3c913e2"} Jul 08 17:36:57.774388 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:57.773902 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" event={"ID":"dd629e33-af0e-4f72-b787-a40efd75bdbf","Type":"ContainerStarted","Data":"d02f70e44543458cd8a2e83980c288dede0ff10b750a47136ade35f27d96aaa3"} Jul 08 17:36:57.793106 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:57.793047 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" podStartSLOduration=1.793028015 podStartE2EDuration="1.793028015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:36:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:36:57.792544074 +0000 UTC m=+1644.194048493" watchObservedRunningTime="2026-07-08 17:36:57.793028015 +0000 UTC m=+1644.194532436" Jul 08 17:36:58.725755 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:58.725718 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:58.730678 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:58.730649 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:58.779118 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:58.779083 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:36:58.780107 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:36:58.780084 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:37:00.476672 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:37:00.476633 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:38:53.157820 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:38:53.157780 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:38:54.589307 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:38:54.589273 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:39:34.166981 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:39:34.166946 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:39:34.167576 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:39:34.167553 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:39:34.171639 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:39:34.171614 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:39:34.172328 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:39:34.172302 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:40:01.234669 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.234632 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4"] Jul 08 17:40:01.235101 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.234908 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" podUID="dd629e33-af0e-4f72-b787-a40efd75bdbf" containerName="istio-proxy" containerID="cri-o://95fd1d20579cf23161d0fd08b8c74391cecc7cf12666ebe8b3155ce4b3c913e2" gracePeriod=30 Jul 08 17:40:01.267346 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.267303 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:40:01.584763 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.584656 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx"] Jul 08 17:40:01.587565 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.587537 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.590098 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.590073 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-9a3a2f79-openshift-default-dockercfg-pp6x7\"" Jul 08 17:40:01.599670 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.599642 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx"] Jul 08 17:40:01.609063 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.609036 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:40:01.718783 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.718744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-workload-certs\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.718783 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.718782 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-workload-socket\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.718995 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.718799 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-podinfo\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.718995 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.718819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-envoy\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.718995 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.718840 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-token\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.718995 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.718897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-data\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.718995 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.718942 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istiod-ca-cert\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.718995 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.718976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-credential-socket\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.719231 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.718998 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfpb4\" (UniqueName: \"kubernetes.io/projected/ac355541-d045-4fe7-8ed2-874b4cfd09fd-kube-api-access-gfpb4\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.820360 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.820321 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-workload-certs\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.820360 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.820360 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-workload-socket\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.820566 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.820379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-podinfo\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.820608 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.820572 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-envoy\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.820608 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.820604 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-token\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.820698 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.820634 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-data\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.820698 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.820666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istiod-ca-cert\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.820796 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.820708 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-credential-socket\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.820796 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.820736 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfpb4\" (UniqueName: \"kubernetes.io/projected/ac355541-d045-4fe7-8ed2-874b4cfd09fd-kube-api-access-gfpb4\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.820888 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.820793 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-workload-socket\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.820888 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.820813 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-workload-certs\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.821197 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.821146 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-data\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.821301 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.821281 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-credential-socket\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.821518 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.821494 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istiod-ca-cert\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.822830 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.822807 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-envoy\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.823048 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.823030 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-podinfo\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.828769 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.828735 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-token\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.829384 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.829361 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfpb4\" (UniqueName: \"kubernetes.io/projected/ac355541-d045-4fe7-8ed2-874b4cfd09fd-kube-api-access-gfpb4\") pod \"e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:01.899241 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:01.899202 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:02.047359 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:02.047329 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx"] Jul 08 17:40:02.051964 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:40:02.051930 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac355541_d045_4fe7_8ed2_874b4cfd09fd.slice/crio-7777fa3161c8837c1a36235dad7f0b004ebfd0c97ca45a412fc955840b02b296 WatchSource:0}: Error finding container 7777fa3161c8837c1a36235dad7f0b004ebfd0c97ca45a412fc955840b02b296: Status 404 returned error can't find the container with id 7777fa3161c8837c1a36235dad7f0b004ebfd0c97ca45a412fc955840b02b296 Jul 08 17:40:02.054417 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:02.054381 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:40:02.054629 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:02.054454 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:40:02.054629 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:02.054489 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:40:02.646442 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:02.646407 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" event={"ID":"ac355541-d045-4fe7-8ed2-874b4cfd09fd","Type":"ContainerStarted","Data":"af4f544488bd01fed088fc4cff8e65d09f5852f198133c9ea45fb58e02f76827"} Jul 08 17:40:02.646872 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:02.646467 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" event={"ID":"ac355541-d045-4fe7-8ed2-874b4cfd09fd","Type":"ContainerStarted","Data":"7777fa3161c8837c1a36235dad7f0b004ebfd0c97ca45a412fc955840b02b296"} Jul 08 17:40:02.670675 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:02.670617 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" podStartSLOduration=1.670600137 podStartE2EDuration="1.670600137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:40:02.670363697 +0000 UTC m=+1829.071868117" watchObservedRunningTime="2026-07-08 17:40:02.670600137 +0000 UTC m=+1829.072104556" Jul 08 17:40:02.900090 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:02.899999 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:03.905316 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:03.905279 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:04.656241 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:04.656207 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:04.657306 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:04.657283 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:40:05.398350 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:05.398314 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:40:06.489983 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.489955 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:40:06.568144 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568115 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-workload-certs\") pod \"dd629e33-af0e-4f72-b787-a40efd75bdbf\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " Jul 08 17:40:06.568144 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568162 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-credential-socket\") pod \"dd629e33-af0e-4f72-b787-a40efd75bdbf\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " Jul 08 17:40:06.568445 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568197 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd629e33-af0e-4f72-b787-a40efd75bdbf-istiod-ca-cert\") pod \"dd629e33-af0e-4f72-b787-a40efd75bdbf\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " Jul 08 17:40:06.568445 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568261 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7zrn\" (UniqueName: \"kubernetes.io/projected/dd629e33-af0e-4f72-b787-a40efd75bdbf-kube-api-access-z7zrn\") pod \"dd629e33-af0e-4f72-b787-a40efd75bdbf\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " Jul 08 17:40:06.568445 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568283 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-token\") pod \"dd629e33-af0e-4f72-b787-a40efd75bdbf\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " Jul 08 17:40:06.568445 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568340 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-envoy\") pod \"dd629e33-af0e-4f72-b787-a40efd75bdbf\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " Jul 08 17:40:06.568445 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568365 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-data\") pod \"dd629e33-af0e-4f72-b787-a40efd75bdbf\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " Jul 08 17:40:06.568445 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568393 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-podinfo\") pod \"dd629e33-af0e-4f72-b787-a40efd75bdbf\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " Jul 08 17:40:06.568445 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568419 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-workload-socket\") pod \"dd629e33-af0e-4f72-b787-a40efd75bdbf\" (UID: \"dd629e33-af0e-4f72-b787-a40efd75bdbf\") " Jul 08 17:40:06.568445 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568398 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd629e33-af0e-4f72-b787-a40efd75bdbf" (UID: "dd629e33-af0e-4f72-b787-a40efd75bdbf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:40:06.568445 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568435 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd629e33-af0e-4f72-b787-a40efd75bdbf" (UID: "dd629e33-af0e-4f72-b787-a40efd75bdbf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:40:06.568867 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568652 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd629e33-af0e-4f72-b787-a40efd75bdbf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd629e33-af0e-4f72-b787-a40efd75bdbf" (UID: "dd629e33-af0e-4f72-b787-a40efd75bdbf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:40:06.568867 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568745 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-workload-certs\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:40:06.568867 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568700 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd629e33-af0e-4f72-b787-a40efd75bdbf" (UID: "dd629e33-af0e-4f72-b787-a40efd75bdbf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:40:06.568867 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568768 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-credential-socket\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:40:06.569054 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.568906 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd629e33-af0e-4f72-b787-a40efd75bdbf" (UID: "dd629e33-af0e-4f72-b787-a40efd75bdbf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:40:06.571020 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.570979 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd629e33-af0e-4f72-b787-a40efd75bdbf" (UID: "dd629e33-af0e-4f72-b787-a40efd75bdbf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:40:06.571118 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.571033 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd629e33-af0e-4f72-b787-a40efd75bdbf" (UID: "dd629e33-af0e-4f72-b787-a40efd75bdbf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:40:06.571118 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.571068 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd629e33-af0e-4f72-b787-a40efd75bdbf" (UID: "dd629e33-af0e-4f72-b787-a40efd75bdbf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:40:06.571118 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.571099 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd629e33-af0e-4f72-b787-a40efd75bdbf-kube-api-access-z7zrn" (OuterVolumeSpecName: "kube-api-access-z7zrn") pod "dd629e33-af0e-4f72-b787-a40efd75bdbf" (UID: "dd629e33-af0e-4f72-b787-a40efd75bdbf"). InnerVolumeSpecName "kube-api-access-z7zrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:40:06.666365 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.666325 2567 generic.go:356] "Generic (PLEG): container finished" podID="dd629e33-af0e-4f72-b787-a40efd75bdbf" containerID="95fd1d20579cf23161d0fd08b8c74391cecc7cf12666ebe8b3155ce4b3c913e2" exitCode=0 Jul 08 17:40:06.666561 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.666385 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" Jul 08 17:40:06.666561 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.666412 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" event={"ID":"dd629e33-af0e-4f72-b787-a40efd75bdbf","Type":"ContainerDied","Data":"95fd1d20579cf23161d0fd08b8c74391cecc7cf12666ebe8b3155ce4b3c913e2"} Jul 08 17:40:06.666561 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.666483 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4" event={"ID":"dd629e33-af0e-4f72-b787-a40efd75bdbf","Type":"ContainerDied","Data":"d02f70e44543458cd8a2e83980c288dede0ff10b750a47136ade35f27d96aaa3"} Jul 08 17:40:06.666561 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.666506 2567 scope.go:117] "RemoveContainer" containerID="95fd1d20579cf23161d0fd08b8c74391cecc7cf12666ebe8b3155ce4b3c913e2" Jul 08 17:40:06.669344 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.669320 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7zrn\" (UniqueName: \"kubernetes.io/projected/dd629e33-af0e-4f72-b787-a40efd75bdbf-kube-api-access-z7zrn\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:40:06.669344 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.669344 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-token\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:40:06.669505 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.669358 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-envoy\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:40:06.669505 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.669370 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-data\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:40:06.669505 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.669381 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd629e33-af0e-4f72-b787-a40efd75bdbf-istio-podinfo\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:40:06.669505 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.669392 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd629e33-af0e-4f72-b787-a40efd75bdbf-workload-socket\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:40:06.669505 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.669405 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd629e33-af0e-4f72-b787-a40efd75bdbf-istiod-ca-cert\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:40:06.676314 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.676259 2567 scope.go:117] "RemoveContainer" containerID="95fd1d20579cf23161d0fd08b8c74391cecc7cf12666ebe8b3155ce4b3c913e2" Jul 08 17:40:06.676544 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:40:06.676525 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95fd1d20579cf23161d0fd08b8c74391cecc7cf12666ebe8b3155ce4b3c913e2\": container with ID starting with 95fd1d20579cf23161d0fd08b8c74391cecc7cf12666ebe8b3155ce4b3c913e2 not found: ID does not exist" containerID="95fd1d20579cf23161d0fd08b8c74391cecc7cf12666ebe8b3155ce4b3c913e2" Jul 08 17:40:06.676588 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.676555 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95fd1d20579cf23161d0fd08b8c74391cecc7cf12666ebe8b3155ce4b3c913e2"} err="failed to get container status \"95fd1d20579cf23161d0fd08b8c74391cecc7cf12666ebe8b3155ce4b3c913e2\": rpc error: code = NotFound desc = could not find container \"95fd1d20579cf23161d0fd08b8c74391cecc7cf12666ebe8b3155ce4b3c913e2\": container with ID starting with 95fd1d20579cf23161d0fd08b8c74391cecc7cf12666ebe8b3155ce4b3c913e2 not found: ID does not exist" Jul 08 17:40:06.688648 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.688618 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4"] Jul 08 17:40:06.692511 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:06.692480 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-220a4915-openshift-default-56cdfc9dcf-r4kj4"] Jul 08 17:40:08.259505 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:08.259469 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd629e33-af0e-4f72-b787-a40efd75bdbf" path="/var/lib/kubelet/pods/dd629e33-af0e-4f72-b787-a40efd75bdbf/volumes" Jul 08 17:40:13.522585 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:13.522538 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:40:13.625126 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:13.625088 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:40:16.618272 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:40:16.618231 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:01.829617 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:41:01.829537 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:40.640700 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:41:40.640662 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:04.990419 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:04.990378 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx"] Jul 08 17:42:04.991034 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:04.990592 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" podUID="ac355541-d045-4fe7-8ed2-874b4cfd09fd" containerName="istio-proxy" containerID="cri-o://af4f544488bd01fed088fc4cff8e65d09f5852f198133c9ea45fb58e02f76827" gracePeriod=30 Jul 08 17:42:05.021765 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:05.021722 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:05.666271 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:05.666220 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:05.765287 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:05.765250 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:05.867330 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:05.867299 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:07.419445 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:07.419406 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:10.243403 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.243377 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:42:10.255640 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.255561 2567 generic.go:356] "Generic (PLEG): container finished" podID="ac355541-d045-4fe7-8ed2-874b4cfd09fd" containerID="af4f544488bd01fed088fc4cff8e65d09f5852f198133c9ea45fb58e02f76827" exitCode=0 Jul 08 17:42:10.255768 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.255663 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" Jul 08 17:42:10.261386 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.261358 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" event={"ID":"ac355541-d045-4fe7-8ed2-874b4cfd09fd","Type":"ContainerDied","Data":"af4f544488bd01fed088fc4cff8e65d09f5852f198133c9ea45fb58e02f76827"} Jul 08 17:42:10.261519 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.261406 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx" event={"ID":"ac355541-d045-4fe7-8ed2-874b4cfd09fd","Type":"ContainerDied","Data":"7777fa3161c8837c1a36235dad7f0b004ebfd0c97ca45a412fc955840b02b296"} Jul 08 17:42:10.261519 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.261435 2567 scope.go:117] "RemoveContainer" containerID="af4f544488bd01fed088fc4cff8e65d09f5852f198133c9ea45fb58e02f76827" Jul 08 17:42:10.271541 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.271491 2567 scope.go:117] "RemoveContainer" containerID="af4f544488bd01fed088fc4cff8e65d09f5852f198133c9ea45fb58e02f76827" Jul 08 17:42:10.271819 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:42:10.271789 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af4f544488bd01fed088fc4cff8e65d09f5852f198133c9ea45fb58e02f76827\": container with ID starting with af4f544488bd01fed088fc4cff8e65d09f5852f198133c9ea45fb58e02f76827 not found: ID does not exist" containerID="af4f544488bd01fed088fc4cff8e65d09f5852f198133c9ea45fb58e02f76827" Jul 08 17:42:10.271938 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.271830 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af4f544488bd01fed088fc4cff8e65d09f5852f198133c9ea45fb58e02f76827"} err="failed to get container status \"af4f544488bd01fed088fc4cff8e65d09f5852f198133c9ea45fb58e02f76827\": rpc error: code = NotFound desc = could not find container \"af4f544488bd01fed088fc4cff8e65d09f5852f198133c9ea45fb58e02f76827\": container with ID starting with af4f544488bd01fed088fc4cff8e65d09f5852f198133c9ea45fb58e02f76827 not found: ID does not exist" Jul 08 17:42:10.282260 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.282228 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-podinfo\") pod \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " Jul 08 17:42:10.282408 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.282265 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfpb4\" (UniqueName: \"kubernetes.io/projected/ac355541-d045-4fe7-8ed2-874b4cfd09fd-kube-api-access-gfpb4\") pod \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " Jul 08 17:42:10.282408 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.282288 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-credential-socket\") pod \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " Jul 08 17:42:10.282408 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.282322 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-workload-certs\") pod \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " Jul 08 17:42:10.282408 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.282370 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-token\") pod \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " Jul 08 17:42:10.282773 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.282691 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac355541-d045-4fe7-8ed2-874b4cfd09fd" (UID: "ac355541-d045-4fe7-8ed2-874b4cfd09fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:42:10.282773 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.282710 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac355541-d045-4fe7-8ed2-874b4cfd09fd" (UID: "ac355541-d045-4fe7-8ed2-874b4cfd09fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:42:10.282773 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.282759 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-data\") pod \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " Jul 08 17:42:10.282968 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.282819 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-envoy\") pod \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " Jul 08 17:42:10.282968 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.282845 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istiod-ca-cert\") pod \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " Jul 08 17:42:10.282968 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.282951 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-workload-socket\") pod \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\" (UID: \"ac355541-d045-4fe7-8ed2-874b4cfd09fd\") " Jul 08 17:42:10.283282 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.282950 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac355541-d045-4fe7-8ed2-874b4cfd09fd" (UID: "ac355541-d045-4fe7-8ed2-874b4cfd09fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:42:10.283378 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.283130 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac355541-d045-4fe7-8ed2-874b4cfd09fd" (UID: "ac355541-d045-4fe7-8ed2-874b4cfd09fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:42:10.283378 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.283255 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac355541-d045-4fe7-8ed2-874b4cfd09fd" (UID: "ac355541-d045-4fe7-8ed2-874b4cfd09fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:42:10.283682 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.283606 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-workload-certs\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:42:10.283682 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.283629 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-data\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:42:10.283682 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.283641 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istiod-ca-cert\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:42:10.283682 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.283653 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-workload-socket\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:42:10.283682 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.283666 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-credential-socket\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:42:10.284747 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.284714 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac355541-d045-4fe7-8ed2-874b4cfd09fd" (UID: "ac355541-d045-4fe7-8ed2-874b4cfd09fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:42:10.286398 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.286372 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac355541-d045-4fe7-8ed2-874b4cfd09fd" (UID: "ac355541-d045-4fe7-8ed2-874b4cfd09fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:42:10.286510 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.286373 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac355541-d045-4fe7-8ed2-874b4cfd09fd" (UID: "ac355541-d045-4fe7-8ed2-874b4cfd09fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:42:10.286510 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.286402 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac355541-d045-4fe7-8ed2-874b4cfd09fd-kube-api-access-gfpb4" (OuterVolumeSpecName: "kube-api-access-gfpb4") pod "ac355541-d045-4fe7-8ed2-874b4cfd09fd" (UID: "ac355541-d045-4fe7-8ed2-874b4cfd09fd"). InnerVolumeSpecName "kube-api-access-gfpb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:42:10.384885 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.384843 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-token\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:42:10.384885 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.384880 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-envoy\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:42:10.384885 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.384893 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac355541-d045-4fe7-8ed2-874b4cfd09fd-istio-podinfo\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:42:10.385117 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.384906 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfpb4\" (UniqueName: \"kubernetes.io/projected/ac355541-d045-4fe7-8ed2-874b4cfd09fd-kube-api-access-gfpb4\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:42:10.581515 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.581481 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx"] Jul 08 17:42:10.584857 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:10.584829 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-9a3a2f79-openshift-default-5b9cb5646c-wlktx"] Jul 08 17:42:12.260719 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:12.260683 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac355541-d045-4fe7-8ed2-874b4cfd09fd" path="/var/lib/kubelet/pods/ac355541-d045-4fe7-8ed2-874b4cfd09fd/volumes" Jul 08 17:42:13.239002 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:13.238959 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:13.306220 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:13.306178 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:13.391662 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:13.391628 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:13.491471 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:13.491371 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:13.988519 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:13.988481 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:16.756191 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:16.756132 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:40.004550 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:40.004512 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:45.642111 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:45.642071 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:45.719437 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:45.719393 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:45.815493 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:45.815453 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:45.909119 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:42:45.909030 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:01.765953 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:01.765898 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:07.755909 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:07.755862 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:07.861248 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:07.861206 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:07.956810 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:07.956771 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:18.542463 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:18.542420 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:19.660522 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:19.660483 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:25.090552 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:25.090510 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:25.190477 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:25.190433 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:25.287488 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:25.287448 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:25.389419 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:25.389388 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:26.241416 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:26.241372 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:26.332042 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:26.331999 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:26.431917 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:26.431882 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:27.389262 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:27.389222 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:43:28.127631 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:28.127595 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:33.854434 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:33.854397 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:33.935826 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:33.935795 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:34.564804 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:34.564769 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:36.584578 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:36.584538 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:43:40.340632 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.340588 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:40.408200 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.408143 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:40.673069 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.673010 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:40.926648 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.926572 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj"] Jul 08 17:43:40.926930 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.926918 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd629e33-af0e-4f72-b787-a40efd75bdbf" containerName="istio-proxy" Jul 08 17:43:40.926977 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.926931 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd629e33-af0e-4f72-b787-a40efd75bdbf" containerName="istio-proxy" Jul 08 17:43:40.926977 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.926940 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac355541-d045-4fe7-8ed2-874b4cfd09fd" containerName="istio-proxy" Jul 08 17:43:40.926977 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.926946 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac355541-d045-4fe7-8ed2-874b4cfd09fd" containerName="istio-proxy" Jul 08 17:43:40.927072 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.927018 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd629e33-af0e-4f72-b787-a40efd75bdbf" containerName="istio-proxy" Jul 08 17:43:40.927072 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.927032 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac355541-d045-4fe7-8ed2-874b4cfd09fd" containerName="istio-proxy" Jul 08 17:43:40.929952 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.929934 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:40.932408 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.932391 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d52bb8d4-openshift-default-dockercfg-pnzpz\"" Jul 08 17:43:40.957441 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.956409 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj"] Jul 08 17:43:40.958522 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:40.958491 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:41.007729 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.007673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-data\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.007933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.007781 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-envoy\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.007933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.007806 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xbjx\" (UniqueName: \"kubernetes.io/projected/80fac4bd-f628-4d69-b395-a69562c6bbf4-kube-api-access-8xbjx\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.007933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.007848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-workload-certs\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.007933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.007874 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-token\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.007933 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.007900 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-workload-socket\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.008261 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.008026 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-podinfo\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.008261 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.008079 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-credential-socket\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.008261 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.008139 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80fac4bd-f628-4d69-b395-a69562c6bbf4-istiod-ca-cert\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.101594 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.101561 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:41.109526 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.109483 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80fac4bd-f628-4d69-b395-a69562c6bbf4-istiod-ca-cert\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.109526 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.109529 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-data\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.109734 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.109581 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-envoy\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.109734 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.109598 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xbjx\" (UniqueName: \"kubernetes.io/projected/80fac4bd-f628-4d69-b395-a69562c6bbf4-kube-api-access-8xbjx\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.109734 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.109624 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-workload-certs\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.109734 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.109642 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-token\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.109734 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.109662 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-workload-socket\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.109987 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.109741 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-podinfo\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.109987 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.109796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-credential-socket\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.110137 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.110112 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-data\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.110239 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.110197 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-credential-socket\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.110304 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.110283 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-workload-socket\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.110357 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.110333 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80fac4bd-f628-4d69-b395-a69562c6bbf4-istiod-ca-cert\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.110409 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.110367 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-workload-certs\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.111936 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.111917 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-envoy\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.112185 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.112145 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-podinfo\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.118468 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.118438 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-token\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.118625 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.118602 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xbjx\" (UniqueName: \"kubernetes.io/projected/80fac4bd-f628-4d69-b395-a69562c6bbf4-kube-api-access-8xbjx\") pod \"e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.240400 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.240302 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:41.380716 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.380684 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj"] Jul 08 17:43:41.382137 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:43:41.382109 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80fac4bd_f628_4d69_b395_a69562c6bbf4.slice/crio-72a5cbf975eae2854d862fe23bc8284475c90261224910ee4bc3d0134c4e4eeb WatchSource:0}: Error finding container 72a5cbf975eae2854d862fe23bc8284475c90261224910ee4bc3d0134c4e4eeb: Status 404 returned error can't find the container with id 72a5cbf975eae2854d862fe23bc8284475c90261224910ee4bc3d0134c4e4eeb Jul 08 17:43:41.384484 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.384439 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:43:41.384583 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.384537 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:43:41.384626 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.384581 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:43:41.676202 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.676142 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" event={"ID":"80fac4bd-f628-4d69-b395-a69562c6bbf4","Type":"ContainerStarted","Data":"215ca1fc0dae732e16a61dad77e60326671fc59f1f04afddc5cba70bbd2e8dfc"} Jul 08 17:43:41.676393 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.676223 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" event={"ID":"80fac4bd-f628-4d69-b395-a69562c6bbf4","Type":"ContainerStarted","Data":"72a5cbf975eae2854d862fe23bc8284475c90261224910ee4bc3d0134c4e4eeb"} Jul 08 17:43:41.696944 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:41.696887 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" podStartSLOduration=1.696868084 podStartE2EDuration="1.696868084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:43:41.695604019 +0000 UTC m=+2048.097108472" watchObservedRunningTime="2026-07-08 17:43:41.696868084 +0000 UTC m=+2048.098372505" Jul 08 17:43:42.241323 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:42.241283 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:42.245865 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:42.245838 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:42.681304 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:42.681265 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:43:42.682193 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:43:42.682145 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:44:34.194016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:44:34.193942 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:44:34.195830 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:44:34.195804 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:44:34.198570 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:44:34.198545 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:44:34.200367 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:44:34.200344 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:46:45.604836 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:45.604791 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj"] Jul 08 17:46:45.607377 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:45.605082 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" podUID="80fac4bd-f628-4d69-b395-a69562c6bbf4" containerName="istio-proxy" containerID="cri-o://215ca1fc0dae732e16a61dad77e60326671fc59f1f04afddc5cba70bbd2e8dfc" gracePeriod=30 Jul 08 17:46:45.664699 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:45.664661 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:47.705218 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:47.705177 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:50.867825 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:50.867761 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:46:51.046006 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.045975 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-credential-socket\") pod \"80fac4bd-f628-4d69-b395-a69562c6bbf4\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " Jul 08 17:46:51.046230 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046021 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-workload-socket\") pod \"80fac4bd-f628-4d69-b395-a69562c6bbf4\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " Jul 08 17:46:51.046230 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046068 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80fac4bd-f628-4d69-b395-a69562c6bbf4-istiod-ca-cert\") pod \"80fac4bd-f628-4d69-b395-a69562c6bbf4\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " Jul 08 17:46:51.046230 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046095 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-data\") pod \"80fac4bd-f628-4d69-b395-a69562c6bbf4\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " Jul 08 17:46:51.046230 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046133 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-envoy\") pod \"80fac4bd-f628-4d69-b395-a69562c6bbf4\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " Jul 08 17:46:51.046453 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046305 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "80fac4bd-f628-4d69-b395-a69562c6bbf4" (UID: "80fac4bd-f628-4d69-b395-a69562c6bbf4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:51.046453 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046336 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-token\") pod \"80fac4bd-f628-4d69-b395-a69562c6bbf4\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " Jul 08 17:46:51.046453 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046395 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-podinfo\") pod \"80fac4bd-f628-4d69-b395-a69562c6bbf4\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " Jul 08 17:46:51.046453 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046426 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xbjx\" (UniqueName: \"kubernetes.io/projected/80fac4bd-f628-4d69-b395-a69562c6bbf4-kube-api-access-8xbjx\") pod \"80fac4bd-f628-4d69-b395-a69562c6bbf4\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " Jul 08 17:46:51.046673 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046447 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "80fac4bd-f628-4d69-b395-a69562c6bbf4" (UID: "80fac4bd-f628-4d69-b395-a69562c6bbf4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:51.046673 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046474 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-workload-certs\") pod \"80fac4bd-f628-4d69-b395-a69562c6bbf4\" (UID: \"80fac4bd-f628-4d69-b395-a69562c6bbf4\") " Jul 08 17:46:51.046673 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046483 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-data" (OuterVolumeSpecName: "istio-data") pod "80fac4bd-f628-4d69-b395-a69562c6bbf4" (UID: "80fac4bd-f628-4d69-b395-a69562c6bbf4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:51.046673 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046551 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80fac4bd-f628-4d69-b395-a69562c6bbf4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "80fac4bd-f628-4d69-b395-a69562c6bbf4" (UID: "80fac4bd-f628-4d69-b395-a69562c6bbf4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:46:51.046881 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046810 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-credential-socket\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:46:51.046881 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046831 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-workload-socket\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:46:51.046881 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046845 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80fac4bd-f628-4d69-b395-a69562c6bbf4-istiod-ca-cert\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:46:51.046881 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046858 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-data\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:46:51.047076 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.046938 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "80fac4bd-f628-4d69-b395-a69562c6bbf4" (UID: "80fac4bd-f628-4d69-b395-a69562c6bbf4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:51.048537 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.048504 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "80fac4bd-f628-4d69-b395-a69562c6bbf4" (UID: "80fac4bd-f628-4d69-b395-a69562c6bbf4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:51.048677 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.048538 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-token" (OuterVolumeSpecName: "istio-token") pod "80fac4bd-f628-4d69-b395-a69562c6bbf4" (UID: "80fac4bd-f628-4d69-b395-a69562c6bbf4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:46:51.048677 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.048586 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80fac4bd-f628-4d69-b395-a69562c6bbf4-kube-api-access-8xbjx" (OuterVolumeSpecName: "kube-api-access-8xbjx") pod "80fac4bd-f628-4d69-b395-a69562c6bbf4" (UID: "80fac4bd-f628-4d69-b395-a69562c6bbf4"). InnerVolumeSpecName "kube-api-access-8xbjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:46:51.048677 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.048603 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "80fac4bd-f628-4d69-b395-a69562c6bbf4" (UID: "80fac4bd-f628-4d69-b395-a69562c6bbf4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:46:51.148263 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.148226 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-envoy\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:46:51.148263 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.148259 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-token\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:46:51.148263 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.148269 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80fac4bd-f628-4d69-b395-a69562c6bbf4-istio-podinfo\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:46:51.148488 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.148278 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xbjx\" (UniqueName: \"kubernetes.io/projected/80fac4bd-f628-4d69-b395-a69562c6bbf4-kube-api-access-8xbjx\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:46:51.148488 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.148288 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80fac4bd-f628-4d69-b395-a69562c6bbf4-workload-certs\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:46:51.547033 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.546943 2567 generic.go:356] "Generic (PLEG): container finished" podID="80fac4bd-f628-4d69-b395-a69562c6bbf4" containerID="215ca1fc0dae732e16a61dad77e60326671fc59f1f04afddc5cba70bbd2e8dfc" exitCode=0 Jul 08 17:46:51.547033 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.546995 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" Jul 08 17:46:51.547231 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.547029 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" event={"ID":"80fac4bd-f628-4d69-b395-a69562c6bbf4","Type":"ContainerDied","Data":"215ca1fc0dae732e16a61dad77e60326671fc59f1f04afddc5cba70bbd2e8dfc"} Jul 08 17:46:51.547231 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.547086 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj" event={"ID":"80fac4bd-f628-4d69-b395-a69562c6bbf4","Type":"ContainerDied","Data":"72a5cbf975eae2854d862fe23bc8284475c90261224910ee4bc3d0134c4e4eeb"} Jul 08 17:46:51.547231 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.547109 2567 scope.go:117] "RemoveContainer" containerID="215ca1fc0dae732e16a61dad77e60326671fc59f1f04afddc5cba70bbd2e8dfc" Jul 08 17:46:51.556769 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.556751 2567 scope.go:117] "RemoveContainer" containerID="215ca1fc0dae732e16a61dad77e60326671fc59f1f04afddc5cba70bbd2e8dfc" Jul 08 17:46:51.557064 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:46:51.557043 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"215ca1fc0dae732e16a61dad77e60326671fc59f1f04afddc5cba70bbd2e8dfc\": container with ID starting with 215ca1fc0dae732e16a61dad77e60326671fc59f1f04afddc5cba70bbd2e8dfc not found: ID does not exist" containerID="215ca1fc0dae732e16a61dad77e60326671fc59f1f04afddc5cba70bbd2e8dfc" Jul 08 17:46:51.557104 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.557075 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"215ca1fc0dae732e16a61dad77e60326671fc59f1f04afddc5cba70bbd2e8dfc"} err="failed to get container status \"215ca1fc0dae732e16a61dad77e60326671fc59f1f04afddc5cba70bbd2e8dfc\": rpc error: code = NotFound desc = could not find container \"215ca1fc0dae732e16a61dad77e60326671fc59f1f04afddc5cba70bbd2e8dfc\": container with ID starting with 215ca1fc0dae732e16a61dad77e60326671fc59f1f04afddc5cba70bbd2e8dfc not found: ID does not exist" Jul 08 17:46:51.584377 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.584336 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj"] Jul 08 17:46:51.587951 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:51.587916 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d52bb8d4-openshift-default-799d74cfb7-85bhj"] Jul 08 17:46:52.259391 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:52.259354 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80fac4bd-f628-4d69-b395-a69562c6bbf4" path="/var/lib/kubelet/pods/80fac4bd-f628-4d69-b395-a69562c6bbf4/volumes" Jul 08 17:46:52.504428 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:52.504386 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:52.564908 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:52.564831 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:52.668512 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:52.668476 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:52.753622 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:52.753589 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:52.904197 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:52.904137 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:58.542560 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:58.542479 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:58.640635 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:46:58.640585 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:05.604107 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.604068 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:05.951464 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.951431 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn"] Jul 08 17:47:05.951852 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.951834 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80fac4bd-f628-4d69-b395-a69562c6bbf4" containerName="istio-proxy" Jul 08 17:47:05.951852 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.951850 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="80fac4bd-f628-4d69-b395-a69562c6bbf4" containerName="istio-proxy" Jul 08 17:47:05.952016 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.951913 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="80fac4bd-f628-4d69-b395-a69562c6bbf4" containerName="istio-proxy" Jul 08 17:47:05.956353 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.956334 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:05.959084 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.959065 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7efd5629-openshift-default-dockercfg-xtp5f\"" Jul 08 17:47:05.969951 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.969926 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn"] Jul 08 17:47:05.976470 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.976434 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b547c99-943a-4f32-adb4-8defff19cb95-istio-podinfo\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:05.976470 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.976470 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-credential-socket\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:05.976655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.976488 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-istio-envoy\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:05.976655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.976504 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-istio-data\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:05.976655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.976577 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-workload-socket\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:05.976655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.976614 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b547c99-943a-4f32-adb4-8defff19cb95-istio-token\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:05.976655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.976635 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-workload-certs\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:05.976655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.976649 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b547c99-943a-4f32-adb4-8defff19cb95-istiod-ca-cert\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:05.976964 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.976668 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drjnd\" (UniqueName: \"kubernetes.io/projected/4b547c99-943a-4f32-adb4-8defff19cb95-kube-api-access-drjnd\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:05.989283 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:05.989258 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:06.077831 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.077796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-workload-socket\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.078012 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.077855 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b547c99-943a-4f32-adb4-8defff19cb95-istio-token\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.078012 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.077894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-workload-certs\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.078012 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.077917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b547c99-943a-4f32-adb4-8defff19cb95-istiod-ca-cert\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.078012 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.077948 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drjnd\" (UniqueName: \"kubernetes.io/projected/4b547c99-943a-4f32-adb4-8defff19cb95-kube-api-access-drjnd\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.078012 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.078011 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b547c99-943a-4f32-adb4-8defff19cb95-istio-podinfo\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.078430 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.078040 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-credential-socket\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.078430 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.078064 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-istio-envoy\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.078430 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.078093 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-istio-data\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.078430 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.078299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-workload-socket\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.078650 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.078456 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-workload-certs\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.078650 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.078499 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-credential-socket\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.078650 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.078515 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-istio-data\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.078791 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.078764 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b547c99-943a-4f32-adb4-8defff19cb95-istiod-ca-cert\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.080554 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.080531 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b547c99-943a-4f32-adb4-8defff19cb95-istio-podinfo\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.080650 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.080556 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-istio-envoy\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.086940 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.086917 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b547c99-943a-4f32-adb4-8defff19cb95-istio-token\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.087056 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.087025 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drjnd\" (UniqueName: \"kubernetes.io/projected/4b547c99-943a-4f32-adb4-8defff19cb95-kube-api-access-drjnd\") pod \"e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.266504 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.266408 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:06.419657 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.419630 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn"] Jul 08 17:47:06.421745 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:47:06.421703 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b547c99_943a_4f32_adb4_8defff19cb95.slice/crio-b1137b13e70ddaeccc50b1245590710460eabe552570049d82d6f14ff922484e WatchSource:0}: Error finding container b1137b13e70ddaeccc50b1245590710460eabe552570049d82d6f14ff922484e: Status 404 returned error can't find the container with id b1137b13e70ddaeccc50b1245590710460eabe552570049d82d6f14ff922484e Jul 08 17:47:06.423976 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.423939 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:47:06.424064 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.424012 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:47:06.424064 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.424040 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:47:06.435451 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.435423 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:06.623570 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.623465 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" event={"ID":"4b547c99-943a-4f32-adb4-8defff19cb95","Type":"ContainerStarted","Data":"5f354cb8a84eed234fe0db691071c22d00116918acb9b86a9e66cc9cf56e5d43"} Jul 08 17:47:06.623570 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.623530 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" event={"ID":"4b547c99-943a-4f32-adb4-8defff19cb95","Type":"ContainerStarted","Data":"b1137b13e70ddaeccc50b1245590710460eabe552570049d82d6f14ff922484e"} Jul 08 17:47:06.644764 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:06.644711 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" podStartSLOduration=1.644690735 podStartE2EDuration="1.644690735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:47:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:47:06.643861839 +0000 UTC m=+2253.045366304" watchObservedRunningTime="2026-07-08 17:47:06.644690735 +0000 UTC m=+2253.046195155" Jul 08 17:47:07.266906 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:07.266873 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:07.271862 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:07.271835 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:07.629429 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:07.629403 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:07.630311 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:07.630290 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:47:54.897381 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:47:54.897347 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:48:19.708349 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:48:19.708313 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:49:34.133093 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:49:34.133058 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:49:34.221812 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:49:34.221786 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:49:34.226517 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:49:34.226485 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:49:34.226798 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:49:34.226780 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:49:34.231271 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:49:34.231249 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:49:34.233345 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:49:34.233321 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:12.902392 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:12.902290 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn"] Jul 08 17:50:12.902997 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:12.902575 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" podUID="4b547c99-943a-4f32-adb4-8defff19cb95" containerName="istio-proxy" containerID="cri-o://5f354cb8a84eed234fe0db691071c22d00116918acb9b86a9e66cc9cf56e5d43" gracePeriod=30 Jul 08 17:50:12.919267 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:12.919234 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:14.368883 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:14.368840 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:14.463288 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:14.463251 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:14.567887 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:14.567855 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:15.373438 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:15.373404 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:15.475802 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:15.475763 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:15.777439 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:15.777392 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:16.985765 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:16.985729 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:50:17.025639 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:17.025582 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:18.159278 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.159257 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:50:18.296542 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.296448 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b547c99-943a-4f32-adb4-8defff19cb95-istio-token\") pod \"4b547c99-943a-4f32-adb4-8defff19cb95\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " Jul 08 17:50:18.296542 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.296492 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-istio-data\") pod \"4b547c99-943a-4f32-adb4-8defff19cb95\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " Jul 08 17:50:18.296542 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.296537 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b547c99-943a-4f32-adb4-8defff19cb95-istio-podinfo\") pod \"4b547c99-943a-4f32-adb4-8defff19cb95\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " Jul 08 17:50:18.296821 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.296559 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b547c99-943a-4f32-adb4-8defff19cb95-istiod-ca-cert\") pod \"4b547c99-943a-4f32-adb4-8defff19cb95\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " Jul 08 17:50:18.296821 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.296584 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-workload-certs\") pod \"4b547c99-943a-4f32-adb4-8defff19cb95\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " Jul 08 17:50:18.296821 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.296611 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-workload-socket\") pod \"4b547c99-943a-4f32-adb4-8defff19cb95\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " Jul 08 17:50:18.296821 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.296646 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-credential-socket\") pod \"4b547c99-943a-4f32-adb4-8defff19cb95\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " Jul 08 17:50:18.296821 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.296671 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-istio-envoy\") pod \"4b547c99-943a-4f32-adb4-8defff19cb95\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " Jul 08 17:50:18.296821 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.296692 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drjnd\" (UniqueName: \"kubernetes.io/projected/4b547c99-943a-4f32-adb4-8defff19cb95-kube-api-access-drjnd\") pod \"4b547c99-943a-4f32-adb4-8defff19cb95\" (UID: \"4b547c99-943a-4f32-adb4-8defff19cb95\") " Jul 08 17:50:18.297125 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.296904 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-istio-data" (OuterVolumeSpecName: "istio-data") pod "4b547c99-943a-4f32-adb4-8defff19cb95" (UID: "4b547c99-943a-4f32-adb4-8defff19cb95"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:50:18.297125 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.296943 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4b547c99-943a-4f32-adb4-8defff19cb95" (UID: "4b547c99-943a-4f32-adb4-8defff19cb95"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:50:18.297125 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.296915 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4b547c99-943a-4f32-adb4-8defff19cb95" (UID: "4b547c99-943a-4f32-adb4-8defff19cb95"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:50:18.297125 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.297038 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-istio-data\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:50:18.297125 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.297059 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-workload-certs\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:50:18.297125 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.297075 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-credential-socket\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:50:18.297125 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.297038 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b547c99-943a-4f32-adb4-8defff19cb95-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4b547c99-943a-4f32-adb4-8defff19cb95" (UID: "4b547c99-943a-4f32-adb4-8defff19cb95"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:50:18.297545 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.297239 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4b547c99-943a-4f32-adb4-8defff19cb95" (UID: "4b547c99-943a-4f32-adb4-8defff19cb95"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:50:18.298775 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.298751 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4b547c99-943a-4f32-adb4-8defff19cb95" (UID: "4b547c99-943a-4f32-adb4-8defff19cb95"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:50:18.298888 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.298849 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b547c99-943a-4f32-adb4-8defff19cb95-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4b547c99-943a-4f32-adb4-8defff19cb95" (UID: "4b547c99-943a-4f32-adb4-8defff19cb95"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:50:18.298888 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.298870 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b547c99-943a-4f32-adb4-8defff19cb95-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b547c99-943a-4f32-adb4-8defff19cb95" (UID: "4b547c99-943a-4f32-adb4-8defff19cb95"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:50:18.298962 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.298888 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b547c99-943a-4f32-adb4-8defff19cb95-kube-api-access-drjnd" (OuterVolumeSpecName: "kube-api-access-drjnd") pod "4b547c99-943a-4f32-adb4-8defff19cb95" (UID: "4b547c99-943a-4f32-adb4-8defff19cb95"). InnerVolumeSpecName "kube-api-access-drjnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:50:18.398209 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.398178 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b547c99-943a-4f32-adb4-8defff19cb95-istio-token\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:50:18.398209 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.398207 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b547c99-943a-4f32-adb4-8defff19cb95-istio-podinfo\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:50:18.398209 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.398216 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b547c99-943a-4f32-adb4-8defff19cb95-istiod-ca-cert\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:50:18.398444 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.398227 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-workload-socket\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:50:18.398444 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.398236 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b547c99-943a-4f32-adb4-8defff19cb95-istio-envoy\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:50:18.398444 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.398245 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drjnd\" (UniqueName: \"kubernetes.io/projected/4b547c99-943a-4f32-adb4-8defff19cb95-kube-api-access-drjnd\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:50:18.521254 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.521221 2567 generic.go:356] "Generic (PLEG): container finished" podID="4b547c99-943a-4f32-adb4-8defff19cb95" containerID="5f354cb8a84eed234fe0db691071c22d00116918acb9b86a9e66cc9cf56e5d43" exitCode=0 Jul 08 17:50:18.521446 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.521264 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" Jul 08 17:50:18.521446 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.521310 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" event={"ID":"4b547c99-943a-4f32-adb4-8defff19cb95","Type":"ContainerDied","Data":"5f354cb8a84eed234fe0db691071c22d00116918acb9b86a9e66cc9cf56e5d43"} Jul 08 17:50:18.521446 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.521371 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn" event={"ID":"4b547c99-943a-4f32-adb4-8defff19cb95","Type":"ContainerDied","Data":"b1137b13e70ddaeccc50b1245590710460eabe552570049d82d6f14ff922484e"} Jul 08 17:50:18.521446 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.521401 2567 scope.go:117] "RemoveContainer" containerID="5f354cb8a84eed234fe0db691071c22d00116918acb9b86a9e66cc9cf56e5d43" Jul 08 17:50:18.530699 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.530680 2567 scope.go:117] "RemoveContainer" containerID="5f354cb8a84eed234fe0db691071c22d00116918acb9b86a9e66cc9cf56e5d43" Jul 08 17:50:18.530964 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:50:18.530945 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f354cb8a84eed234fe0db691071c22d00116918acb9b86a9e66cc9cf56e5d43\": container with ID starting with 5f354cb8a84eed234fe0db691071c22d00116918acb9b86a9e66cc9cf56e5d43 not found: ID does not exist" containerID="5f354cb8a84eed234fe0db691071c22d00116918acb9b86a9e66cc9cf56e5d43" Jul 08 17:50:18.531010 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.530973 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f354cb8a84eed234fe0db691071c22d00116918acb9b86a9e66cc9cf56e5d43"} err="failed to get container status \"5f354cb8a84eed234fe0db691071c22d00116918acb9b86a9e66cc9cf56e5d43\": rpc error: code = NotFound desc = could not find container \"5f354cb8a84eed234fe0db691071c22d00116918acb9b86a9e66cc9cf56e5d43\": container with ID starting with 5f354cb8a84eed234fe0db691071c22d00116918acb9b86a9e66cc9cf56e5d43 not found: ID does not exist" Jul 08 17:50:18.544359 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.544335 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn"] Jul 08 17:50:18.551420 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:18.551367 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7efd5629-openshift-default-65cd87c58c-j5mbn"] Jul 08 17:50:20.259545 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:20.259512 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b547c99-943a-4f32-adb4-8defff19cb95" path="/var/lib/kubelet/pods/4b547c99-943a-4f32-adb4-8defff19cb95/volumes" Jul 08 17:50:22.885963 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:22.885927 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:22.955417 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:22.955378 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:23.621444 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:23.621409 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:29.608100 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:29.608057 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:29.715696 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:29.715660 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:29.809244 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:29.809211 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:31.187392 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:31.187355 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rxlnb"] Jul 08 17:50:40.350422 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:40.350376 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:40.705431 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:50:40.705394 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:01.717656 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:01.717615 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:07.375440 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:07.375400 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:07.475359 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:07.475325 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:07.740843 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:07.740813 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:08.048465 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.048388 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz"] Jul 08 17:51:08.048739 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.048727 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b547c99-943a-4f32-adb4-8defff19cb95" containerName="istio-proxy" Jul 08 17:51:08.048782 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.048740 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b547c99-943a-4f32-adb4-8defff19cb95" containerName="istio-proxy" Jul 08 17:51:08.048824 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.048815 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b547c99-943a-4f32-adb4-8defff19cb95" containerName="istio-proxy" Jul 08 17:51:08.051796 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.051777 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.054464 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.054438 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-780189-openshift-default-dockercfg-srvcm\"" Jul 08 17:51:08.064461 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.064431 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz"] Jul 08 17:51:08.067470 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.067439 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:08.165611 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.165574 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:08.228493 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.228453 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-token\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.228493 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.228494 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istiod-ca-cert\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.228754 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.228572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-workload-certs\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.228754 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.228595 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-podinfo\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.228754 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.228647 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-credential-socket\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.228754 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.228679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r6zd\" (UniqueName: \"kubernetes.io/projected/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-kube-api-access-6r6zd\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.228754 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.228719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-data\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.229002 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.228774 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-workload-socket\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.229002 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.228803 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-envoy\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.329937 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.329839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-workload-socket\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.329937 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.329878 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-envoy\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.329937 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.329903 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-token\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.330251 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.329960 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istiod-ca-cert\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.330251 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.330050 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-workload-certs\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.330251 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.330081 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-podinfo\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.330251 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.330131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-credential-socket\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.330251 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.330178 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r6zd\" (UniqueName: \"kubernetes.io/projected/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-kube-api-access-6r6zd\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.330251 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.330224 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-data\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.330554 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.330432 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-workload-socket\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.330846 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.330815 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-credential-socket\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.330976 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.330899 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-data\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.330976 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.330918 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-workload-certs\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.331141 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.331114 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istiod-ca-cert\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.332476 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.332453 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-envoy\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.332805 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.332787 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-podinfo\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.337882 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.337852 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-token\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.338069 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.338047 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r6zd\" (UniqueName: \"kubernetes.io/projected/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-kube-api-access-6r6zd\") pod \"e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.370029 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.369999 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:08.507759 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.507733 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz"] Jul 08 17:51:08.509897 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:51:08.509868 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82eb0ecd_bbeb_4cea_81fb_0a1ebd2dfedd.slice/crio-f356333620f549b36d88090a08d528ba6ebed3a7259a33dbce12abe37d94ce55 WatchSource:0}: Error finding container f356333620f549b36d88090a08d528ba6ebed3a7259a33dbce12abe37d94ce55: Status 404 returned error can't find the container with id f356333620f549b36d88090a08d528ba6ebed3a7259a33dbce12abe37d94ce55 Jul 08 17:51:08.512485 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.512451 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:51:08.512568 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.512526 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:51:08.512568 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.512555 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:51:08.759568 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.759533 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" event={"ID":"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd","Type":"ContainerStarted","Data":"ea34d5a186cd020ca30e1dd4b05e5a417655d1a63f219d839b7aff203477443e"} Jul 08 17:51:08.759747 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.759583 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" event={"ID":"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd","Type":"ContainerStarted","Data":"f356333620f549b36d88090a08d528ba6ebed3a7259a33dbce12abe37d94ce55"} Jul 08 17:51:08.815655 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:08.815603 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" podStartSLOduration=0.815585269 podStartE2EDuration="815.585269ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:51:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:51:08.812487929 +0000 UTC m=+2495.213992348" watchObservedRunningTime="2026-07-08 17:51:08.815585269 +0000 UTC m=+2495.217089726" Jul 08 17:51:09.370350 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:09.370314 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:09.375231 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:09.375207 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:09.764551 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:09.764522 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:09.765635 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:09.765617 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:51:16.029639 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:16.029598 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:16.094513 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:16.094471 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:50.001880 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:51:50.001844 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:52:00.241628 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:52:00.241591 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:15.620012 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:15.619972 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz"] Jul 08 17:54:15.620594 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:15.620247 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" podUID="82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" containerName="istio-proxy" containerID="cri-o://ea34d5a186cd020ca30e1dd4b05e5a417655d1a63f219d839b7aff203477443e" gracePeriod=30 Jul 08 17:54:15.671122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:15.671084 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:20.870959 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:20.870930 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:54:21.053756 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.053658 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-data\") pod \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " Jul 08 17:54:21.053756 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.053726 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-workload-socket\") pod \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " Jul 08 17:54:21.053756 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.053753 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-workload-certs\") pod \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " Jul 08 17:54:21.054042 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.053787 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istiod-ca-cert\") pod \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " Jul 08 17:54:21.054042 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.053808 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-podinfo\") pod \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " Jul 08 17:54:21.054042 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.053861 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-envoy\") pod \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " Jul 08 17:54:21.054042 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.053912 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-credential-socket\") pod \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " Jul 08 17:54:21.054042 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.053958 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-token\") pod \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " Jul 08 17:54:21.054042 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.054003 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r6zd\" (UniqueName: \"kubernetes.io/projected/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-kube-api-access-6r6zd\") pod \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\" (UID: \"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd\") " Jul 08 17:54:21.054042 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.054013 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" (UID: "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:21.054366 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.054022 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-data" (OuterVolumeSpecName: "istio-data") pod "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" (UID: "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:21.054366 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.054198 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" (UID: "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:21.054366 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.054301 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" (UID: "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:21.054366 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.054307 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" (UID: "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:54:21.054573 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.054403 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-data\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:54:21.054573 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.054423 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-workload-socket\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:54:21.054573 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.054440 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-workload-certs\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:54:21.054573 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.054453 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istiod-ca-cert\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:54:21.054573 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.054467 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-credential-socket\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:54:21.056279 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.056257 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-token" (OuterVolumeSpecName: "istio-token") pod "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" (UID: "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:54:21.056375 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.056320 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" (UID: "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:54:21.056557 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.056530 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" (UID: "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:21.056557 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.056548 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-kube-api-access-6r6zd" (OuterVolumeSpecName: "kube-api-access-6r6zd") pod "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" (UID: "82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd"). InnerVolumeSpecName "kube-api-access-6r6zd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:54:21.155212 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.155176 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-token\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:54:21.155212 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.155208 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r6zd\" (UniqueName: \"kubernetes.io/projected/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-kube-api-access-6r6zd\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:54:21.155212 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.155219 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-podinfo\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:54:21.155442 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.155228 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd-istio-envoy\") on node \"ip-10-0-138-180.ec2.internal\" DevicePath \"\"" Jul 08 17:54:21.667606 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.667568 2567 generic.go:356] "Generic (PLEG): container finished" podID="82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" containerID="ea34d5a186cd020ca30e1dd4b05e5a417655d1a63f219d839b7aff203477443e" exitCode=0 Jul 08 17:54:21.667606 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.667618 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" Jul 08 17:54:21.667895 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.667614 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" event={"ID":"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd","Type":"ContainerDied","Data":"ea34d5a186cd020ca30e1dd4b05e5a417655d1a63f219d839b7aff203477443e"} Jul 08 17:54:21.667895 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.667754 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz" event={"ID":"82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd","Type":"ContainerDied","Data":"f356333620f549b36d88090a08d528ba6ebed3a7259a33dbce12abe37d94ce55"} Jul 08 17:54:21.667895 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.667796 2567 scope.go:117] "RemoveContainer" containerID="ea34d5a186cd020ca30e1dd4b05e5a417655d1a63f219d839b7aff203477443e" Jul 08 17:54:21.677381 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.677365 2567 scope.go:117] "RemoveContainer" containerID="ea34d5a186cd020ca30e1dd4b05e5a417655d1a63f219d839b7aff203477443e" Jul 08 17:54:21.677629 ip-10-0-138-180 kubenswrapper[2567]: E0708 17:54:21.677610 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea34d5a186cd020ca30e1dd4b05e5a417655d1a63f219d839b7aff203477443e\": container with ID starting with ea34d5a186cd020ca30e1dd4b05e5a417655d1a63f219d839b7aff203477443e not found: ID does not exist" containerID="ea34d5a186cd020ca30e1dd4b05e5a417655d1a63f219d839b7aff203477443e" Jul 08 17:54:21.677680 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.677636 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea34d5a186cd020ca30e1dd4b05e5a417655d1a63f219d839b7aff203477443e"} err="failed to get container status \"ea34d5a186cd020ca30e1dd4b05e5a417655d1a63f219d839b7aff203477443e\": rpc error: code = NotFound desc = could not find container \"ea34d5a186cd020ca30e1dd4b05e5a417655d1a63f219d839b7aff203477443e\": container with ID starting with ea34d5a186cd020ca30e1dd4b05e5a417655d1a63f219d839b7aff203477443e not found: ID does not exist" Jul 08 17:54:21.690191 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.690166 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz"] Jul 08 17:54:21.694455 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:21.694436 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-780189-openshift-default-676f5b4b99-r2vjz"] Jul 08 17:54:22.260574 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:22.260538 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" path="/var/lib/kubelet/pods/82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd/volumes" Jul 08 17:54:23.260319 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:23.260290 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gp22x_78f3520d-fa34-40ce-84b2-cab8628e0490/server/0.log" Jul 08 17:54:23.382922 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:23.382885 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jltzl_71eb22b0-86a6-41ee-bd62-e0b32bca36a8/manager/0.log" Jul 08 17:54:23.506281 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:23.506252 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6778fbd4c5-sslms_f9124842-9568-4021-a70a-e02792d17ab9/copy-manifests/0.log" Jul 08 17:54:23.513900 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:23.513837 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6778fbd4c5-sslms_f9124842-9568-4021-a70a-e02792d17ab9/manager/0.log" Jul 08 17:54:25.428784 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:25.428751 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-25kg9_62db82c1-9a13-4345-9a47-9f22c0c21e75/manager/0.log" Jul 08 17:54:25.797652 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:25.797556 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rtjdd_0fdcdeb7-3af0-4395-aa61-4850b715a569/manager/0.log" Jul 08 17:54:25.953282 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:25.953253 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-rxlnb_dc77dde0-2238-4a53-bd63-67b402dff1f5/limitador/0.log" Jul 08 17:54:26.451294 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:26.451264 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4486hk_be11f07d-edab-46b2-9d20-0d5b2cf55835/istio-proxy/0.log" Jul 08 17:54:26.578581 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:26.578551 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7wrrh_f7b9942d-7532-49dc-9b12-37df398b3fef/discovery/0.log" Jul 08 17:54:26.812243 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:26.812145 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55b4df66b5-tj9x5_c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff/kube-auth-proxy/0.log" Jul 08 17:54:26.938310 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:26.938280 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ltxfm_bb8bf282-11a3-41f7-8ade-be41be353e88/istio-proxy/1.log" Jul 08 17:54:27.304327 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:27.304297 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d68bf77dc-pphvl_d5e4bf86-708e-4e08-a293-505c094abc70/router/0.log" Jul 08 17:54:27.658628 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:27.658601 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-zqm5r_fda02442-5f06-4a83-b69b-2f5e87fca332/main/0.log" Jul 08 17:54:28.126953 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:28.126873 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-twflm_9c89a7c4-1162-4898-bd1d-93e676672934/main/0.log" Jul 08 17:54:32.718763 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.718726 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p4s77/must-gather-824zr"] Jul 08 17:54:32.719144 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.719073 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" containerName="istio-proxy" Jul 08 17:54:32.719144 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.719083 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" containerName="istio-proxy" Jul 08 17:54:32.719144 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.719143 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="82eb0ecd-bbeb-4cea-81fb-0a1ebd2dfedd" containerName="istio-proxy" Jul 08 17:54:32.723879 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.723856 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4s77/must-gather-824zr" Jul 08 17:54:32.726302 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.726280 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p4s77\"/\"openshift-service-ca.crt\"" Jul 08 17:54:32.726419 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.726300 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p4s77\"/\"kube-root-ca.crt\"" Jul 08 17:54:32.727218 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.727198 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p4s77\"/\"default-dockercfg-tlqzb\"" Jul 08 17:54:32.732775 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.732747 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4s77/must-gather-824zr"] Jul 08 17:54:32.736484 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.736459 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:32.751186 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.751145 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e809d817-f00e-4a33-845c-f0d91d199020-must-gather-output\") pod \"must-gather-824zr\" (UID: \"e809d817-f00e-4a33-845c-f0d91d199020\") " pod="openshift-must-gather-p4s77/must-gather-824zr" Jul 08 17:54:32.751319 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.751206 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldr7p\" (UniqueName: \"kubernetes.io/projected/e809d817-f00e-4a33-845c-f0d91d199020-kube-api-access-ldr7p\") pod \"must-gather-824zr\" (UID: \"e809d817-f00e-4a33-845c-f0d91d199020\") " pod="openshift-must-gather-p4s77/must-gather-824zr" Jul 08 17:54:32.835378 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.835343 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:32.852725 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.852692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e809d817-f00e-4a33-845c-f0d91d199020-must-gather-output\") pod \"must-gather-824zr\" (UID: \"e809d817-f00e-4a33-845c-f0d91d199020\") " pod="openshift-must-gather-p4s77/must-gather-824zr" Jul 08 17:54:32.852882 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.852735 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldr7p\" (UniqueName: \"kubernetes.io/projected/e809d817-f00e-4a33-845c-f0d91d199020-kube-api-access-ldr7p\") pod \"must-gather-824zr\" (UID: \"e809d817-f00e-4a33-845c-f0d91d199020\") " pod="openshift-must-gather-p4s77/must-gather-824zr" Jul 08 17:54:32.853069 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.853048 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e809d817-f00e-4a33-845c-f0d91d199020-must-gather-output\") pod \"must-gather-824zr\" (UID: \"e809d817-f00e-4a33-845c-f0d91d199020\") " pod="openshift-must-gather-p4s77/must-gather-824zr" Jul 08 17:54:32.860925 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:32.860902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldr7p\" (UniqueName: \"kubernetes.io/projected/e809d817-f00e-4a33-845c-f0d91d199020-kube-api-access-ldr7p\") pod \"must-gather-824zr\" (UID: \"e809d817-f00e-4a33-845c-f0d91d199020\") " pod="openshift-must-gather-p4s77/must-gather-824zr" Jul 08 17:54:33.034574 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:33.034479 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4s77/must-gather-824zr" Jul 08 17:54:33.174809 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:33.174777 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4s77/must-gather-824zr"] Jul 08 17:54:33.177318 ip-10-0-138-180 kubenswrapper[2567]: W0708 17:54:33.177283 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode809d817_f00e_4a33_845c_f0d91d199020.slice/crio-d2cec57f0856f85d5aa6cc90d950271aee6521beadfcf5d4e3171ae332a8dcfc WatchSource:0}: Error finding container d2cec57f0856f85d5aa6cc90d950271aee6521beadfcf5d4e3171ae332a8dcfc: Status 404 returned error can't find the container with id d2cec57f0856f85d5aa6cc90d950271aee6521beadfcf5d4e3171ae332a8dcfc Jul 08 17:54:33.179147 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:33.179128 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:54:33.726065 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:33.726017 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4s77/must-gather-824zr" event={"ID":"e809d817-f00e-4a33-845c-f0d91d199020","Type":"ContainerStarted","Data":"d2cec57f0856f85d5aa6cc90d950271aee6521beadfcf5d4e3171ae332a8dcfc"} Jul 08 17:54:34.253385 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:34.253356 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:54:34.258478 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:34.258456 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:54:34.258787 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:34.258770 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:54:34.264093 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:34.264056 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t7wkp_b5aa675b-9f8b-4f8c-a2ab-d5dd209c84c7/ovn-acl-logging/0.log" Jul 08 17:54:34.734477 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:34.734438 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4s77/must-gather-824zr" event={"ID":"e809d817-f00e-4a33-845c-f0d91d199020","Type":"ContainerStarted","Data":"cc2ecf98d415c6b5e490f442d7205ff480d8e2aad9a896b6870eb83600b958f3"} Jul 08 17:54:34.734834 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:34.734496 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4s77/must-gather-824zr" event={"ID":"e809d817-f00e-4a33-845c-f0d91d199020","Type":"ContainerStarted","Data":"832b5335c591a257ce6ccb622840404eda73548cb1dbd584dbdbd455c0c96a52"} Jul 08 17:54:34.749469 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:34.749400 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p4s77/must-gather-824zr" podStartSLOduration=1.517339408 podStartE2EDuration="2.749381843s" totalImagesPullingTime="1.232042435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:54:34.748641889 +0000 UTC m=+2701.150146309" watchObservedRunningTime="2026-07-08 17:54:34.749381843 +0000 UTC m=+2701.150886263" Jul 08 17:54:36.084100 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:36.084069 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9d4bs_766e4d7c-1d51-4db8-bdc4-3be62175a3a6/global-pull-secret-syncer/0.log" Jul 08 17:54:36.173965 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:36.173933 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-687zq_4357f9ee-c302-449a-ba96-678febe063ae/konnectivity-agent/0.log" Jul 08 17:54:36.296762 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:36.296733 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-180.ec2.internal_5d6797f993b19877f01026719e994bf0/haproxy/0.log" Jul 08 17:54:41.326625 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:41.326588 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-25kg9_62db82c1-9a13-4345-9a47-9f22c0c21e75/manager/0.log" Jul 08 17:54:41.494549 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:41.494512 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rtjdd_0fdcdeb7-3af0-4395-aa61-4850b715a569/manager/0.log" Jul 08 17:54:41.533223 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:41.533120 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-rxlnb_dc77dde0-2238-4a53-bd63-67b402dff1f5/limitador/0.log" Jul 08 17:54:43.479554 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:43.479513 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-q6qgr_1232df85-ee3c-43d7-8c4b-35e54e42eb59/cluster-monitoring-operator/0.log" Jul 08 17:54:43.756584 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:43.756498 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6crv9_46d24bc8-bab5-4a60-b24f-9d015bfa8f88/node-exporter/0.log" Jul 08 17:54:43.806969 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:43.806929 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6crv9_46d24bc8-bab5-4a60-b24f-9d015bfa8f88/kube-rbac-proxy/0.log" Jul 08 17:54:43.832424 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:43.832398 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6crv9_46d24bc8-bab5-4a60-b24f-9d015bfa8f88/init-textfile/0.log" Jul 08 17:54:46.433923 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:46.433891 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/1.log" Jul 08 17:54:46.439410 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:46.439383 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bhsb4_e398959d-5b24-4304-af82-1a79e9faed29/console-operator/2.log" Jul 08 17:54:46.801022 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:46.800919 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7"] Jul 08 17:54:46.809680 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:46.809650 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:46.813842 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:46.813808 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7"] Jul 08 17:54:46.910735 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:46.910678 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-proc\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:46.910927 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:46.910784 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-podres\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:46.910927 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:46.910898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-sys\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:46.911055 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:46.910941 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzpmv\" (UniqueName: \"kubernetes.io/projected/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-kube-api-access-qzpmv\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:46.911055 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:46.911000 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-lib-modules\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:47.012611 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.012563 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-sys\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:47.012800 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.012633 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzpmv\" (UniqueName: \"kubernetes.io/projected/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-kube-api-access-qzpmv\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:47.012800 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.012681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-lib-modules\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:47.012800 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.012688 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-sys\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:47.012800 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.012716 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-proc\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:47.012800 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.012776 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-podres\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:47.013075 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.012927 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-podres\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:47.013075 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.013014 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-lib-modules\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:47.013075 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.013046 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-proc\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:47.022258 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.022227 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzpmv\" (UniqueName: \"kubernetes.io/projected/a2b949ef-f91c-4fb9-8e28-3b29cce0f51a-kube-api-access-qzpmv\") pod \"perf-node-gather-daemonset-lrgd7\" (UID: \"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a\") " pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:47.126051 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.125970 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:47.287252 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.287207 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7"] Jul 08 17:54:47.590142 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.590110 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-hzhw5_c471b244-f353-4ab3-8d23-25e0f26739fa/volume-data-source-validator/0.log" Jul 08 17:54:47.829790 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.829708 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" event={"ID":"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a","Type":"ContainerStarted","Data":"ad104588d2f90e6430c5458a9a680c70c426281e32177f07c5332a65f5ca678d"} Jul 08 17:54:47.830833 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.830796 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:47.831046 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.831027 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" event={"ID":"a2b949ef-f91c-4fb9-8e28-3b29cce0f51a","Type":"ContainerStarted","Data":"98200181c3053f1a836fa2b4e203b0e4a3041de716b93276f3fe2fa7d0816532"} Jul 08 17:54:47.847768 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:47.847708 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" podStartSLOduration=1.847688786 podStartE2EDuration="1.847688786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:54:47.847039217 +0000 UTC m=+2714.248543637" watchObservedRunningTime="2026-07-08 17:54:47.847688786 +0000 UTC m=+2714.249193207" Jul 08 17:54:48.839830 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:48.839798 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7v5fb_c4ced9eb-4fb8-4539-9bcc-de27d6198e36/dns/0.log" Jul 08 17:54:48.865380 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:48.865350 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7v5fb_c4ced9eb-4fb8-4539-9bcc-de27d6198e36/kube-rbac-proxy/0.log" Jul 08 17:54:48.939474 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:48.939439 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fbzfk_6ad2f2a1-97af-4cd8-8166-c1b9bf2c928e/dns-node-resolver/0.log" Jul 08 17:54:49.571672 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:49.571634 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gp6fb_6e808ac0-56f2-43de-820c-c788e873dbec/node-ca/0.log" Jul 08 17:54:50.573617 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:50.573579 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4486hk_be11f07d-edab-46b2-9d20-0d5b2cf55835/istio-proxy/0.log" Jul 08 17:54:50.653815 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:50.653783 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7wrrh_f7b9942d-7532-49dc-9b12-37df398b3fef/discovery/0.log" Jul 08 17:54:50.698334 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:50.698305 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55b4df66b5-tj9x5_c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff/kube-auth-proxy/0.log" Jul 08 17:54:50.726895 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:50.726858 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ltxfm_bb8bf282-11a3-41f7-8ade-be41be353e88/istio-proxy/0.log" Jul 08 17:54:50.765045 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:50.765015 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ltxfm_bb8bf282-11a3-41f7-8ade-be41be353e88/istio-proxy/1.log" Jul 08 17:54:50.870042 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:50.869967 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d68bf77dc-pphvl_d5e4bf86-708e-4e08-a293-505c094abc70/router/0.log" Jul 08 17:54:51.544044 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:51.544013 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fxrcw_935d2a80-4507-4c9d-aa0e-326c3bc25de7/serve-healthcheck-canary/0.log" Jul 08 17:54:52.022050 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:52.022015 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-nmpch_e4a2a9da-2675-486c-8bef-b051037fb231/insights-operator/0.log" Jul 08 17:54:52.022953 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:52.022920 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-nmpch_e4a2a9da-2675-486c-8bef-b051037fb231/insights-operator/1.log" Jul 08 17:54:52.125004 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:52.124973 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l7xml_cc974593-c73d-4f6d-9b20-17de46a702b6/kube-rbac-proxy/0.log" Jul 08 17:54:52.148473 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:52.148441 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l7xml_cc974593-c73d-4f6d-9b20-17de46a702b6/exporter/0.log" Jul 08 17:54:52.172627 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:52.172601 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l7xml_cc974593-c73d-4f6d-9b20-17de46a702b6/extractor/0.log" Jul 08 17:54:54.635936 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:54.635907 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gp22x_78f3520d-fa34-40ce-84b2-cab8628e0490/server/0.log" Jul 08 17:54:54.713892 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:54.713858 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jltzl_71eb22b0-86a6-41ee-bd62-e0b32bca36a8/manager/0.log" Jul 08 17:54:54.738239 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:54.738200 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6778fbd4c5-sslms_f9124842-9568-4021-a70a-e02792d17ab9/manager/0.log" Jul 08 17:54:54.762191 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:54.762148 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6778fbd4c5-sslms_f9124842-9568-4021-a70a-e02792d17ab9/copy-manifests/0.log" Jul 08 17:54:54.852220 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:54.852188 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p4s77/perf-node-gather-daemonset-lrgd7" Jul 08 17:54:56.485652 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:56.485621 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4486hk_be11f07d-edab-46b2-9d20-0d5b2cf55835/istio-proxy/0.log" Jul 08 17:54:56.560520 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:56.560486 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7wrrh_f7b9942d-7532-49dc-9b12-37df398b3fef/discovery/0.log" Jul 08 17:54:56.588241 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:56.588208 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55b4df66b5-tj9x5_c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff/kube-auth-proxy/0.log" Jul 08 17:54:56.608344 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:56.608288 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ltxfm_bb8bf282-11a3-41f7-8ade-be41be353e88/istio-proxy/0.log" Jul 08 17:54:56.644625 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:56.644583 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ltxfm_bb8bf282-11a3-41f7-8ade-be41be353e88/istio-proxy/1.log" Jul 08 17:54:56.729654 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:56.729616 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d68bf77dc-pphvl_d5e4bf86-708e-4e08-a293-505c094abc70/router/0.log" Jul 08 17:54:57.805081 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:57.805047 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4486hk_be11f07d-edab-46b2-9d20-0d5b2cf55835/istio-proxy/0.log" Jul 08 17:54:57.881412 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:57.881354 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7wrrh_f7b9942d-7532-49dc-9b12-37df398b3fef/discovery/0.log" Jul 08 17:54:57.912180 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:57.912114 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55b4df66b5-tj9x5_c2d0bf1a-3a52-487e-8d6f-56b0e87af1ff/kube-auth-proxy/0.log" Jul 08 17:54:57.934806 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:57.934775 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ltxfm_bb8bf282-11a3-41f7-8ade-be41be353e88/istio-proxy/0.log" Jul 08 17:54:57.974786 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:57.974743 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ltxfm_bb8bf282-11a3-41f7-8ade-be41be353e88/istio-proxy/1.log" Jul 08 17:54:58.057054 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:54:58.056976 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d68bf77dc-pphvl_d5e4bf86-708e-4e08-a293-505c094abc70/router/0.log" Jul 08 17:55:01.739529 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:55:01.739497 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-2kswq_0bbe62e9-bf21-4977-b63c-6173c46cf195/kube-storage-version-migrator-operator/1.log" Jul 08 17:55:01.740406 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:55:01.740384 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-2kswq_0bbe62e9-bf21-4977-b63c-6173c46cf195/kube-storage-version-migrator-operator/0.log" Jul 08 17:55:03.073859 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:55:03.073827 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fmf67_f653f2c8-1e71-4873-aa01-ff31a98cb14f/kube-multus-additional-cni-plugins/0.log" Jul 08 17:55:03.097584 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:55:03.097559 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fmf67_f653f2c8-1e71-4873-aa01-ff31a98cb14f/egress-router-binary-copy/0.log" Jul 08 17:55:03.122071 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:55:03.122041 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fmf67_f653f2c8-1e71-4873-aa01-ff31a98cb14f/cni-plugins/0.log" Jul 08 17:55:03.149122 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:55:03.149092 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fmf67_f653f2c8-1e71-4873-aa01-ff31a98cb14f/bond-cni-plugin/0.log" Jul 08 17:55:03.174173 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:55:03.174126 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fmf67_f653f2c8-1e71-4873-aa01-ff31a98cb14f/routeoverride-cni/0.log" Jul 08 17:55:03.199369 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:55:03.199340 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fmf67_f653f2c8-1e71-4873-aa01-ff31a98cb14f/whereabouts-cni-bincopy/0.log" Jul 08 17:55:03.226207 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:55:03.226178 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fmf67_f653f2c8-1e71-4873-aa01-ff31a98cb14f/whereabouts-cni/0.log" Jul 08 17:55:03.297786 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:55:03.297738 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xlrfn_8fa60a71-f6c1-45f6-83d5-174ec7b9ecb3/kube-multus/0.log" Jul 08 17:55:03.354232 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:55:03.354143 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f6jwj_506c8214-179c-4cb1-91c2-6f282fdca948/network-metrics-daemon/0.log" Jul 08 17:55:03.379212 ip-10-0-138-180 kubenswrapper[2567]: I0708 17:55:03.379187 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f6jwj_506c8214-179c-4cb1-91c2-6f282fdca948/kube-rbac-proxy/0.log"