Jul 14 22:55:06.834599 ip-10-0-130-2 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 22:55:06.834611 ip-10-0-130-2 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 22:55:06.834618 ip-10-0-130-2 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 22:55:06.834840 ip-10-0-130-2 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 22:55:16.874644 ip-10-0-130-2 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 22:55:16.874661 ip-10-0-130-2 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 124233a9ba684ba5b3dbbe9727a58835 -- Jul 14 22:56:51.257829 ip-10-0-130-2 systemd[1]: Starting Kubernetes Kubelet... Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.706243 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713293 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713310 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713313 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713318 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713323 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713326 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713330 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 22:56:51.732012 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713333 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713336 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713338 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713341 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713344 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713346 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713349 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713351 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713354 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713356 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713359 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713361 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713364 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713367 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713369 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713372 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713375 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713377 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713382 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713385 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 22:56:51.734136 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713388 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713390 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713392 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713395 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713397 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713400 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713403 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713406 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713408 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713411 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713413 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713416 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713418 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713421 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713423 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713426 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713428 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713431 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713434 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713437 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 22:56:51.736780 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713439 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713443 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713446 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713449 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713451 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713454 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713457 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713461 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713464 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713469 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713473 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713476 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713479 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713481 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713484 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713486 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713489 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713491 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713495 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713498 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 22:56:51.738623 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713500 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713503 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713506 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713509 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713512 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713515 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713518 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713521 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713524 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713526 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713528 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713531 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713534 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713537 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713558 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713561 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713564 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713567 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713570 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713572 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 22:56:51.740935 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713575 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713577 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713580 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713585 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713589 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713592 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713595 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713598 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713601 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713603 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713606 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.713609 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714352 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714361 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714364 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714367 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714370 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714373 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714376 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 22:56:51.747719 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714379 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714382 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714384 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714387 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714390 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714393 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714395 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714398 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714401 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714404 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714408 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714410 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714413 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714415 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714418 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714421 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714424 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714426 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714429 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714432 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 22:56:51.750072 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714434 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714437 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714440 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714442 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714445 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714447 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714450 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714452 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714458 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714461 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714464 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714467 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714469 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714472 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714474 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714477 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714480 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714482 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714485 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714488 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 22:56:51.752231 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714491 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714493 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714496 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714499 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714502 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714505 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714507 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714510 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714513 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714515 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714518 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714521 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714523 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714526 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714528 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714531 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714533 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714536 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714555 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714558 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 22:56:51.754614 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714561 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714566 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714569 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714572 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714574 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714577 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714579 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714582 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714588 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714591 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714595 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714598 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714601 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714605 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714607 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714610 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714613 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714616 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714619 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 22:56:51.767738 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714622 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714625 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714627 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714630 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714632 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714635 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714637 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714640 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714659 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714663 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714667 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714671 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.714674 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715246 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715257 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715264 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715269 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715274 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715278 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 22:56:51.770144 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715281 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715285 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715289 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715293 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715298 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715304 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715308 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715312 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715316 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715320 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715324 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715328 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715332 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715336 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715342 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715346 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715350 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715354 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715357 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715360 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 22:56:51.771856 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715363 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715367 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715371 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715375 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715379 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715382 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715386 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715392 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715395 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715399 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715404 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715409 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715414 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715418 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715421 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715426 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715430 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715433 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715437 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 22:56:51.784131 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715441 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715444 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715449 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715453 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715458 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715461 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715465 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715470 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715474 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715477 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715481 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715485 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715488 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715493 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715496 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715500 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715504 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715507 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715511 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 22:56:51.786401 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715514 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715519 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715523 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715527 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715530 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715534 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715553 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715557 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715562 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715566 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715579 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715583 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715586 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715591 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715595 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715598 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715602 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715606 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715611 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715615 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 22:56:51.789158 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715620 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 22:56:51.789159 ip-10-0-130-2 systemd[1]: Started Kubernetes Kubelet. Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715624 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715628 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715631 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715635 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715639 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715642 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715646 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715650 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715654 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715658 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715662 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715665 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715670 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.715675 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715763 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715773 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715782 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715786 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715792 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715796 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 22:56:51.793102 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715803 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715809 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715813 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715818 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715822 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715827 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715832 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715836 2572 flags.go:64] FLAG: --cgroup-root="" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715840 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715844 2572 flags.go:64] FLAG: --client-ca-file="" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715849 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715855 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715861 2572 flags.go:64] FLAG: --cluster-domain="" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715865 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715869 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715873 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715878 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715884 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715888 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715892 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715897 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715902 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715906 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715911 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 22:56:51.810467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715916 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715920 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715926 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715930 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715935 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715938 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715943 2572 flags.go:64] FLAG: --enable-server="true" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715946 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715953 2572 flags.go:64] FLAG: --event-burst="100" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715958 2572 flags.go:64] FLAG: --event-qps="50" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715962 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715966 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715970 2572 flags.go:64] FLAG: --eviction-hard="" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715976 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715981 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715985 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715989 2572 flags.go:64] FLAG: --eviction-soft="" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715992 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.715995 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716001 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716005 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716009 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716013 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716018 2572 flags.go:64] FLAG: --feature-gates="" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716023 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 22:56:51.812959 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716028 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716032 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716036 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716041 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716045 2572 flags.go:64] FLAG: --help="false" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716049 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-130-2.ec2.internal" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716055 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716060 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716066 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716070 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716075 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716080 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716084 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716088 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716093 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716097 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716102 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716106 2572 flags.go:64] FLAG: --kube-reserved="" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716110 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716113 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716116 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716118 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716121 2572 flags.go:64] FLAG: --lock-file="" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716124 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 22:56:51.815976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716126 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716129 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716137 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716141 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716144 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716146 2572 flags.go:64] FLAG: --logging-format="text" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716149 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716152 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716155 2572 flags.go:64] FLAG: --manifest-url="" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716158 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716162 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716165 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716169 2572 flags.go:64] FLAG: --max-pods="110" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716172 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716175 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716179 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716182 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716185 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716188 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716190 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716197 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716201 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716203 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 22:56:52.023892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716207 2572 flags.go:64] FLAG: --pod-cidr="" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716210 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716215 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716218 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716221 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716225 2572 flags.go:64] FLAG: --port="10250" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716229 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716233 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-058fac240ed0d5b3c" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716238 2572 flags.go:64] FLAG: --qos-reserved="" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716242 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716246 2572 flags.go:64] FLAG: --register-node="true" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716252 2572 flags.go:64] FLAG: --register-with-taints="" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716257 2572 flags.go:64] FLAG: --registry-burst="10" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716262 2572 flags.go:64] FLAG: --registry-qps="5" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716267 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716271 2572 flags.go:64] FLAG: --reserved-memory="" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716276 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716280 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716285 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716289 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716294 2572 flags.go:64] FLAG: --runonce="false" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716298 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716303 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716307 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716311 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 22:56:52.025958 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716316 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716321 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716325 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716329 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716333 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716337 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716342 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716346 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716350 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716355 2572 flags.go:64] FLAG: --system-cgroups="" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716358 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716366 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716370 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716374 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716379 2572 flags.go:64] FLAG: --tls-min-version="" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716383 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716387 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716392 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716397 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716402 2572 flags.go:64] FLAG: --v="2" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716407 2572 flags.go:64] FLAG: --version="false" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716414 2572 flags.go:64] FLAG: --vmodule="" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716419 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.716424 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716597 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 22:56:52.042153 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716603 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716607 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716612 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716616 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716620 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716624 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716628 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716633 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716637 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716644 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716649 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716654 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716658 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716661 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716665 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716670 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716674 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716678 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716682 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 22:56:52.043190 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716685 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716688 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716692 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716696 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716700 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716703 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716708 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716712 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716716 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716720 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716724 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716728 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716732 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716735 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716739 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716743 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716746 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716750 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716753 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716757 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 22:56:52.043792 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716762 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716766 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716770 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716774 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716778 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716782 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716785 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716789 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716793 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716797 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716801 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716805 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716809 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716813 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716816 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716820 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716824 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716827 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716832 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716836 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 22:56:52.044837 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716840 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716844 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716848 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716852 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716856 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716859 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716863 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716867 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716870 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716872 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716875 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716880 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716884 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716888 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716892 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716895 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716900 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716904 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716907 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716911 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 22:56:52.045474 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716915 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716919 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716923 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716926 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716930 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716934 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716938 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716941 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716945 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716949 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716955 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716959 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716964 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716969 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716973 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716978 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716982 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716986 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 22:56:52.046283 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.716991 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.717561 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.724586 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.724608 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.724621 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.724627 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724684 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724689 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724693 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724696 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724699 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724702 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724705 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724708 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724711 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 22:56:52.046863 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724714 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724717 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724721 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724724 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724727 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724729 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724734 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724737 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724740 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724743 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724747 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724749 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724752 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724755 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724759 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724762 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724765 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724768 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724771 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 22:56:52.047375 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724774 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724778 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724781 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724784 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724787 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724790 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724792 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724795 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724797 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724800 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724803 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724807 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724810 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724813 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724815 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724818 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724820 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724823 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724826 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724829 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 22:56:52.047909 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724831 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724834 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724836 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724841 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724844 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724847 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724849 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724852 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724854 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724857 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724860 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724862 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724865 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724868 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724871 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724874 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724877 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724881 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724883 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724886 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 22:56:52.048469 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724889 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724891 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724894 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724897 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724899 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724902 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724904 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724907 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724909 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724912 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724915 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724917 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724920 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724922 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724926 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724933 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724936 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724939 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724942 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 22:56:52.049013 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724945 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724948 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724951 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724954 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724957 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724960 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724962 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724965 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724968 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724971 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724976 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.724979 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.724984 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725100 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725105 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 22:56:52.049577 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725108 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725111 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725114 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725116 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725119 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725122 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725124 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725127 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725129 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725133 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725137 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725139 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725142 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725146 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725149 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725152 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725155 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725157 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725160 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 22:56:52.049990 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725162 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725165 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725168 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725170 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725172 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725175 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725178 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725181 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725183 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725187 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725190 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725192 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725195 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725198 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725201 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725203 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725206 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725208 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725211 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 22:56:52.050525 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725213 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725216 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725218 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725221 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725224 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725226 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725229 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725233 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725235 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725238 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725240 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725243 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725245 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725248 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725250 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725253 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725255 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725258 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725260 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725263 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 22:56:52.051068 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725265 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725269 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725273 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725275 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725278 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725282 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725285 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725288 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725291 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725293 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725296 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725299 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725302 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725304 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725307 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725309 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725312 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725315 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725317 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725321 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 22:56:52.051695 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725324 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725326 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725329 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725331 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725334 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725336 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725339 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725342 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725344 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725347 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725349 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725352 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725354 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725357 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725361 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725364 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725367 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725370 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 22:56:52.052233 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:51.725374 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 22:56:52.052775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.725379 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 22:56:52.052775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.725507 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 22:56:52.052775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.728672 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 22:56:52.052775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.730658 2572 server.go:1019] "Starting client certificate rotation" Jul 14 22:56:52.052775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.730760 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 22:56:52.052775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.730802 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 22:56:52.052775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.733666 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 22:56:52.052775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.739194 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 22:56:52.052775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.754371 2572 log.go:25] "Validated CRI v1 runtime API" Jul 14 22:56:52.052775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.756617 2572 log.go:25] "Validated CRI v1 image API" Jul 14 22:56:52.052775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.757291 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 22:56:52.052775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.759790 2572 fs.go:135] Filesystem UUIDs: map[678ee3f2-11ce-4878-a745-d26165ea8991:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cf3f1991-5cc5-4398-a387-a4168cf15b53:/dev/nvme0n1p3] Jul 14 22:56:52.053129 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.759811 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 22:56:52.053129 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.763697 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.765578 2572 manager.go:216] Machine: {Timestamp:2026-07-14 22:56:51.764363485 +0000 UTC m=+0.381025170 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099940 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f2a8a31efafff78aea29e1ccbf2eb SystemUUID:ec2f2a8a-31ef-afff-78ae-a29e1ccbf2eb BootID:124233a9-ba68-4ba5-b3db-be9727a58835 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:61:5a:cd:46:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:61:5a:cd:46:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:10:ef:a4:93:0c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.765680 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.765758 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.766934 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.767374 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-2.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.768618 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.768630 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.768836 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.768851 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.771744 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.775039 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.775164 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.775194 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.775205 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.775219 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.775227 2572 kubelet.go:398] "Adding apiserver pod source" Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.775236 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 22:56:52.179496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.775607 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.775623 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.778010 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.780936 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.780981 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.782385 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.782400 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.782407 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.782413 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.782422 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.782427 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.782436 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.782441 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.782449 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.782455 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.782463 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.782469 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.783964 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.783977 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.788108 2572 server.go:1268] "Started kubelet" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.788292 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.788295 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.788335 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.789163 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-2.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.789206 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.789255 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-2.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.789756 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.790969 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.794252 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.795524 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.795553 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.795624 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.796099 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.796117 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.796101 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.796204 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.796213 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.796335 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.796348 2572 factory.go:55] Registering systemd factory Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.796355 2572 factory.go:223] Registration of the systemd container factory successfully Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.796614 2572 factory.go:153] Registering CRI-O factory Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.796627 2572 factory.go:223] Registration of the crio container factory successfully Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.796648 2572 factory.go:103] Registering Raw factory Jul 14 22:56:52.180214 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.796659 2572 manager.go:1196] Started watching for new ooms in manager Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.795661 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-2.ec2.internal.18c24a0a9a205dcb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-2.ec2.internal,UID:ip-10-0-130-2.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-2.ec2.internal,},FirstTimestamp:2026-07-14 22:56:51.788078539 +0000 UTC m=+0.404740224,LastTimestamp:2026-07-14 22:56:51.788078539 +0000 UTC m=+0.404740224,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-2.ec2.internal,}" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.798100 2572 manager.go:349] Starting recovery of all containers Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.805302 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-2.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.805442 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.811104 2572 manager.go:354] Recovery completed Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.816189 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.818134 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.818294 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.818308 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.818905 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.818914 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.818929 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.818939 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.820181 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.820201 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.820210 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.820595 2572 policy_none.go:49] "None policy: Start" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.821118 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.821141 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.821274 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w7wzn" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.821358 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-2.ec2.internal.18c24a0a9bed20da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-2.ec2.internal,UID:ip-10-0-130-2.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-2.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-2.ec2.internal,},FirstTimestamp:2026-07-14 22:56:51.818275034 +0000 UTC m=+0.434936719,LastTimestamp:2026-07-14 22:56:51.818275034 +0000 UTC m=+0.434936719,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-2.ec2.internal,}" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.822151 2572 policy_none.go:47] "Start" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.830413 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w7wzn" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.830960 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-2.ec2.internal.18c24a0a9bed86ee default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-2.ec2.internal,UID:ip-10-0-130-2.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-2.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-2.ec2.internal,},FirstTimestamp:2026-07-14 22:56:51.818301166 +0000 UTC m=+0.434962851,LastTimestamp:2026-07-14 22:56:51.818301166 +0000 UTC m=+0.434962851,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-2.ec2.internal,}" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.875143 2572 manager.go:337] "Starting Device Plugin manager" Jul 14 22:56:52.182155 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.875174 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.875185 2572 server.go:87] "Starting device plugin registration server" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.875450 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.875461 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.875566 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.875636 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.875644 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.876202 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.876252 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.902514 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.903732 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.903766 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.903786 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.903818 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.905889 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.975578 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.977086 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.977115 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.977129 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.977160 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:51.986733 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:51.986756 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-2.ec2.internal\": node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:52.002084 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.004141 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-2.ec2.internal"] Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.004202 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.005065 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.005094 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.005114 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.006489 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.006607 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.006636 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.008472 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.008502 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.008521 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.009071 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.009098 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.009110 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.010270 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.010290 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.011155 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.011183 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.011197 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:56:52.182930 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:52.057690 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-2.ec2.internal\" not found" node="ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.184010 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:52.064081 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-2.ec2.internal\" not found" node="ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.184010 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.097789 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af33ff80b67406ee580f6a2f5c9820b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal\" (UID: \"af33ff80b67406ee580f6a2f5c9820b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.184010 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.097823 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af33ff80b67406ee580f6a2f5c9820b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal\" (UID: \"af33ff80b67406ee580f6a2f5c9820b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.184010 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.097848 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5fc01eedff708540538bb5f52d24e9e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-2.ec2.internal\" (UID: \"a5fc01eedff708540538bb5f52d24e9e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.184010 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:52.102281 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:52.321886 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.198422 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af33ff80b67406ee580f6a2f5c9820b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal\" (UID: \"af33ff80b67406ee580f6a2f5c9820b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.321886 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.198452 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af33ff80b67406ee580f6a2f5c9820b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal\" (UID: \"af33ff80b67406ee580f6a2f5c9820b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.321886 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.198469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5fc01eedff708540538bb5f52d24e9e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-2.ec2.internal\" (UID: \"a5fc01eedff708540538bb5f52d24e9e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.321886 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.198497 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5fc01eedff708540538bb5f52d24e9e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-2.ec2.internal\" (UID: \"a5fc01eedff708540538bb5f52d24e9e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.321886 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.198521 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af33ff80b67406ee580f6a2f5c9820b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal\" (UID: \"af33ff80b67406ee580f6a2f5c9820b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.321886 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.198513 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af33ff80b67406ee580f6a2f5c9820b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal\" (UID: \"af33ff80b67406ee580f6a2f5c9820b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.321886 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:52.202500 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:52.321886 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:52.303392 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:52.433748 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.360576 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.433748 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.367028 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-2.ec2.internal" Jul 14 22:56:52.433748 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:52.403899 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:52.542175 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:52.504435 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:52.658098 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:52.604927 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:52.781145 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:52.705221 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:52.781145 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.730241 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 22:56:52.781145 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.730426 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 22:56:52.881962 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:52.805832 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:52.881962 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.835477 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 22:51:52 +0000 UTC" deadline="2028-04-29 11:21:43.556829772 +0000 UTC" Jul 14 22:56:52.881962 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.835517 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15708h24m50.721318398s" Jul 14 22:56:52.881962 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.847757 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 22:56:52.881962 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.850427 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientMemory" Jul 14 22:56:52.881962 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.850460 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 22:56:52.881962 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:52.850471 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeHasSufficientPID" Jul 14 22:56:52.977926 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:52.906484 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:53.089099 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:53.006830 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-2.ec2.internal\" not found" Jul 14 22:56:53.089099 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.036763 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 22:56:53.205657 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.106680 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" Jul 14 22:56:53.205657 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.114227 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 22:56:53.205657 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.121254 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 22:56:53.205657 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.122207 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-2.ec2.internal" Jul 14 22:56:53.205657 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:53.130314 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf33ff80b67406ee580f6a2f5c9820b8.slice/crio-335c9b6f5e866f808bf9372051a7bfa2529a305516935c907017af7337bd7dc2 WatchSource:0}: Error finding container 335c9b6f5e866f808bf9372051a7bfa2529a305516935c907017af7337bd7dc2: Status 404 returned error can't find the container with id 335c9b6f5e866f808bf9372051a7bfa2529a305516935c907017af7337bd7dc2 Jul 14 22:56:53.205657 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:53.130722 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fc01eedff708540538bb5f52d24e9e.slice/crio-279d296cd066a10259aa2abb8cb9036c34c92720ca141a2e2134d9494ca630d6 WatchSource:0}: Error finding container 279d296cd066a10259aa2abb8cb9036c34c92720ca141a2e2134d9494ca630d6: Status 404 returned error can't find the container with id 279d296cd066a10259aa2abb8cb9036c34c92720ca141a2e2134d9494ca630d6 Jul 14 22:56:53.205657 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.130736 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 22:56:53.205657 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.145258 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 22:56:53.365565 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.244289 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 22:56:53.777141 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.775898 2572 apiserver.go:52] "Watching apiserver" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.785919 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.786343 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-v5k7g","openshift-image-registry/node-ca-xnjpp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal","openshift-multus/multus-q257d","openshift-multus/network-metrics-daemon-fgjds","openshift-network-operator/iptables-alerter-kwbhm","kube-system/konnectivity-agent-4z959","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7","openshift-cluster-node-tuning-operator/tuned-n8gn9","openshift-multus/multus-additional-cni-plugins-s4b8q","openshift-network-diagnostics/network-check-target-84br9","openshift-ovn-kubernetes/ovnkube-node-98b67","kube-system/global-pull-secret-syncer-pn6sh","kube-system/kube-apiserver-proxy-ip-10-0-130-2.ec2.internal"] Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.789005 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4z959" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.791333 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:53.791419 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.793908 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.794095 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.794444 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.795947 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.796232 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q257d" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.796578 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lp8pr\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.798761 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:53.798817 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.799403 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.799565 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.800030 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nzpml\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.800060 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.800078 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.800245 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.800631 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kwbhm" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.801147 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.801204 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4rffc\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.801209 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.803114 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.803918 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.803942 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.804184 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-clmww\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.804187 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.805945 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5k7g" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.806456 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 22:56:53.841749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.806486 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rcjxj\"" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.806519 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.808076 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xnjpp" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.809041 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fkjb4\"" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.809484 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.809910 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.810773 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-socket-dir\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.810800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-registration-dir\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.810823 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-var-lib-cni-multus\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.810844 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-hostroot\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.810870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-multus-conf-dir\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.810891 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1024b4d-03b0-4d83-928e-d04a0fe55861-dbus\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.810911 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zggmg\" (UniqueName: \"kubernetes.io/projected/021925ca-6e34-4e06-b282-2081f65724f0-kube-api-access-zggmg\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.810930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-os-release\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.810951 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.810953 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-run-k8s-cni-cncf-io\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-system-cni-dir\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811075 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-cnibin\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811096 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/021925ca-6e34-4e06-b282-2081f65724f0-multus-daemon-config\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811119 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxhxc\" (UniqueName: \"kubernetes.io/projected/47316235-0c7a-4121-9099-3b86679137ba-kube-api-access-hxhxc\") pod \"network-metrics-daemon-fgjds\" (UID: \"47316235-0c7a-4121-9099-3b86679137ba\") " pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811140 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.847052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811203 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811201 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7zvk\" (UniqueName: \"kubernetes.io/projected/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-kube-api-access-x7zvk\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811249 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-multus-socket-dir-parent\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811286 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-run-netns\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811305 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-var-lib-cni-bin\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811325 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-run-multus-certs\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811350 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811439 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811344 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1024b4d-03b0-4d83-928e-d04a0fe55861-kubelet-config\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811439 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jxksr\"" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811572 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-sys-fs\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811603 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-etc-kubernetes\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811640 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/38438969-9483-4e29-8c82-414077938b43-agent-certs\") pod \"konnectivity-agent-4z959\" (UID: \"38438969-9483-4e29-8c82-414077938b43\") " pod="kube-system/konnectivity-agent-4z959" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811661 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/38438969-9483-4e29-8c82-414077938b43-konnectivity-ca\") pod \"konnectivity-agent-4z959\" (UID: \"38438969-9483-4e29-8c82-414077938b43\") " pod="kube-system/konnectivity-agent-4z959" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811682 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811703 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-var-lib-kubelet\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811753 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs\") pod \"network-metrics-daemon-fgjds\" (UID: \"47316235-0c7a-4121-9099-3b86679137ba\") " pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811788 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:53.848474 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811813 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-device-dir\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811864 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-multus-cni-dir\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.811896 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/021925ca-6e34-4e06-b282-2081f65724f0-cni-binary-copy\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.814824 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:53.814910 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.816376 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.816727 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pxzld\"" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.816901 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.817007 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.822739 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.822848 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.823002 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.823060 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.823157 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.823405 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.823634 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.823779 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ff7p7\"" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.856555 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2r59w" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.869982 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2r59w" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.897851 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912105 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ccbl\" (UniqueName: \"kubernetes.io/projected/8eabff28-0ba3-4893-a7a0-f167a98700f6-kube-api-access-6ccbl\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7559daa9-b3da-4594-8163-12e31455b252-ovn-node-metrics-cert\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912169 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqcbm\" (UniqueName: \"kubernetes.io/projected/1f9cc78f-778b-4688-ba5d-66d909ec321f-kube-api-access-tqcbm\") pod \"iptables-alerter-kwbhm\" (UID: \"1f9cc78f-778b-4688-ba5d-66d909ec321f\") " pod="openshift-network-operator/iptables-alerter-kwbhm" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912195 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/657fd608-a02e-4549-8ddb-fc3804266929-serviceca\") pod \"node-ca-xnjpp\" (UID: \"657fd608-a02e-4549-8ddb-fc3804266929\") " pod="openshift-image-registry/node-ca-xnjpp" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912222 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/511a080e-cdd5-4403-bc46-b986daa2fa40-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:53.935260 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912249 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/511a080e-cdd5-4403-bc46-b986daa2fa40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912279 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/021925ca-6e34-4e06-b282-2081f65724f0-multus-daemon-config\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912303 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/511a080e-cdd5-4403-bc46-b986daa2fa40-os-release\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912330 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/511a080e-cdd5-4403-bc46-b986daa2fa40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912357 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/511a080e-cdd5-4403-bc46-b986daa2fa40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912386 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7zvk\" (UniqueName: \"kubernetes.io/projected/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-kube-api-access-x7zvk\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912413 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-run-multus-certs\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912436 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-kubernetes\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912464 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1024b4d-03b0-4d83-928e-d04a0fe55861-kubelet-config\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912489 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-etc-kubernetes\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912512 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-cni-netd\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kztwj\" (UniqueName: \"kubernetes.io/projected/7559daa9-b3da-4594-8163-12e31455b252-kube-api-access-kztwj\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912567 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/38438969-9483-4e29-8c82-414077938b43-agent-certs\") pod \"konnectivity-agent-4z959\" (UID: \"38438969-9483-4e29-8c82-414077938b43\") " pod="kube-system/konnectivity-agent-4z959" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912593 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912642 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-var-lib-kubelet\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912667 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-systemd-units\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.937007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912691 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-cni-bin\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912718 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs\") pod \"network-metrics-daemon-fgjds\" (UID: \"47316235-0c7a-4121-9099-3b86679137ba\") " pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912751 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-device-dir\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-multus-cni-dir\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912799 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-modprobe-d\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912827 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-sysctl-conf\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-lib-modules\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912887 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912915 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7559daa9-b3da-4594-8163-12e31455b252-ovnkube-config\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-socket-dir\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.912978 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-registration-dir\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913008 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-hostroot\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913033 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-var-lib-kubelet\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913068 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn5rs\" (UniqueName: \"kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs\") pod \"network-check-target-84br9\" (UID: \"1c8536f6-15f3-4d84-9b99-4f051233feac\") " pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913094 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-run-openvswitch\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913119 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd-tmp-dir\") pod \"node-resolver-v5k7g\" (UID: \"5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd\") " pod="openshift-dns/node-resolver-v5k7g" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913170 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eabff28-0ba3-4893-a7a0-f167a98700f6-tmp\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.938149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913195 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-etc-openvswitch\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913226 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-run-ovn\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913253 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-os-release\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-run-k8s-cni-cncf-io\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913310 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-sysctl-d\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-sys\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913365 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-run-systemd\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913403 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-log-socket\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913429 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd-hosts-file\") pod \"node-resolver-v5k7g\" (UID: \"5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd\") " pod="openshift-dns/node-resolver-v5k7g" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913458 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-system-cni-dir\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913486 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-cnibin\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913510 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7559daa9-b3da-4594-8163-12e31455b252-env-overrides\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f9cc78f-778b-4688-ba5d-66d909ec321f-iptables-alerter-script\") pod \"iptables-alerter-kwbhm\" (UID: \"1f9cc78f-778b-4688-ba5d-66d909ec321f\") " pod="openshift-network-operator/iptables-alerter-kwbhm" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913567 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxhxc\" (UniqueName: \"kubernetes.io/projected/47316235-0c7a-4121-9099-3b86679137ba-kube-api-access-hxhxc\") pod \"network-metrics-daemon-fgjds\" (UID: \"47316235-0c7a-4121-9099-3b86679137ba\") " pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913595 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913637 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-multus-socket-dir-parent\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-run-netns\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.939759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913691 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-var-lib-cni-bin\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913716 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-kubelet\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913743 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/511a080e-cdd5-4403-bc46-b986daa2fa40-system-cni-dir\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913781 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-sys-fs\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913808 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7559daa9-b3da-4594-8163-12e31455b252-ovnkube-script-lib\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913836 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnw8v\" (UniqueName: \"kubernetes.io/projected/5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd-kube-api-access-hnw8v\") pod \"node-resolver-v5k7g\" (UID: \"5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd\") " pod="openshift-dns/node-resolver-v5k7g" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913865 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ftqh\" (UniqueName: \"kubernetes.io/projected/657fd608-a02e-4549-8ddb-fc3804266929-kube-api-access-9ftqh\") pod \"node-ca-xnjpp\" (UID: \"657fd608-a02e-4549-8ddb-fc3804266929\") " pod="openshift-image-registry/node-ca-xnjpp" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913892 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf6bp\" (UniqueName: \"kubernetes.io/projected/511a080e-cdd5-4403-bc46-b986daa2fa40-kube-api-access-hf6bp\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913920 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/38438969-9483-4e29-8c82-414077938b43-konnectivity-ca\") pod \"konnectivity-agent-4z959\" (UID: \"38438969-9483-4e29-8c82-414077938b43\") " pod="kube-system/konnectivity-agent-4z959" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913948 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-sysconfig\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913973 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-run\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.913999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-run-netns\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-node-log\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/657fd608-a02e-4549-8ddb-fc3804266929-host\") pod \"node-ca-xnjpp\" (UID: \"657fd608-a02e-4549-8ddb-fc3804266929\") " pod="openshift-image-registry/node-ca-xnjpp" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914081 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/511a080e-cdd5-4403-bc46-b986daa2fa40-cnibin\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914109 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914137 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/021925ca-6e34-4e06-b282-2081f65724f0-cni-binary-copy\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.940950 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914163 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-tuned\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914191 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-slash\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914217 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f9cc78f-778b-4688-ba5d-66d909ec321f-host-slash\") pod \"iptables-alerter-kwbhm\" (UID: \"1f9cc78f-778b-4688-ba5d-66d909ec321f\") " pod="openshift-network-operator/iptables-alerter-kwbhm" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914247 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-var-lib-cni-multus\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914275 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-multus-conf-dir\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914305 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-run-ovn-kubernetes\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914336 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1024b4d-03b0-4d83-928e-d04a0fe55861-dbus\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914365 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zggmg\" (UniqueName: \"kubernetes.io/projected/021925ca-6e34-4e06-b282-2081f65724f0-kube-api-access-zggmg\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914391 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-host\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-var-lib-openvswitch\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.914445 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-systemd\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.915150 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/021925ca-6e34-4e06-b282-2081f65724f0-multus-daemon-config\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.915532 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-run-multus-certs\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.915630 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1024b4d-03b0-4d83-928e-d04a0fe55861-kubelet-config\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.915679 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-etc-kubernetes\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.916020 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.916990 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.917044 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-var-lib-kubelet\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.942482 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:53.917153 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:53.917215 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs podName:47316235-0c7a-4121-9099-3b86679137ba nodeName:}" failed. No retries permitted until 2026-07-14 22:56:54.417191387 +0000 UTC m=+3.033853064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs") pod "network-metrics-daemon-fgjds" (UID: "47316235-0c7a-4121-9099-3b86679137ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.917275 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-device-dir\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.917419 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-multus-cni-dir\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.917577 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-socket-dir\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.917646 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-registration-dir\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.917696 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-hostroot\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.917837 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-os-release\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.917880 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-run-k8s-cni-cncf-io\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.917979 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-system-cni-dir\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.918027 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-cnibin\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.918477 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.918540 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-multus-socket-dir-parent\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.918582 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-run-netns\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.918642 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-var-lib-cni-bin\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.918725 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-sys-fs\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.919272 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/38438969-9483-4e29-8c82-414077938b43-konnectivity-ca\") pod \"konnectivity-agent-4z959\" (UID: \"38438969-9483-4e29-8c82-414077938b43\") " pod="kube-system/konnectivity-agent-4z959" Jul 14 22:56:53.943584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.919486 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1024b4d-03b0-4d83-928e-d04a0fe55861-dbus\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:53.944577 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.919603 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-multus-conf-dir\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.944577 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:53.920050 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:56:53.944577 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:53.920105 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret podName:c1024b4d-03b0-4d83-928e-d04a0fe55861 nodeName:}" failed. No retries permitted until 2026-07-14 22:56:54.420087858 +0000 UTC m=+3.036749537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret") pod "global-pull-secret-syncer-pn6sh" (UID: "c1024b4d-03b0-4d83-928e-d04a0fe55861") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:56:53.944577 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.920328 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/021925ca-6e34-4e06-b282-2081f65724f0-cni-binary-copy\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.944577 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.920585 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/021925ca-6e34-4e06-b282-2081f65724f0-host-var-lib-cni-multus\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.944577 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.923586 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/38438969-9483-4e29-8c82-414077938b43-agent-certs\") pod \"konnectivity-agent-4z959\" (UID: \"38438969-9483-4e29-8c82-414077938b43\") " pod="kube-system/konnectivity-agent-4z959" Jul 14 22:56:53.944577 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.926531 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7zvk\" (UniqueName: \"kubernetes.io/projected/0356fd44-6a0a-4642-9ebe-1ce2563a7b53-kube-api-access-x7zvk\") pod \"aws-ebs-csi-driver-node-m7jb7\" (UID: \"0356fd44-6a0a-4642-9ebe-1ce2563a7b53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:53.944577 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.929405 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxhxc\" (UniqueName: \"kubernetes.io/projected/47316235-0c7a-4121-9099-3b86679137ba-kube-api-access-hxhxc\") pod \"network-metrics-daemon-fgjds\" (UID: \"47316235-0c7a-4121-9099-3b86679137ba\") " pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:56:53.944577 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.935940 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zggmg\" (UniqueName: \"kubernetes.io/projected/021925ca-6e34-4e06-b282-2081f65724f0-kube-api-access-zggmg\") pod \"multus-q257d\" (UID: \"021925ca-6e34-4e06-b282-2081f65724f0\") " pod="openshift-multus/multus-q257d" Jul 14 22:56:53.967825 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.967769 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" event={"ID":"af33ff80b67406ee580f6a2f5c9820b8","Type":"ContainerStarted","Data":"335c9b6f5e866f808bf9372051a7bfa2529a305516935c907017af7337bd7dc2"} Jul 14 22:56:53.969977 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:53.969941 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-2.ec2.internal" event={"ID":"a5fc01eedff708540538bb5f52d24e9e","Type":"ContainerStarted","Data":"279d296cd066a10259aa2abb8cb9036c34c92720ca141a2e2134d9494ca630d6"} Jul 14 22:56:54.015773 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.015737 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-kubernetes\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.015961 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.015786 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-cni-netd\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.015961 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.015813 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kztwj\" (UniqueName: \"kubernetes.io/projected/7559daa9-b3da-4594-8163-12e31455b252-kube-api-access-kztwj\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.015961 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.015839 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-systemd-units\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.015961 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.015862 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-cni-bin\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.015961 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.015875 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-kubernetes\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.015961 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.015906 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-modprobe-d\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.015961 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.015932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-sysctl-conf\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.015961 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.015957 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-lib-modules\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.015967 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-cni-bin\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.015984 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016006 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-systemd-units\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.015931 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-cni-netd\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016012 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7559daa9-b3da-4594-8163-12e31455b252-ovnkube-config\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016139 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-modprobe-d\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016155 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-var-lib-kubelet\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016217 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-var-lib-kubelet\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016221 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016259 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn5rs\" (UniqueName: \"kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs\") pod \"network-check-target-84br9\" (UID: \"1c8536f6-15f3-4d84-9b99-4f051233feac\") " pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016293 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-run-openvswitch\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016319 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd-tmp-dir\") pod \"node-resolver-v5k7g\" (UID: \"5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd\") " pod="openshift-dns/node-resolver-v5k7g" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016343 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eabff28-0ba3-4893-a7a0-f167a98700f6-tmp\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016347 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-lib-modules\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016369 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-etc-openvswitch\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016393 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-run-openvswitch\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.016441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016397 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-run-ovn\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016430 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-sysctl-d\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016471 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-sys\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016498 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-run-systemd\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016520 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-sysctl-conf\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016522 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-log-socket\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016557 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-log-socket\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016607 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd-hosts-file\") pod \"node-resolver-v5k7g\" (UID: \"5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd\") " pod="openshift-dns/node-resolver-v5k7g" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.016664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7559daa9-b3da-4594-8163-12e31455b252-env-overrides\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.017032 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f9cc78f-778b-4688-ba5d-66d909ec321f-iptables-alerter-script\") pod \"iptables-alerter-kwbhm\" (UID: \"1f9cc78f-778b-4688-ba5d-66d909ec321f\") " pod="openshift-network-operator/iptables-alerter-kwbhm" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.017090 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-kubelet\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.017110 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-etc-openvswitch\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.017126 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/511a080e-cdd5-4403-bc46-b986daa2fa40-system-cni-dir\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.017185 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7559daa9-b3da-4594-8163-12e31455b252-ovnkube-script-lib\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.017179 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/511a080e-cdd5-4403-bc46-b986daa2fa40-system-cni-dir\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.017230 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnw8v\" (UniqueName: \"kubernetes.io/projected/5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd-kube-api-access-hnw8v\") pod \"node-resolver-v5k7g\" (UID: \"5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd\") " pod="openshift-dns/node-resolver-v5k7g" Jul 14 22:56:54.017259 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.017234 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-sysctl-d\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.018048 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.017274 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftqh\" (UniqueName: \"kubernetes.io/projected/657fd608-a02e-4549-8ddb-fc3804266929-kube-api-access-9ftqh\") pod \"node-ca-xnjpp\" (UID: \"657fd608-a02e-4549-8ddb-fc3804266929\") " pod="openshift-image-registry/node-ca-xnjpp" Jul 14 22:56:54.018048 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.017899 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd-tmp-dir\") pod \"node-resolver-v5k7g\" (UID: \"5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd\") " pod="openshift-dns/node-resolver-v5k7g" Jul 14 22:56:54.018143 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018087 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f9cc78f-778b-4688-ba5d-66d909ec321f-iptables-alerter-script\") pod \"iptables-alerter-kwbhm\" (UID: \"1f9cc78f-778b-4688-ba5d-66d909ec321f\") " pod="openshift-network-operator/iptables-alerter-kwbhm" Jul 14 22:56:54.018143 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.017277 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd-hosts-file\") pod \"node-resolver-v5k7g\" (UID: \"5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd\") " pod="openshift-dns/node-resolver-v5k7g" Jul 14 22:56:54.018717 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018450 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-kubelet\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.018717 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018509 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7559daa9-b3da-4594-8163-12e31455b252-ovnkube-script-lib\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.018717 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018521 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-run-ovn\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.018717 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018532 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7559daa9-b3da-4594-8163-12e31455b252-ovnkube-config\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.018717 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018661 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf6bp\" (UniqueName: \"kubernetes.io/projected/511a080e-cdd5-4403-bc46-b986daa2fa40-kube-api-access-hf6bp\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.018717 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018682 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-sys\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.018717 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018700 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-sysconfig\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.018717 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018707 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-run-systemd\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.018717 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018734 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-run\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018766 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-run-netns\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018778 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-sysconfig\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018799 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-node-log\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/657fd608-a02e-4549-8ddb-fc3804266929-host\") pod \"node-ca-xnjpp\" (UID: \"657fd608-a02e-4549-8ddb-fc3804266929\") " pod="openshift-image-registry/node-ca-xnjpp" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018842 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-run\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018856 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/511a080e-cdd5-4403-bc46-b986daa2fa40-cnibin\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018904 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-node-log\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018910 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-tuned\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018940 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-slash\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018961 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-run-netns\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.018965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f9cc78f-778b-4688-ba5d-66d909ec321f-host-slash\") pod \"iptables-alerter-kwbhm\" (UID: \"1f9cc78f-778b-4688-ba5d-66d909ec321f\") " pod="openshift-network-operator/iptables-alerter-kwbhm" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019011 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-run-ovn-kubernetes\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019024 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/657fd608-a02e-4549-8ddb-fc3804266929-host\") pod \"node-ca-xnjpp\" (UID: \"657fd608-a02e-4549-8ddb-fc3804266929\") " pod="openshift-image-registry/node-ca-xnjpp" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019064 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-host\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019098 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-var-lib-openvswitch\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019129 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-systemd\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019160 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ccbl\" (UniqueName: \"kubernetes.io/projected/8eabff28-0ba3-4893-a7a0-f167a98700f6-kube-api-access-6ccbl\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.019255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019202 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7559daa9-b3da-4594-8163-12e31455b252-ovn-node-metrics-cert\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019180 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7559daa9-b3da-4594-8163-12e31455b252-env-overrides\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019327 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-var-lib-openvswitch\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqcbm\" (UniqueName: \"kubernetes.io/projected/1f9cc78f-778b-4688-ba5d-66d909ec321f-kube-api-access-tqcbm\") pod \"iptables-alerter-kwbhm\" (UID: \"1f9cc78f-778b-4688-ba5d-66d909ec321f\") " pod="openshift-network-operator/iptables-alerter-kwbhm" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019365 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/657fd608-a02e-4549-8ddb-fc3804266929-serviceca\") pod \"node-ca-xnjpp\" (UID: \"657fd608-a02e-4549-8ddb-fc3804266929\") " pod="openshift-image-registry/node-ca-xnjpp" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019393 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-run-ovn-kubernetes\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019409 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/511a080e-cdd5-4403-bc46-b986daa2fa40-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019442 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/511a080e-cdd5-4403-bc46-b986daa2fa40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019453 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f9cc78f-778b-4688-ba5d-66d909ec321f-host-slash\") pod \"iptables-alerter-kwbhm\" (UID: \"1f9cc78f-778b-4688-ba5d-66d909ec321f\") " pod="openshift-network-operator/iptables-alerter-kwbhm" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/511a080e-cdd5-4403-bc46-b986daa2fa40-os-release\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019502 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/511a080e-cdd5-4403-bc46-b986daa2fa40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019507 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-host\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019545 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/511a080e-cdd5-4403-bc46-b986daa2fa40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019565 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/511a080e-cdd5-4403-bc46-b986daa2fa40-cnibin\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019614 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7559daa9-b3da-4594-8163-12e31455b252-host-slash\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019675 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-systemd\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.019991 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/511a080e-cdd5-4403-bc46-b986daa2fa40-os-release\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.021187 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.020046 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/657fd608-a02e-4549-8ddb-fc3804266929-serviceca\") pod \"node-ca-xnjpp\" (UID: \"657fd608-a02e-4549-8ddb-fc3804266929\") " pod="openshift-image-registry/node-ca-xnjpp" Jul 14 22:56:54.022102 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.020501 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/511a080e-cdd5-4403-bc46-b986daa2fa40-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.022102 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.020632 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/511a080e-cdd5-4403-bc46-b986daa2fa40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.022102 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.020677 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/511a080e-cdd5-4403-bc46-b986daa2fa40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.022102 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.020948 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/511a080e-cdd5-4403-bc46-b986daa2fa40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.026223 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:54.025859 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:56:54.026223 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:54.025883 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:56:54.026223 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:54.025893 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dn5rs for pod openshift-network-diagnostics/network-check-target-84br9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:56:54.026223 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:54.025955 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs podName:1c8536f6-15f3-4d84-9b99-4f051233feac nodeName:}" failed. No retries permitted until 2026-07-14 22:56:54.525941187 +0000 UTC m=+3.142602861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dn5rs" (UniqueName: "kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs") pod "network-check-target-84br9" (UID: "1c8536f6-15f3-4d84-9b99-4f051233feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:56:54.026223 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.026015 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eabff28-0ba3-4893-a7a0-f167a98700f6-tmp\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.026584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.026375 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8eabff28-0ba3-4893-a7a0-f167a98700f6-etc-tuned\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.027718 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.027696 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7559daa9-b3da-4594-8163-12e31455b252-ovn-node-metrics-cert\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.031400 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.031294 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf6bp\" (UniqueName: \"kubernetes.io/projected/511a080e-cdd5-4403-bc46-b986daa2fa40-kube-api-access-hf6bp\") pod \"multus-additional-cni-plugins-s4b8q\" (UID: \"511a080e-cdd5-4403-bc46-b986daa2fa40\") " pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.031400 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.031357 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqcbm\" (UniqueName: \"kubernetes.io/projected/1f9cc78f-778b-4688-ba5d-66d909ec321f-kube-api-access-tqcbm\") pod \"iptables-alerter-kwbhm\" (UID: \"1f9cc78f-778b-4688-ba5d-66d909ec321f\") " pod="openshift-network-operator/iptables-alerter-kwbhm" Jul 14 22:56:54.031864 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.031836 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kztwj\" (UniqueName: \"kubernetes.io/projected/7559daa9-b3da-4594-8163-12e31455b252-kube-api-access-kztwj\") pod \"ovnkube-node-98b67\" (UID: \"7559daa9-b3da-4594-8163-12e31455b252\") " pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.032048 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.032001 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnw8v\" (UniqueName: \"kubernetes.io/projected/5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd-kube-api-access-hnw8v\") pod \"node-resolver-v5k7g\" (UID: \"5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd\") " pod="openshift-dns/node-resolver-v5k7g" Jul 14 22:56:54.033313 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.033274 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ftqh\" (UniqueName: \"kubernetes.io/projected/657fd608-a02e-4549-8ddb-fc3804266929-kube-api-access-9ftqh\") pod \"node-ca-xnjpp\" (UID: \"657fd608-a02e-4549-8ddb-fc3804266929\") " pod="openshift-image-registry/node-ca-xnjpp" Jul 14 22:56:54.033392 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.033333 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ccbl\" (UniqueName: \"kubernetes.io/projected/8eabff28-0ba3-4893-a7a0-f167a98700f6-kube-api-access-6ccbl\") pod \"tuned-n8gn9\" (UID: \"8eabff28-0ba3-4893-a7a0-f167a98700f6\") " pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.046360 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.046183 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 22:56:54.103874 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.103742 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4z959" Jul 14 22:56:54.110084 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.110060 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" Jul 14 22:56:54.121376 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:54.121342 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38438969_9483_4e29_8c82_414077938b43.slice/crio-7b92ae33156fe890d0f24661d1c98404184e4bebf2c484b56a79f753c605ca04 WatchSource:0}: Error finding container 7b92ae33156fe890d0f24661d1c98404184e4bebf2c484b56a79f753c605ca04: Status 404 returned error can't find the container with id 7b92ae33156fe890d0f24661d1c98404184e4bebf2c484b56a79f753c605ca04 Jul 14 22:56:54.122649 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.122626 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q257d" Jul 14 22:56:54.126628 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:54.126592 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0356fd44_6a0a_4642_9ebe_1ce2563a7b53.slice/crio-8430f3ed61ba37a8557d0a176a91fa5388804f796a6484e1ae5dd10115728d32 WatchSource:0}: Error finding container 8430f3ed61ba37a8557d0a176a91fa5388804f796a6484e1ae5dd10115728d32: Status 404 returned error can't find the container with id 8430f3ed61ba37a8557d0a176a91fa5388804f796a6484e1ae5dd10115728d32 Jul 14 22:56:54.141869 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:54.141844 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021925ca_6e34_4e06_b282_2081f65724f0.slice/crio-e429cfe70e844f32fa4119a55b5565a5e3c7e660617b49efd4cca81be5c6386d WatchSource:0}: Error finding container e429cfe70e844f32fa4119a55b5565a5e3c7e660617b49efd4cca81be5c6386d: Status 404 returned error can't find the container with id e429cfe70e844f32fa4119a55b5565a5e3c7e660617b49efd4cca81be5c6386d Jul 14 22:56:54.161269 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.161177 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kwbhm" Jul 14 22:56:54.174800 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:54.174756 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f9cc78f_778b_4688_ba5d_66d909ec321f.slice/crio-1a3de45dfc068773f337f4b8090890e263a3638b2ac41ce41c4cee1912b90444 WatchSource:0}: Error finding container 1a3de45dfc068773f337f4b8090890e263a3638b2ac41ce41c4cee1912b90444: Status 404 returned error can't find the container with id 1a3de45dfc068773f337f4b8090890e263a3638b2ac41ce41c4cee1912b90444 Jul 14 22:56:54.178242 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.178171 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" Jul 14 22:56:54.186643 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.186430 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5k7g" Jul 14 22:56:54.188782 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:54.188750 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eabff28_0ba3_4893_a7a0_f167a98700f6.slice/crio-ad63942615dc2aa57664abd8797650d381c8d1cd468bafc456ccacc0b0f702f0 WatchSource:0}: Error finding container ad63942615dc2aa57664abd8797650d381c8d1cd468bafc456ccacc0b0f702f0: Status 404 returned error can't find the container with id ad63942615dc2aa57664abd8797650d381c8d1cd468bafc456ccacc0b0f702f0 Jul 14 22:56:54.196531 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.196347 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xnjpp" Jul 14 22:56:54.199040 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:54.199013 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4b191b_6d7c_4bd7_8e6b_7f9cd49ae0cd.slice/crio-384bf3d9bda11d2e1c1854613765207bdc146a003b5425a7448a7c391d64566f WatchSource:0}: Error finding container 384bf3d9bda11d2e1c1854613765207bdc146a003b5425a7448a7c391d64566f: Status 404 returned error can't find the container with id 384bf3d9bda11d2e1c1854613765207bdc146a003b5425a7448a7c391d64566f Jul 14 22:56:54.207585 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.207489 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s4b8q" Jul 14 22:56:54.213240 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:54.213210 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657fd608_a02e_4549_8ddb_fc3804266929.slice/crio-5d1b307d1af67354adb5bc0f0e643c5b563b2c1500e0d95304633a745a770d50 WatchSource:0}: Error finding container 5d1b307d1af67354adb5bc0f0e643c5b563b2c1500e0d95304633a745a770d50: Status 404 returned error can't find the container with id 5d1b307d1af67354adb5bc0f0e643c5b563b2c1500e0d95304633a745a770d50 Jul 14 22:56:54.222765 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:54.222730 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511a080e_cdd5_4403_bc46_b986daa2fa40.slice/crio-69c713cdf51e46ce98cae83514e739d34c0a71e7c21f7bc04d61caca4f57c755 WatchSource:0}: Error finding container 69c713cdf51e46ce98cae83514e739d34c0a71e7c21f7bc04d61caca4f57c755: Status 404 returned error can't find the container with id 69c713cdf51e46ce98cae83514e739d34c0a71e7c21f7bc04d61caca4f57c755 Jul 14 22:56:54.224541 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.224420 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:56:54.235693 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:56:54.235664 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7559daa9_b3da_4594_8163_12e31455b252.slice/crio-618d1e06d4478f3786b18fc3e62077a53705ef6b31d9958768491c13e59db7f6 WatchSource:0}: Error finding container 618d1e06d4478f3786b18fc3e62077a53705ef6b31d9958768491c13e59db7f6: Status 404 returned error can't find the container with id 618d1e06d4478f3786b18fc3e62077a53705ef6b31d9958768491c13e59db7f6 Jul 14 22:56:54.423100 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.423058 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:54.423279 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.423118 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs\") pod \"network-metrics-daemon-fgjds\" (UID: \"47316235-0c7a-4121-9099-3b86679137ba\") " pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:56:54.423279 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:54.423236 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:56:54.423279 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:54.423262 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:56:54.423420 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:54.423316 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret podName:c1024b4d-03b0-4d83-928e-d04a0fe55861 nodeName:}" failed. No retries permitted until 2026-07-14 22:56:55.423296864 +0000 UTC m=+4.039958562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret") pod "global-pull-secret-syncer-pn6sh" (UID: "c1024b4d-03b0-4d83-928e-d04a0fe55861") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:56:54.423420 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:54.423341 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs podName:47316235-0c7a-4121-9099-3b86679137ba nodeName:}" failed. No retries permitted until 2026-07-14 22:56:55.423328333 +0000 UTC m=+4.039990007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs") pod "network-metrics-daemon-fgjds" (UID: "47316235-0c7a-4121-9099-3b86679137ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:56:54.625016 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.624920 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn5rs\" (UniqueName: \"kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs\") pod \"network-check-target-84br9\" (UID: \"1c8536f6-15f3-4d84-9b99-4f051233feac\") " pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:56:54.625196 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:54.625128 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:56:54.625196 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:54.625157 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:56:54.625196 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:54.625171 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dn5rs for pod openshift-network-diagnostics/network-check-target-84br9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:56:54.625355 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:54.625240 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs podName:1c8536f6-15f3-4d84-9b99-4f051233feac nodeName:}" failed. No retries permitted until 2026-07-14 22:56:55.625218887 +0000 UTC m=+4.241880563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dn5rs" (UniqueName: "kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs") pod "network-check-target-84br9" (UID: "1c8536f6-15f3-4d84-9b99-4f051233feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:56:54.873481 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.873438 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 22:51:54 +0000 UTC" deadline="2028-01-30 18:13:45.985385899 +0000 UTC" Jul 14 22:56:54.873481 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.873480 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13555h16m51.111911523s" Jul 14 22:56:54.973121 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.973079 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xnjpp" event={"ID":"657fd608-a02e-4549-8ddb-fc3804266929","Type":"ContainerStarted","Data":"5d1b307d1af67354adb5bc0f0e643c5b563b2c1500e0d95304633a745a770d50"} Jul 14 22:56:54.974778 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.974748 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5k7g" event={"ID":"5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd","Type":"ContainerStarted","Data":"384bf3d9bda11d2e1c1854613765207bdc146a003b5425a7448a7c391d64566f"} Jul 14 22:56:54.976212 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.976162 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" event={"ID":"8eabff28-0ba3-4893-a7a0-f167a98700f6","Type":"ContainerStarted","Data":"ad63942615dc2aa57664abd8797650d381c8d1cd468bafc456ccacc0b0f702f0"} Jul 14 22:56:54.977809 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.977782 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kwbhm" event={"ID":"1f9cc78f-778b-4688-ba5d-66d909ec321f","Type":"ContainerStarted","Data":"1a3de45dfc068773f337f4b8090890e263a3638b2ac41ce41c4cee1912b90444"} Jul 14 22:56:54.979887 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.979861 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4z959" event={"ID":"38438969-9483-4e29-8c82-414077938b43","Type":"ContainerStarted","Data":"7b92ae33156fe890d0f24661d1c98404184e4bebf2c484b56a79f753c605ca04"} Jul 14 22:56:54.981251 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.981227 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" event={"ID":"7559daa9-b3da-4594-8163-12e31455b252","Type":"ContainerStarted","Data":"618d1e06d4478f3786b18fc3e62077a53705ef6b31d9958768491c13e59db7f6"} Jul 14 22:56:54.982675 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.982651 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4b8q" event={"ID":"511a080e-cdd5-4403-bc46-b986daa2fa40","Type":"ContainerStarted","Data":"69c713cdf51e46ce98cae83514e739d34c0a71e7c21f7bc04d61caca4f57c755"} Jul 14 22:56:54.984268 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.984210 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q257d" event={"ID":"021925ca-6e34-4e06-b282-2081f65724f0","Type":"ContainerStarted","Data":"e429cfe70e844f32fa4119a55b5565a5e3c7e660617b49efd4cca81be5c6386d"} Jul 14 22:56:54.985882 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:54.985811 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" event={"ID":"0356fd44-6a0a-4642-9ebe-1ce2563a7b53","Type":"ContainerStarted","Data":"8430f3ed61ba37a8557d0a176a91fa5388804f796a6484e1ae5dd10115728d32"} Jul 14 22:56:55.433713 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:55.433663 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs\") pod \"network-metrics-daemon-fgjds\" (UID: \"47316235-0c7a-4121-9099-3b86679137ba\") " pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:56:55.433908 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:55.433799 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:55.433988 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:55.433944 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:56:55.434041 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:55.434034 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret podName:c1024b4d-03b0-4d83-928e-d04a0fe55861 nodeName:}" failed. No retries permitted until 2026-07-14 22:56:57.434013028 +0000 UTC m=+6.050674721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret") pod "global-pull-secret-syncer-pn6sh" (UID: "c1024b4d-03b0-4d83-928e-d04a0fe55861") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:56:55.434605 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:55.434446 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:56:55.434605 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:55.434500 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs podName:47316235-0c7a-4121-9099-3b86679137ba nodeName:}" failed. No retries permitted until 2026-07-14 22:56:57.434482453 +0000 UTC m=+6.051144136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs") pod "network-metrics-daemon-fgjds" (UID: "47316235-0c7a-4121-9099-3b86679137ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:56:55.636634 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:55.635934 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn5rs\" (UniqueName: \"kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs\") pod \"network-check-target-84br9\" (UID: \"1c8536f6-15f3-4d84-9b99-4f051233feac\") " pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:56:55.636634 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:55.636154 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:56:55.636634 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:55.636177 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:56:55.636634 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:55.636191 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dn5rs for pod openshift-network-diagnostics/network-check-target-84br9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:56:55.636634 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:55.636254 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs podName:1c8536f6-15f3-4d84-9b99-4f051233feac nodeName:}" failed. No retries permitted until 2026-07-14 22:56:57.636233941 +0000 UTC m=+6.252895616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dn5rs" (UniqueName: "kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs") pod "network-check-target-84br9" (UID: "1c8536f6-15f3-4d84-9b99-4f051233feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:56:55.873925 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:55.873624 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 22:51:54 +0000 UTC" deadline="2028-04-24 01:03:22.65443971 +0000 UTC" Jul 14 22:56:55.873925 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:55.873897 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15578h6m26.780551594s" Jul 14 22:56:55.904832 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:55.904798 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:55.905004 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:55.904933 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:56:55.905074 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:55.905023 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:56:55.905155 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:55.905114 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:56:55.905332 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:55.905305 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:56:55.905453 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:55.905431 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:56:57.454063 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:57.453201 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs\") pod \"network-metrics-daemon-fgjds\" (UID: \"47316235-0c7a-4121-9099-3b86679137ba\") " pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:56:57.454063 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:57.453296 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:57.454063 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:57.453453 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:56:57.454063 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:57.453518 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret podName:c1024b4d-03b0-4d83-928e-d04a0fe55861 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:01.453498375 +0000 UTC m=+10.070160052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret") pod "global-pull-secret-syncer-pn6sh" (UID: "c1024b4d-03b0-4d83-928e-d04a0fe55861") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:56:57.454063 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:57.453978 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:56:57.454063 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:57.454039 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs podName:47316235-0c7a-4121-9099-3b86679137ba nodeName:}" failed. No retries permitted until 2026-07-14 22:57:01.454020782 +0000 UTC m=+10.070682457 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs") pod "network-metrics-daemon-fgjds" (UID: "47316235-0c7a-4121-9099-3b86679137ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:56:57.655999 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:57.655389 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn5rs\" (UniqueName: \"kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs\") pod \"network-check-target-84br9\" (UID: \"1c8536f6-15f3-4d84-9b99-4f051233feac\") " pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:56:57.655999 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:57.655548 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:56:57.655999 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:57.655567 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:56:57.655999 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:57.655599 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dn5rs for pod openshift-network-diagnostics/network-check-target-84br9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:56:57.655999 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:57.655658 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs podName:1c8536f6-15f3-4d84-9b99-4f051233feac nodeName:}" failed. No retries permitted until 2026-07-14 22:57:01.655638975 +0000 UTC m=+10.272300653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dn5rs" (UniqueName: "kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs") pod "network-check-target-84br9" (UID: "1c8536f6-15f3-4d84-9b99-4f051233feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:56:57.904749 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:57.904717 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:57.904943 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:57.904749 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:56:57.904943 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:57.904864 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:56:57.904943 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:57.904914 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:56:57.905126 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:57.905056 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:56:57.905191 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:57.905146 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:56:59.905008 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:59.904966 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:56:59.905657 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:59.905110 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:56:59.905657 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:59.905169 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:56:59.905657 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:59.905290 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:56:59.905657 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:56:59.905351 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:56:59.905657 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:56:59.905438 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:01.491490 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:01.491042 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs\") pod \"network-metrics-daemon-fgjds\" (UID: \"47316235-0c7a-4121-9099-3b86679137ba\") " pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:01.491490 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:01.491130 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:01.491490 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:01.491262 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:01.491490 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:01.491325 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret podName:c1024b4d-03b0-4d83-928e-d04a0fe55861 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:09.491306453 +0000 UTC m=+18.107968126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret") pod "global-pull-secret-syncer-pn6sh" (UID: "c1024b4d-03b0-4d83-928e-d04a0fe55861") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:01.491490 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:01.491386 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:01.491490 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:01.491432 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs podName:47316235-0c7a-4121-9099-3b86679137ba nodeName:}" failed. No retries permitted until 2026-07-14 22:57:09.491418895 +0000 UTC m=+18.108080581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs") pod "network-metrics-daemon-fgjds" (UID: "47316235-0c7a-4121-9099-3b86679137ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:01.693414 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:01.692790 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn5rs\" (UniqueName: \"kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs\") pod \"network-check-target-84br9\" (UID: \"1c8536f6-15f3-4d84-9b99-4f051233feac\") " pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:01.693414 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:01.692936 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:57:01.693414 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:01.692949 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:57:01.693414 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:01.692977 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dn5rs for pod openshift-network-diagnostics/network-check-target-84br9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:01.693414 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:01.693021 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs podName:1c8536f6-15f3-4d84-9b99-4f051233feac nodeName:}" failed. No retries permitted until 2026-07-14 22:57:09.693007934 +0000 UTC m=+18.309669609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dn5rs" (UniqueName: "kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs") pod "network-check-target-84br9" (UID: "1c8536f6-15f3-4d84-9b99-4f051233feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:01.905921 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:01.905084 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:01.905921 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:01.905251 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:01.905921 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:01.905652 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:01.905921 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:01.905752 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:01.905921 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:01.905807 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:01.905921 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:01.905870 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:03.904455 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:03.904423 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:03.904873 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:03.904580 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:03.904975 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:03.904949 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:03.905100 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:03.905045 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:03.905337 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:03.905191 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:03.905337 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:03.905302 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:05.015075 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:05.012436 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" event={"ID":"af33ff80b67406ee580f6a2f5c9820b8","Type":"ContainerStarted","Data":"5ad7fe4fb4ab5810531678ec1ad374a9c13142dd84e55806a26c7506fa773989"} Jul 14 22:57:05.904936 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:05.904898 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:05.905128 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:05.904913 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:05.905197 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:05.905158 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:05.905197 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:05.905032 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:05.905197 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:05.904921 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:05.905333 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:05.905263 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:07.904765 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:07.904730 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:07.904765 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:07.904762 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:07.905310 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:07.904730 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:07.905310 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:07.904875 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:07.905310 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:07.905005 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:07.905310 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:07.905088 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:09.553956 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:09.553906 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs\") pod \"network-metrics-daemon-fgjds\" (UID: \"47316235-0c7a-4121-9099-3b86679137ba\") " pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:09.554442 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:09.554015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:09.554442 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:09.554086 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:09.554442 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:09.554130 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:09.554442 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:09.554170 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs podName:47316235-0c7a-4121-9099-3b86679137ba nodeName:}" failed. No retries permitted until 2026-07-14 22:57:25.554148096 +0000 UTC m=+34.170809780 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs") pod "network-metrics-daemon-fgjds" (UID: "47316235-0c7a-4121-9099-3b86679137ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:09.554442 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:09.554195 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret podName:c1024b4d-03b0-4d83-928e-d04a0fe55861 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:25.554181977 +0000 UTC m=+34.170843659 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret") pod "global-pull-secret-syncer-pn6sh" (UID: "c1024b4d-03b0-4d83-928e-d04a0fe55861") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:09.755912 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:09.755877 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn5rs\" (UniqueName: \"kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs\") pod \"network-check-target-84br9\" (UID: \"1c8536f6-15f3-4d84-9b99-4f051233feac\") " pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:09.756098 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:09.756078 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:57:09.756138 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:09.756106 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:57:09.756138 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:09.756122 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dn5rs for pod openshift-network-diagnostics/network-check-target-84br9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:09.756213 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:09.756186 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs podName:1c8536f6-15f3-4d84-9b99-4f051233feac nodeName:}" failed. No retries permitted until 2026-07-14 22:57:25.756167776 +0000 UTC m=+34.372829470 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dn5rs" (UniqueName: "kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs") pod "network-check-target-84br9" (UID: "1c8536f6-15f3-4d84-9b99-4f051233feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:09.905067 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:09.905032 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:09.905252 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:09.905032 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:09.905252 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:09.905173 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:09.905252 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:09.905170 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:09.905414 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:09.905300 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:09.905414 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:09.905380 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:10.023380 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:10.023289 2572 generic.go:356] "Generic (PLEG): container finished" podID="af33ff80b67406ee580f6a2f5c9820b8" containerID="5ad7fe4fb4ab5810531678ec1ad374a9c13142dd84e55806a26c7506fa773989" exitCode=0 Jul 14 22:57:10.023380 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:10.023337 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" event={"ID":"af33ff80b67406ee580f6a2f5c9820b8","Type":"ContainerDied","Data":"5ad7fe4fb4ab5810531678ec1ad374a9c13142dd84e55806a26c7506fa773989"} Jul 14 22:57:11.905675 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:11.905643 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:11.906130 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:11.905743 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:11.906130 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:11.905752 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:11.906130 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:11.905873 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:11.906130 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:11.905924 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:11.906130 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:11.905991 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:13.904888 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:13.904717 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:13.905511 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:13.904742 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:13.905511 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:13.904978 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:13.905511 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:13.904794 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:13.905511 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:13.905051 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:13.905511 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:13.905141 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:14.031327 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.031189 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" event={"ID":"8eabff28-0ba3-4893-a7a0-f167a98700f6","Type":"ContainerStarted","Data":"6704650ab0a4fce74e344c01e5aa689eb6897f5bc0a8b4a72087960fec0e056a"} Jul 14 22:57:14.032653 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.032629 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4z959" event={"ID":"38438969-9483-4e29-8c82-414077938b43","Type":"ContainerStarted","Data":"00ffafc81508c00d66ed6921d066e6e35de628b9fd9de6e097802f3e55df5d29"} Jul 14 22:57:14.034361 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.034344 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 22:57:14.034766 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.034687 2572 generic.go:356] "Generic (PLEG): container finished" podID="7559daa9-b3da-4594-8163-12e31455b252" containerID="1e611cc8081d5e3e70bf5868e6f102021ae9dec4fd40b868f770ee2bdd21095c" exitCode=1 Jul 14 22:57:14.034766 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.034746 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" event={"ID":"7559daa9-b3da-4594-8163-12e31455b252","Type":"ContainerStarted","Data":"43e4f7d27d54ad9104b3d8beaebb1ee1c23dd28f08053ce0b045b524ce766ab7"} Jul 14 22:57:14.034880 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.034798 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" event={"ID":"7559daa9-b3da-4594-8163-12e31455b252","Type":"ContainerDied","Data":"1e611cc8081d5e3e70bf5868e6f102021ae9dec4fd40b868f770ee2bdd21095c"} Jul 14 22:57:14.034880 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.034839 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" event={"ID":"7559daa9-b3da-4594-8163-12e31455b252","Type":"ContainerStarted","Data":"314b0df9483d44a299d71f9e887fd110cf7ea622b82988b15bd2339e3a2489ea"} Jul 14 22:57:14.036078 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.036056 2572 generic.go:356] "Generic (PLEG): container finished" podID="511a080e-cdd5-4403-bc46-b986daa2fa40" containerID="9cce9376b7ef2591d50d28926f300d56a99768a2c4b652a5aae5c6f4ca79ebaa" exitCode=0 Jul 14 22:57:14.036163 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.036098 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4b8q" event={"ID":"511a080e-cdd5-4403-bc46-b986daa2fa40","Type":"ContainerDied","Data":"9cce9376b7ef2591d50d28926f300d56a99768a2c4b652a5aae5c6f4ca79ebaa"} Jul 14 22:57:14.038185 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.038165 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q257d" event={"ID":"021925ca-6e34-4e06-b282-2081f65724f0","Type":"ContainerStarted","Data":"35953311a09135bb42e23862438def954a88792fd979a68fa70480e7028b9ed8"} Jul 14 22:57:14.039673 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.039642 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" event={"ID":"0356fd44-6a0a-4642-9ebe-1ce2563a7b53","Type":"ContainerStarted","Data":"4e013a41eede31a2b0702c0a8b941a7aab0ed0d492e51dc605908325017771e8"} Jul 14 22:57:14.041407 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.041370 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" event={"ID":"af33ff80b67406ee580f6a2f5c9820b8","Type":"ContainerStarted","Data":"94e6595c53ce6d971356eb1ba25c3d6b3b9d7d9cd7a56aed1f28a53da9406cf2"} Jul 14 22:57:14.042982 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.042961 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-2.ec2.internal" event={"ID":"a5fc01eedff708540538bb5f52d24e9e","Type":"ContainerStarted","Data":"705444cdc3fc3bcfbfab5eec47db69abf1d5ff5d28dfadc83611c03258d5d965"} Jul 14 22:57:14.044608 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.044578 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xnjpp" event={"ID":"657fd608-a02e-4549-8ddb-fc3804266929","Type":"ContainerStarted","Data":"ec283df9afa5a3a71936c3498aad4c22bef51919b50c8c307e3cfbfc2bec65c8"} Jul 14 22:57:14.046024 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.045997 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5k7g" event={"ID":"5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd","Type":"ContainerStarted","Data":"730ae96fd8f8d84c61073cfb2b8792ae19a5875fb63e03e6fd5cb20a131c0227"} Jul 14 22:57:14.079300 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.079247 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n8gn9" podStartSLOduration=3.018229182 podStartE2EDuration="22.079229898s" totalImagesPullingTime="19.061000716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:14.078900311 +0000 UTC m=+22.695562006" watchObservedRunningTime="2026-07-14 22:57:14.079229898 +0000 UTC m=+22.695891595" Jul 14 22:57:14.093516 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.093460 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xnjpp" podStartSLOduration=3.102771361 podStartE2EDuration="22.093438735s" totalImagesPullingTime="18.990667374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:14.092998923 +0000 UTC m=+22.709660618" watchObservedRunningTime="2026-07-14 22:57:14.093438735 +0000 UTC m=+22.710100431" Jul 14 22:57:14.116129 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.116084 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-2.ec2.internal" podStartSLOduration=21.116066797 podStartE2EDuration="21.116066797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:14.114787319 +0000 UTC m=+22.731449016" watchObservedRunningTime="2026-07-14 22:57:14.116066797 +0000 UTC m=+22.732728491" Jul 14 22:57:14.146115 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.146064 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q257d" podStartSLOduration=2.994488892 podStartE2EDuration="22.146043781s" totalImagesPullingTime="19.151554889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:14.145046783 +0000 UTC m=+22.761708478" watchObservedRunningTime="2026-07-14 22:57:14.146043781 +0000 UTC m=+22.762705478" Jul 14 22:57:14.161445 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.161341 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v5k7g" podStartSLOduration=3.154300407 podStartE2EDuration="22.161321449s" totalImagesPullingTime="19.007021042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:14.160475372 +0000 UTC m=+22.777137068" watchObservedRunningTime="2026-07-14 22:57:14.161321449 +0000 UTC m=+22.777983145" Jul 14 22:57:14.177296 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.177246 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-2.ec2.internal" podStartSLOduration=21.177231615 podStartE2EDuration="21.177231615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:14.17695432 +0000 UTC m=+22.793616013" watchObservedRunningTime="2026-07-14 22:57:14.177231615 +0000 UTC m=+22.793893316" Jul 14 22:57:14.773336 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.773302 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 22:57:14.888732 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.888588 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T22:57:14.773318687Z","UUID":"570d1fb2-58d7-45ee-8ba9-80ea2037ae21","Handler":null,"Name":"","Endpoint":""} Jul 14 22:57:14.890330 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.890312 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 22:57:14.890448 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:14.890354 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 22:57:15.050199 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:15.050138 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kwbhm" event={"ID":"1f9cc78f-778b-4688-ba5d-66d909ec321f","Type":"ContainerStarted","Data":"9347539e29699c825a31397444f6647179a9dd5e3d5d50c68ab17b723f437962"} Jul 14 22:57:15.053374 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:15.053345 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 22:57:15.053915 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:15.053891 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" event={"ID":"7559daa9-b3da-4594-8163-12e31455b252","Type":"ContainerStarted","Data":"13ce26d26bd97325ed572ffc6f77c43609343bfd3df665c4b2b3e20189ee86cc"} Jul 14 22:57:15.054033 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:15.053971 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" event={"ID":"7559daa9-b3da-4594-8163-12e31455b252","Type":"ContainerStarted","Data":"89efe71bd72183f1b7463f63dec21fe07a0496035a213c35ac80eeca5f935edb"} Jul 14 22:57:15.054033 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:15.054024 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" event={"ID":"7559daa9-b3da-4594-8163-12e31455b252","Type":"ContainerStarted","Data":"df45417c7ce10557cd861fc8b540151dc622d437815a4ef33b9f98af2908735e"} Jul 14 22:57:15.055823 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:15.055774 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" event={"ID":"0356fd44-6a0a-4642-9ebe-1ce2563a7b53","Type":"ContainerStarted","Data":"49c481b6a0ef44b134eea185bdf4e38589e7c0ad1eed82ca7c568503722c1ca9"} Jul 14 22:57:15.065901 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:15.065829 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kwbhm" podStartSLOduration=3.991186011 podStartE2EDuration="23.065809961s" totalImagesPullingTime="19.07462395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:15.065770533 +0000 UTC m=+23.682432226" watchObservedRunningTime="2026-07-14 22:57:15.065809961 +0000 UTC m=+23.682471658" Jul 14 22:57:15.066047 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:15.065944 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4z959" podStartSLOduration=3.9831343759999998 podStartE2EDuration="23.065936785s" totalImagesPullingTime="19.082802409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:14.194479818 +0000 UTC m=+22.811141514" watchObservedRunningTime="2026-07-14 22:57:15.065936785 +0000 UTC m=+23.682598480" Jul 14 22:57:15.905054 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:15.904603 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:15.905224 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:15.905171 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:15.905224 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:15.904621 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:15.905347 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:15.905260 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:15.905347 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:15.904621 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:15.905447 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:15.905348 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:16.060921 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:16.060832 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" event={"ID":"0356fd44-6a0a-4642-9ebe-1ce2563a7b53","Type":"ContainerStarted","Data":"a714e0827518a8b932afaa79b87bb94ec4f462e9ce5b758ce9c944037e0c7d78"} Jul 14 22:57:16.079442 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:16.079391 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7jb7" podStartSLOduration=2.835414686 podStartE2EDuration="24.079376436s" totalImagesPullingTime="21.24396175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:56:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:16.079243556 +0000 UTC m=+24.695905251" watchObservedRunningTime="2026-07-14 22:57:16.079376436 +0000 UTC m=+24.696038131" Jul 14 22:57:16.866737 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:16.866702 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4z959" Jul 14 22:57:16.867236 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:16.867211 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4z959" Jul 14 22:57:17.066143 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:17.066118 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 22:57:17.066744 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:17.066473 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" event={"ID":"7559daa9-b3da-4594-8163-12e31455b252","Type":"ContainerStarted","Data":"6f1077a970cf0d7e38ab4b141726157a27ad0d0c5a2eb9b0c4665747aa4cfd9c"} Jul 14 22:57:17.066920 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:17.066903 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4z959" Jul 14 22:57:17.067258 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:17.067241 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4z959" Jul 14 22:57:17.904740 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:17.904705 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:17.904927 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:17.904710 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:17.904927 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:17.904834 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:17.905054 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:17.904710 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:17.905054 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:17.904965 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:17.905171 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:17.905078 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:19.074179 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:19.073946 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 22:57:19.074877 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:19.074463 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" event={"ID":"7559daa9-b3da-4594-8163-12e31455b252","Type":"ContainerStarted","Data":"34424e64a0fe2f10a3b488aadd78504dd241ac382a53c799e73d0d071f4aacf1"} Jul 14 22:57:19.074877 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:19.074735 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:57:19.075002 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:19.074986 2572 scope.go:117] "RemoveContainer" containerID="1e611cc8081d5e3e70bf5868e6f102021ae9dec4fd40b868f770ee2bdd21095c" Jul 14 22:57:19.076507 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:19.076484 2572 generic.go:356] "Generic (PLEG): container finished" podID="511a080e-cdd5-4403-bc46-b986daa2fa40" containerID="0e7254dc27394d7cc11846c91b712e12017e3a09152db0a605ef2956f1f7577b" exitCode=0 Jul 14 22:57:19.076634 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:19.076574 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4b8q" event={"ID":"511a080e-cdd5-4403-bc46-b986daa2fa40","Type":"ContainerDied","Data":"0e7254dc27394d7cc11846c91b712e12017e3a09152db0a605ef2956f1f7577b"} Jul 14 22:57:19.093072 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:19.093053 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:57:19.905925 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:19.905458 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:19.905925 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:19.905487 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:19.905925 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:19.905620 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:19.905925 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:19.905775 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:19.905925 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:19.905820 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:19.905925 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:19.905916 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:20.082585 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:20.082560 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 22:57:20.083073 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:20.082930 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" event={"ID":"7559daa9-b3da-4594-8163-12e31455b252","Type":"ContainerStarted","Data":"5a0a8f8ab92d50c7879c2dc581c6a689b31697c29cb8460087453ad4d0c99bc4"} Jul 14 22:57:20.083307 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:20.083285 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:57:20.083479 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:20.083458 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:57:20.098387 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:20.098366 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:57:20.114451 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:20.114401 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" podStartSLOduration=8.689525596 podStartE2EDuration="28.11438689s" totalImagesPullingTime="19.424861294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:20.113846264 +0000 UTC m=+28.730507968" watchObservedRunningTime="2026-07-14 22:57:20.11438689 +0000 UTC m=+28.731048584" Jul 14 22:57:20.621050 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:20.620749 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-84br9"] Jul 14 22:57:20.621232 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:20.621096 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:20.621232 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:20.621209 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:20.625795 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:20.625765 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pn6sh"] Jul 14 22:57:20.625941 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:20.625861 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:20.626000 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:20.625963 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:20.626389 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:20.626365 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fgjds"] Jul 14 22:57:20.626513 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:20.626446 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:20.626594 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:20.626533 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:21.087151 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:21.087118 2572 generic.go:356] "Generic (PLEG): container finished" podID="511a080e-cdd5-4403-bc46-b986daa2fa40" containerID="728ce0e9389bb2447124d51663c0c78877bb966234897b8c3b7276c441d999b1" exitCode=0 Jul 14 22:57:21.087516 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:21.087199 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4b8q" event={"ID":"511a080e-cdd5-4403-bc46-b986daa2fa40","Type":"ContainerDied","Data":"728ce0e9389bb2447124d51663c0c78877bb966234897b8c3b7276c441d999b1"} Jul 14 22:57:21.905255 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:21.905217 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:21.905428 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:21.905303 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:21.905428 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:21.905357 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:21.905428 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:21.905390 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:21.905428 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:21.905414 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:21.905654 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:21.905486 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:23.094291 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:23.094259 2572 generic.go:356] "Generic (PLEG): container finished" podID="511a080e-cdd5-4403-bc46-b986daa2fa40" containerID="d8fd0306cf799bddbde4294d6e10f196a76b5ecbd62ef774019a2ae01440efc9" exitCode=0 Jul 14 22:57:23.094865 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:23.094308 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4b8q" event={"ID":"511a080e-cdd5-4403-bc46-b986daa2fa40","Type":"ContainerDied","Data":"d8fd0306cf799bddbde4294d6e10f196a76b5ecbd62ef774019a2ae01440efc9"} Jul 14 22:57:23.905112 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:23.905062 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:23.905300 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:23.905062 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:23.905300 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:23.905206 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:23.905300 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:23.905219 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:23.905466 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:23.905303 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:23.905466 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:23.905399 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:25.578330 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:25.578073 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:25.578869 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:25.578337 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs\") pod \"network-metrics-daemon-fgjds\" (UID: \"47316235-0c7a-4121-9099-3b86679137ba\") " pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:25.578869 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:25.578242 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:25.578869 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:25.578430 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret podName:c1024b4d-03b0-4d83-928e-d04a0fe55861 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:57.578408859 +0000 UTC m=+66.195070546 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret") pod "global-pull-secret-syncer-pn6sh" (UID: "c1024b4d-03b0-4d83-928e-d04a0fe55861") : object "kube-system"/"original-pull-secret" not registered Jul 14 22:57:25.578869 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:25.578467 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:25.578869 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:25.578525 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs podName:47316235-0c7a-4121-9099-3b86679137ba nodeName:}" failed. No retries permitted until 2026-07-14 22:57:57.578509902 +0000 UTC m=+66.195171598 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs") pod "network-metrics-daemon-fgjds" (UID: "47316235-0c7a-4121-9099-3b86679137ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 22:57:25.780608 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:25.780574 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn5rs\" (UniqueName: \"kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs\") pod \"network-check-target-84br9\" (UID: \"1c8536f6-15f3-4d84-9b99-4f051233feac\") " pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:25.780799 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:25.780765 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 22:57:25.780799 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:25.780791 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 22:57:25.780918 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:25.780804 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dn5rs for pod openshift-network-diagnostics/network-check-target-84br9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:25.780918 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:25.780872 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs podName:1c8536f6-15f3-4d84-9b99-4f051233feac nodeName:}" failed. No retries permitted until 2026-07-14 22:57:57.780852315 +0000 UTC m=+66.397514008 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dn5rs" (UniqueName: "kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs") pod "network-check-target-84br9" (UID: "1c8536f6-15f3-4d84-9b99-4f051233feac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 22:57:25.904492 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:25.904456 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:25.904681 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:25.904497 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:25.904681 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:25.904456 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:25.904681 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:25.904610 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6sh" podUID="c1024b4d-03b0-4d83-928e-d04a0fe55861" Jul 14 22:57:25.904838 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:25.904761 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgjds" podUID="47316235-0c7a-4121-9099-3b86679137ba" Jul 14 22:57:25.904887 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:25.904855 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-84br9" podUID="1c8536f6-15f3-4d84-9b99-4f051233feac" Jul 14 22:57:27.108049 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.108013 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4b8q" event={"ID":"511a080e-cdd5-4403-bc46-b986daa2fa40","Type":"ContainerStarted","Data":"5c0a371397330f25e2d58a442a4c55a7053ee3e5ca11220f9bd68c6c87699190"} Jul 14 22:57:27.157444 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.157422 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-2.ec2.internal" event="NodeReady" Jul 14 22:57:27.157579 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.157569 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 22:57:27.190172 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.190139 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5dff44dd5f-rtvnn"] Jul 14 22:57:27.192448 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.192431 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-nhddc"] Jul 14 22:57:27.192610 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.192591 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.196654 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.194620 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.196654 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.195651 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml"] Jul 14 22:57:27.198205 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.198184 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt"] Jul 14 22:57:27.198324 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.198310 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:27.200358 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.200338 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x9cqr"] Jul 14 22:57:27.200468 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.200434 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:27.202461 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.202445 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6cbc88d98d-86h58"] Jul 14 22:57:27.202585 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.202569 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x9cqr" Jul 14 22:57:27.204621 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.204605 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-ppmpg"] Jul 14 22:57:27.204724 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.204708 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.206913 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.206892 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c"] Jul 14 22:57:27.207021 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.207002 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:27.209367 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.209349 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" Jul 14 22:57:27.221673 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.221656 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 14 22:57:27.221789 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.221706 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 14 22:57:27.225464 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.225446 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 14 22:57:27.227256 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.227227 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"console-operator-config\" is forbidden: User \"system:node:ip-10-0-130-2.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-130-2.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap" Jul 14 22:57:27.227356 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.227302 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 14 22:57:27.227356 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.227316 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 22:57:27.227356 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.227324 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 22:57:27.230021 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.230003 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ljkhq\"" Jul 14 22:57:27.230120 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.230049 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 22:57:27.230176 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.230136 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 22:57:27.230277 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.230261 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pvwlq\"" Jul 14 22:57:27.260272 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.257140 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 22:57:27.260272 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.257434 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hxcx5\"" Jul 14 22:57:27.260272 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.257793 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 14 22:57:27.260272 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.258011 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"service-ca-operator-dockercfg-zp8gc\" is forbidden: User \"system:node:ip-10-0-130-2.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-130-2.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zp8gc\"" type="*v1.Secret" Jul 14 22:57:27.260272 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.258097 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-2.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-130-2.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 14 22:57:27.260272 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.258786 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gm9qp\"" Jul 14 22:57:27.260272 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.258960 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-pml6h\"" Jul 14 22:57:27.260272 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.259234 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 14 22:57:27.260272 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.259389 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 22:57:27.260272 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.259584 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 22:57:27.260272 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.259765 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 22:57:27.260272 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.259938 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 22:57:27.264562 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.261412 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 14 22:57:27.264562 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.261631 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 14 22:57:27.264562 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.261819 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 14 22:57:27.264562 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.262039 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 14 22:57:27.264562 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.262217 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 14 22:57:27.264562 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.262389 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 14 22:57:27.266686 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.266659 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 22:57:27.266922 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.266793 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 14 22:57:27.267007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.266990 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 22:57:27.267418 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.267394 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 14 22:57:27.267866 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.267817 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-htzv8\"" Jul 14 22:57:27.268176 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.268154 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 22:57:27.268762 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.268742 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 22:57:27.269008 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.268992 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 22:57:27.269074 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.269008 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jmn75\"" Jul 14 22:57:27.271566 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.271029 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw"] Jul 14 22:57:27.274838 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.274818 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 14 22:57:27.275641 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.275603 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c"] Jul 14 22:57:27.275641 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.275631 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dff44dd5f-rtvnn"] Jul 14 22:57:27.275796 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.275649 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-ppmpg"] Jul 14 22:57:27.275796 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.275668 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-nz8h8"] Jul 14 22:57:27.275796 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.275717 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" Jul 14 22:57:27.278049 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.278029 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt"] Jul 14 22:57:27.278129 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.278063 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x9cqr"] Jul 14 22:57:27.278180 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.278142 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nz8h8" Jul 14 22:57:27.284264 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.284245 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 14 22:57:27.284824 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.284792 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 14 22:57:27.284824 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.284823 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 14 22:57:27.284963 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.284850 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 14 22:57:27.285148 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.285128 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xcvgm\"" Jul 14 22:57:27.285233 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.285132 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw"] Jul 14 22:57:27.285418 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.285403 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 22:57:27.285602 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.285582 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 22:57:27.285754 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.285468 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2rzgg\"" Jul 14 22:57:27.286450 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.286413 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-nhddc"] Jul 14 22:57:27.292979 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.292956 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2c61efd-9ba4-4003-a455-8238eba3aec4-trusted-ca\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.293072 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293049 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cvw5\" (UniqueName: \"kubernetes.io/projected/df375676-ba25-481c-babc-5c81539e7726-kube-api-access-2cvw5\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.293139 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293089 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-bound-sa-token\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.293139 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293128 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df375676-ba25-481c-babc-5c81539e7726-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.293229 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293191 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f6c8\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-kube-api-access-4f6c8\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.293229 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293212 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df375676-ba25-481c-babc-5c81539e7726-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.293315 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2c61efd-9ba4-4003-a455-8238eba3aec4-ca-trust-extracted\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.293315 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293266 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-certificates\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.293390 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293323 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.293390 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293369 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2c61efd-9ba4-4003-a455-8238eba3aec4-installation-pull-secrets\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.293496 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293478 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df375676-ba25-481c-babc-5c81539e7726-tmp\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.293584 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293569 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gjgwf"] Jul 14 22:57:27.293644 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293578 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2c61efd-9ba4-4003-a455-8238eba3aec4-image-registry-private-configuration\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.293644 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293598 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/df375676-ba25-481c-babc-5c81539e7726-snapshots\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.293644 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.293614 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df375676-ba25-481c-babc-5c81539e7726-serving-cert\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.296445 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.296428 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tmglv"] Jul 14 22:57:27.296561 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.296531 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gjgwf" Jul 14 22:57:27.299010 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.298991 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 14 22:57:27.299256 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.299226 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:27.300454 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.300429 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 22:57:27.300623 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.300498 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nt85j\"" Jul 14 22:57:27.301113 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.301092 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-nz8h8"] Jul 14 22:57:27.301710 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.301688 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 22:57:27.302301 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.302282 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 22:57:27.302672 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.302658 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 22:57:27.306863 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.306847 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 22:57:27.306979 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.306962 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 22:57:27.307045 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.307030 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdwsb\"" Jul 14 22:57:27.307432 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.307414 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gjgwf"] Jul 14 22:57:27.315635 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.315611 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6cbc88d98d-86h58"] Jul 14 22:57:27.317353 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.317331 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml"] Jul 14 22:57:27.320863 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.320842 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tmglv"] Jul 14 22:57:27.374743 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.374700 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:27.394503 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.394469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-bound-sa-token\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.394503 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.394507 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbgn8\" (UniqueName: \"kubernetes.io/projected/6c75a176-d0e0-4cee-9d0c-5e977a433545-kube-api-access-pbgn8\") pod \"cluster-samples-operator-65db858894-7gcml\" (UID: \"6c75a176-d0e0-4cee-9d0c-5e977a433545\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:27.394735 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.394654 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f6c8\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-kube-api-access-4f6c8\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.394735 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.394686 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l24wm\" (UniqueName: \"kubernetes.io/projected/4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9-kube-api-access-l24wm\") pod \"service-ca-operator-7695fc6c8c-9dj2c\" (UID: \"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" Jul 14 22:57:27.394735 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.394715 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df375676-ba25-481c-babc-5c81539e7726-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.394866 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.394744 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2c61efd-9ba4-4003-a455-8238eba3aec4-ca-trust-extracted\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.394866 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.394770 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7gcml\" (UID: \"6c75a176-d0e0-4cee-9d0c-5e977a433545\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:27.394866 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.394793 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13340f57-01a1-462f-b7c2-13985ec3ef72-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:27.395015 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.394862 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.395015 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.394903 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2c61efd-9ba4-4003-a455-8238eba3aec4-installation-pull-secrets\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.395015 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.394937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s7st\" (UniqueName: \"kubernetes.io/projected/6a59d30e-3ddf-48a7-9de3-387c2e92f951-kube-api-access-4s7st\") pod \"kube-storage-version-migrator-operator-799cb7f958-w4djw\" (UID: \"6a59d30e-3ddf-48a7-9de3-387c2e92f951\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" Jul 14 22:57:27.395015 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.394958 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 22:57:27.395015 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.394971 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dff44dd5f-rtvnn: secret "image-registry-tls" not found Jul 14 22:57:27.395015 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.394975 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df375676-ba25-481c-babc-5c81539e7726-serving-cert\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.395015 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395001 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2kln\" (UniqueName: \"kubernetes.io/projected/13340f57-01a1-462f-b7c2-13985ec3ef72-kube-api-access-w2kln\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:27.395319 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.395032 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls podName:f2c61efd-9ba4-4003-a455-8238eba3aec4 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:27.895013903 +0000 UTC m=+36.511675579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls") pod "image-registry-5dff44dd5f-rtvnn" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4") : secret "image-registry-tls" not found Jul 14 22:57:27.395319 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395054 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9-config\") pod \"service-ca-operator-7695fc6c8c-9dj2c\" (UID: \"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" Jul 14 22:57:27.395319 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395081 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a59d30e-3ddf-48a7-9de3-387c2e92f951-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-w4djw\" (UID: \"6a59d30e-3ddf-48a7-9de3-387c2e92f951\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" Jul 14 22:57:27.395319 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395113 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75599b0f-5f71-4919-8723-67aaa6ebe201-trusted-ca\") pod \"console-operator-7866497494-ppmpg\" (UID: \"75599b0f-5f71-4919-8723-67aaa6ebe201\") " pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:27.395319 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395140 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvw5\" (UniqueName: \"kubernetes.io/projected/df375676-ba25-481c-babc-5c81539e7726-kube-api-access-2cvw5\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.395319 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395164 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpbdl\" (UniqueName: \"kubernetes.io/projected/f37c190b-70d5-41ae-ad87-96b058495645-kube-api-access-zpbdl\") pod \"ingress-canary-gjgwf\" (UID: \"f37c190b-70d5-41ae-ad87-96b058495645\") " pod="openshift-ingress-canary/ingress-canary-gjgwf" Jul 14 22:57:27.395319 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395192 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j82hk\" (UniqueName: \"kubernetes.io/projected/e797c696-68ce-4d0f-ac1d-dd74d0291fd2-kube-api-access-j82hk\") pod \"network-check-source-869dcfcdcd-nz8h8\" (UID: \"e797c696-68ce-4d0f-ac1d-dd74d0291fd2\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nz8h8" Jul 14 22:57:27.395319 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395228 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75599b0f-5f71-4919-8723-67aaa6ebe201-config\") pod \"console-operator-7866497494-ppmpg\" (UID: \"75599b0f-5f71-4919-8723-67aaa6ebe201\") " pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:27.395319 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395229 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2c61efd-9ba4-4003-a455-8238eba3aec4-ca-trust-extracted\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.395319 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395252 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75599b0f-5f71-4919-8723-67aaa6ebe201-serving-cert\") pod \"console-operator-7866497494-ppmpg\" (UID: \"75599b0f-5f71-4919-8723-67aaa6ebe201\") " pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:27.395319 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395279 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df375676-ba25-481c-babc-5c81539e7726-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.395319 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395309 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-stats-auth\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395334 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a59d30e-3ddf-48a7-9de3-387c2e92f951-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-w4djw\" (UID: \"6a59d30e-3ddf-48a7-9de3-387c2e92f951\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395383 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcvgn\" (UniqueName: \"kubernetes.io/projected/75599b0f-5f71-4919-8723-67aaa6ebe201-kube-api-access-vcvgn\") pod \"console-operator-7866497494-ppmpg\" (UID: \"75599b0f-5f71-4919-8723-67aaa6ebe201\") " pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395416 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df375676-ba25-481c-babc-5c81539e7726-tmp\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395448 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-847vw\" (UniqueName: \"kubernetes.io/projected/1c15dde8-c2b7-4afd-a922-0bf324bb54c1-kube-api-access-847vw\") pod \"volume-data-source-validator-78495597f6-x9cqr\" (UID: \"1c15dde8-c2b7-4afd-a922-0bf324bb54c1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x9cqr" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395493 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395521 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395563 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f37c190b-70d5-41ae-ad87-96b058495645-cert\") pod \"ingress-canary-gjgwf\" (UID: \"f37c190b-70d5-41ae-ad87-96b058495645\") " pod="openshift-ingress-canary/ingress-canary-gjgwf" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395598 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-certificates\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395665 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9-serving-cert\") pod \"service-ca-operator-7695fc6c8c-9dj2c\" (UID: \"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2c61efd-9ba4-4003-a455-8238eba3aec4-image-registry-private-configuration\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395761 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/df375676-ba25-481c-babc-5c81539e7726-snapshots\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395772 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df375676-ba25-481c-babc-5c81539e7726-tmp\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395804 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-default-certificate\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:27.395899 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395840 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df375676-ba25-481c-babc-5c81539e7726-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.396511 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395875 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2c61efd-9ba4-4003-a455-8238eba3aec4-trusted-ca\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.396511 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.395917 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4dtc\" (UniqueName: \"kubernetes.io/projected/dbf0442c-13e6-4e76-909f-280c9bc111ed-kube-api-access-x4dtc\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.396511 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.396005 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df375676-ba25-481c-babc-5c81539e7726-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.396511 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.396072 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-certificates\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.396511 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.396272 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/df375676-ba25-481c-babc-5c81539e7726-snapshots\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.396742 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.396726 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2c61efd-9ba4-4003-a455-8238eba3aec4-trusted-ca\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.399487 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.399460 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df375676-ba25-481c-babc-5c81539e7726-serving-cert\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.399487 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.399480 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2c61efd-9ba4-4003-a455-8238eba3aec4-image-registry-private-configuration\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.399656 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.399591 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2c61efd-9ba4-4003-a455-8238eba3aec4-installation-pull-secrets\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.403079 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.403053 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-bound-sa-token\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.405215 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.405195 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f6c8\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-kube-api-access-4f6c8\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.406358 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.406339 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cvw5\" (UniqueName: \"kubernetes.io/projected/df375676-ba25-481c-babc-5c81539e7726-kube-api-access-2cvw5\") pod \"insights-operator-68d9dd94cf-nhddc\" (UID: \"df375676-ba25-481c-babc-5c81539e7726\") " pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.466284 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.466189 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:27.496892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.496859 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-default-certificate\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.496892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.496887 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:27.497127 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.496910 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4dtc\" (UniqueName: \"kubernetes.io/projected/dbf0442c-13e6-4e76-909f-280c9bc111ed-kube-api-access-x4dtc\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.497127 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.496939 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbgn8\" (UniqueName: \"kubernetes.io/projected/6c75a176-d0e0-4cee-9d0c-5e977a433545-kube-api-access-pbgn8\") pod \"cluster-samples-operator-65db858894-7gcml\" (UID: \"6c75a176-d0e0-4cee-9d0c-5e977a433545\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:27.497127 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.496968 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:27.497127 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l24wm\" (UniqueName: \"kubernetes.io/projected/4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9-kube-api-access-l24wm\") pod \"service-ca-operator-7695fc6c8c-9dj2c\" (UID: \"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" Jul 14 22:57:27.497127 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.497016 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 22:57:27.497127 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497038 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7gcml\" (UID: \"6c75a176-d0e0-4cee-9d0c-5e977a433545\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:27.497127 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497064 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13340f57-01a1-462f-b7c2-13985ec3ef72-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:27.497127 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.497086 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls podName:13340f57-01a1-462f-b7c2-13985ec3ef72 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:27.997068372 +0000 UTC m=+36.613730062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4znxt" (UID: "13340f57-01a1-462f-b7c2-13985ec3ef72") : secret "cluster-monitoring-operator-tls" not found Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.497158 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.497227 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls podName:6c75a176-d0e0-4cee-9d0c-5e977a433545 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:27.997209122 +0000 UTC m=+36.613870799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls") pod "cluster-samples-operator-65db858894-7gcml" (UID: "6c75a176-d0e0-4cee-9d0c-5e977a433545") : secret "samples-operator-tls" not found Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497157 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s7st\" (UniqueName: \"kubernetes.io/projected/6a59d30e-3ddf-48a7-9de3-387c2e92f951-kube-api-access-4s7st\") pod \"kube-storage-version-migrator-operator-799cb7f958-w4djw\" (UID: \"6a59d30e-3ddf-48a7-9de3-387c2e92f951\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497277 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2kln\" (UniqueName: \"kubernetes.io/projected/13340f57-01a1-462f-b7c2-13985ec3ef72-kube-api-access-w2kln\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497302 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9-config\") pod \"service-ca-operator-7695fc6c8c-9dj2c\" (UID: \"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497318 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a59d30e-3ddf-48a7-9de3-387c2e92f951-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-w4djw\" (UID: \"6a59d30e-3ddf-48a7-9de3-387c2e92f951\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497344 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-tmp-dir\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75599b0f-5f71-4919-8723-67aaa6ebe201-trusted-ca\") pod \"console-operator-7866497494-ppmpg\" (UID: \"75599b0f-5f71-4919-8723-67aaa6ebe201\") " pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497402 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpbdl\" (UniqueName: \"kubernetes.io/projected/f37c190b-70d5-41ae-ad87-96b058495645-kube-api-access-zpbdl\") pod \"ingress-canary-gjgwf\" (UID: \"f37c190b-70d5-41ae-ad87-96b058495645\") " pod="openshift-ingress-canary/ingress-canary-gjgwf" Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497432 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j82hk\" (UniqueName: \"kubernetes.io/projected/e797c696-68ce-4d0f-ac1d-dd74d0291fd2-kube-api-access-j82hk\") pod \"network-check-source-869dcfcdcd-nz8h8\" (UID: \"e797c696-68ce-4d0f-ac1d-dd74d0291fd2\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nz8h8" Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tdq2\" (UniqueName: \"kubernetes.io/projected/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-kube-api-access-8tdq2\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75599b0f-5f71-4919-8723-67aaa6ebe201-config\") pod \"console-operator-7866497494-ppmpg\" (UID: \"75599b0f-5f71-4919-8723-67aaa6ebe201\") " pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497512 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75599b0f-5f71-4919-8723-67aaa6ebe201-serving-cert\") pod \"console-operator-7866497494-ppmpg\" (UID: \"75599b0f-5f71-4919-8723-67aaa6ebe201\") " pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:27.497536 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497562 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-stats-auth\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.498209 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497589 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a59d30e-3ddf-48a7-9de3-387c2e92f951-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-w4djw\" (UID: \"6a59d30e-3ddf-48a7-9de3-387c2e92f951\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" Jul 14 22:57:27.498209 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcvgn\" (UniqueName: \"kubernetes.io/projected/75599b0f-5f71-4919-8723-67aaa6ebe201-kube-api-access-vcvgn\") pod \"console-operator-7866497494-ppmpg\" (UID: \"75599b0f-5f71-4919-8723-67aaa6ebe201\") " pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:27.498209 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497649 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-847vw\" (UniqueName: \"kubernetes.io/projected/1c15dde8-c2b7-4afd-a922-0bf324bb54c1-kube-api-access-847vw\") pod \"volume-data-source-validator-78495597f6-x9cqr\" (UID: \"1c15dde8-c2b7-4afd-a922-0bf324bb54c1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x9cqr" Jul 14 22:57:27.498209 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.498209 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497720 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.498209 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497750 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f37c190b-70d5-41ae-ad87-96b058495645-cert\") pod \"ingress-canary-gjgwf\" (UID: \"f37c190b-70d5-41ae-ad87-96b058495645\") " pod="openshift-ingress-canary/ingress-canary-gjgwf" Jul 14 22:57:27.498209 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497780 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-config-volume\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:27.498209 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9-serving-cert\") pod \"service-ca-operator-7695fc6c8c-9dj2c\" (UID: \"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" Jul 14 22:57:27.498209 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497852 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13340f57-01a1-462f-b7c2-13985ec3ef72-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:27.498209 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.497899 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9-config\") pod \"service-ca-operator-7695fc6c8c-9dj2c\" (UID: \"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" Jul 14 22:57:27.498209 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.497987 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 22:57:27.498209 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.498108 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs podName:dbf0442c-13e6-4e76-909f-280c9bc111ed nodeName:}" failed. No retries permitted until 2026-07-14 22:57:27.998090934 +0000 UTC m=+36.614752611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs") pod "router-default-6cbc88d98d-86h58" (UID: "dbf0442c-13e6-4e76-909f-280c9bc111ed") : secret "router-metrics-certs-default" not found Jul 14 22:57:27.498209 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.498201 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle podName:dbf0442c-13e6-4e76-909f-280c9bc111ed nodeName:}" failed. No retries permitted until 2026-07-14 22:57:27.998186085 +0000 UTC m=+36.614847779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle") pod "router-default-6cbc88d98d-86h58" (UID: "dbf0442c-13e6-4e76-909f-280c9bc111ed") : configmap references non-existent config key: service-ca.crt Jul 14 22:57:27.498852 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.498386 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75599b0f-5f71-4919-8723-67aaa6ebe201-trusted-ca\") pod \"console-operator-7866497494-ppmpg\" (UID: \"75599b0f-5f71-4919-8723-67aaa6ebe201\") " pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:27.498852 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.498624 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a59d30e-3ddf-48a7-9de3-387c2e92f951-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-w4djw\" (UID: \"6a59d30e-3ddf-48a7-9de3-387c2e92f951\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" Jul 14 22:57:27.500348 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.500316 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-stats-auth\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.500444 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.500412 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-default-certificate\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.500502 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.500486 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9-serving-cert\") pod \"service-ca-operator-7695fc6c8c-9dj2c\" (UID: \"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" Jul 14 22:57:27.500652 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.500637 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a59d30e-3ddf-48a7-9de3-387c2e92f951-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-w4djw\" (UID: \"6a59d30e-3ddf-48a7-9de3-387c2e92f951\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" Jul 14 22:57:27.500825 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.500811 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f37c190b-70d5-41ae-ad87-96b058495645-cert\") pod \"ingress-canary-gjgwf\" (UID: \"f37c190b-70d5-41ae-ad87-96b058495645\") " pod="openshift-ingress-canary/ingress-canary-gjgwf" Jul 14 22:57:27.500881 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.500867 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75599b0f-5f71-4919-8723-67aaa6ebe201-serving-cert\") pod \"console-operator-7866497494-ppmpg\" (UID: \"75599b0f-5f71-4919-8723-67aaa6ebe201\") " pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:27.509358 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.509340 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" Jul 14 22:57:27.515399 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.514696 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-847vw\" (UniqueName: \"kubernetes.io/projected/1c15dde8-c2b7-4afd-a922-0bf324bb54c1-kube-api-access-847vw\") pod \"volume-data-source-validator-78495597f6-x9cqr\" (UID: \"1c15dde8-c2b7-4afd-a922-0bf324bb54c1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x9cqr" Jul 14 22:57:27.515399 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.515060 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s7st\" (UniqueName: \"kubernetes.io/projected/6a59d30e-3ddf-48a7-9de3-387c2e92f951-kube-api-access-4s7st\") pod \"kube-storage-version-migrator-operator-799cb7f958-w4djw\" (UID: \"6a59d30e-3ddf-48a7-9de3-387c2e92f951\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" Jul 14 22:57:27.515399 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.515253 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2kln\" (UniqueName: \"kubernetes.io/projected/13340f57-01a1-462f-b7c2-13985ec3ef72-kube-api-access-w2kln\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:27.515585 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.515474 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcvgn\" (UniqueName: \"kubernetes.io/projected/75599b0f-5f71-4919-8723-67aaa6ebe201-kube-api-access-vcvgn\") pod \"console-operator-7866497494-ppmpg\" (UID: \"75599b0f-5f71-4919-8723-67aaa6ebe201\") " pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:27.515681 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.515661 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpbdl\" (UniqueName: \"kubernetes.io/projected/f37c190b-70d5-41ae-ad87-96b058495645-kube-api-access-zpbdl\") pod \"ingress-canary-gjgwf\" (UID: \"f37c190b-70d5-41ae-ad87-96b058495645\") " pod="openshift-ingress-canary/ingress-canary-gjgwf" Jul 14 22:57:27.515857 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.515834 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbgn8\" (UniqueName: \"kubernetes.io/projected/6c75a176-d0e0-4cee-9d0c-5e977a433545-kube-api-access-pbgn8\") pod \"cluster-samples-operator-65db858894-7gcml\" (UID: \"6c75a176-d0e0-4cee-9d0c-5e977a433545\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:27.516013 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.515993 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j82hk\" (UniqueName: \"kubernetes.io/projected/e797c696-68ce-4d0f-ac1d-dd74d0291fd2-kube-api-access-j82hk\") pod \"network-check-source-869dcfcdcd-nz8h8\" (UID: \"e797c696-68ce-4d0f-ac1d-dd74d0291fd2\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nz8h8" Jul 14 22:57:27.516624 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.516603 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4dtc\" (UniqueName: \"kubernetes.io/projected/dbf0442c-13e6-4e76-909f-280c9bc111ed-kube-api-access-x4dtc\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:27.526254 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.526237 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x9cqr" Jul 14 22:57:27.587340 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.587306 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" Jul 14 22:57:27.591627 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.591597 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nz8h8" Jul 14 22:57:27.599224 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.599187 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-tmp-dir\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:27.599343 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.599294 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tdq2\" (UniqueName: \"kubernetes.io/projected/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-kube-api-access-8tdq2\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:27.599439 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.599388 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-config-volume\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:27.599510 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.599467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:27.599639 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.599622 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 22:57:27.599709 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.599686 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls podName:3cdd0825-5bd6-47e8-86c1-f008e96a9f8b nodeName:}" failed. No retries permitted until 2026-07-14 22:57:28.09966473 +0000 UTC m=+36.716326407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls") pod "dns-default-tmglv" (UID: "3cdd0825-5bd6-47e8-86c1-f008e96a9f8b") : secret "dns-default-metrics-tls" not found Jul 14 22:57:27.600103 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.600064 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-tmp-dir\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:27.600518 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.600482 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-config-volume\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:27.606834 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.606811 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gjgwf" Jul 14 22:57:27.615489 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.615286 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tdq2\" (UniqueName: \"kubernetes.io/projected/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-kube-api-access-8tdq2\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:27.654367 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.654023 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:27.667159 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.665967 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-nhddc"] Jul 14 22:57:27.673309 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:57:27.673282 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf375676_ba25_481c_babc_5c81539e7726.slice/crio-8cee49dc6893a73b8410692bafb195e9f97fc14e2be7be49332b55ddf0c9ddb8 WatchSource:0}: Error finding container 8cee49dc6893a73b8410692bafb195e9f97fc14e2be7be49332b55ddf0c9ddb8: Status 404 returned error can't find the container with id 8cee49dc6893a73b8410692bafb195e9f97fc14e2be7be49332b55ddf0c9ddb8 Jul 14 22:57:27.676305 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.675925 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x9cqr"] Jul 14 22:57:27.682491 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:57:27.682452 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c15dde8_c2b7_4afd_a922_0bf324bb54c1.slice/crio-aef9860c49e5189c74821d41e8547a2e7d9005bdfb64f9cbbd9b766122f1478a WatchSource:0}: Error finding container aef9860c49e5189c74821d41e8547a2e7d9005bdfb64f9cbbd9b766122f1478a: Status 404 returned error can't find the container with id aef9860c49e5189c74821d41e8547a2e7d9005bdfb64f9cbbd9b766122f1478a Jul 14 22:57:27.746402 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.746299 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw"] Jul 14 22:57:27.749065 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:57:27.749032 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a59d30e_3ddf_48a7_9de3_387c2e92f951.slice/crio-abe8c579329aeb391712030df9362a42494a19e7a2a8106848d325ceef455d82 WatchSource:0}: Error finding container abe8c579329aeb391712030df9362a42494a19e7a2a8106848d325ceef455d82: Status 404 returned error can't find the container with id abe8c579329aeb391712030df9362a42494a19e7a2a8106848d325ceef455d82 Jul 14 22:57:27.749969 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.749929 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-nz8h8"] Jul 14 22:57:27.750362 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.750334 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:27.751811 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:57:27.751782 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode797c696_68ce_4d0f_ac1d_dd74d0291fd2.slice/crio-d69ab4950419aff7e37d09b7cb62a642dd438e5bd63c061165c95b77c1b759bf WatchSource:0}: Error finding container d69ab4950419aff7e37d09b7cb62a642dd438e5bd63c061165c95b77c1b759bf: Status 404 returned error can't find the container with id d69ab4950419aff7e37d09b7cb62a642dd438e5bd63c061165c95b77c1b759bf Jul 14 22:57:27.762817 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.762800 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gjgwf"] Jul 14 22:57:27.764726 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:57:27.764702 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37c190b_70d5_41ae_ad87_96b058495645.slice/crio-6443bbfba13ba802da33bd96522853462bb6ef2c9cee0fc7f38c6ad724e3e770 WatchSource:0}: Error finding container 6443bbfba13ba802da33bd96522853462bb6ef2c9cee0fc7f38c6ad724e3e770: Status 404 returned error can't find the container with id 6443bbfba13ba802da33bd96522853462bb6ef2c9cee0fc7f38c6ad724e3e770 Jul 14 22:57:27.901727 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.901690 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:27.901897 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.901831 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 22:57:27.901897 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.901849 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dff44dd5f-rtvnn: secret "image-registry-tls" not found Jul 14 22:57:27.901967 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:27.901902 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls podName:f2c61efd-9ba4-4003-a455-8238eba3aec4 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:28.901887118 +0000 UTC m=+37.518548790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls") pod "image-registry-5dff44dd5f-rtvnn" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4") : secret "image-registry-tls" not found Jul 14 22:57:27.907900 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.907878 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:27.908026 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.907878 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:27.908082 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.907878 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:27.910488 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.910464 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 22:57:27.911258 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.911040 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wx244\"" Jul 14 22:57:27.911258 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.911090 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d24rt\"" Jul 14 22:57:27.911258 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:27.911103 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 22:57:28.002781 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.002687 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:28.002781 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.002728 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:28.002983 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.002848 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle podName:dbf0442c-13e6-4e76-909f-280c9bc111ed nodeName:}" failed. No retries permitted until 2026-07-14 22:57:29.002830592 +0000 UTC m=+37.619492264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle") pod "router-default-6cbc88d98d-86h58" (UID: "dbf0442c-13e6-4e76-909f-280c9bc111ed") : configmap references non-existent config key: service-ca.crt Jul 14 22:57:28.002983 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.002897 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 22:57:28.002983 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.002947 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs podName:dbf0442c-13e6-4e76-909f-280c9bc111ed nodeName:}" failed. No retries permitted until 2026-07-14 22:57:29.002934141 +0000 UTC m=+37.619595813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs") pod "router-default-6cbc88d98d-86h58" (UID: "dbf0442c-13e6-4e76-909f-280c9bc111ed") : secret "router-metrics-certs-default" not found Jul 14 22:57:28.003145 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.002999 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:28.003145 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.003085 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 22:57:28.003145 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.003117 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls podName:13340f57-01a1-462f-b7c2-13985ec3ef72 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:29.003107533 +0000 UTC m=+37.619769206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4znxt" (UID: "13340f57-01a1-462f-b7c2-13985ec3ef72") : secret "cluster-monitoring-operator-tls" not found Jul 14 22:57:28.003268 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.003159 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7gcml\" (UID: \"6c75a176-d0e0-4cee-9d0c-5e977a433545\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:28.003268 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.003261 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 22:57:28.003342 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.003290 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls podName:6c75a176-d0e0-4cee-9d0c-5e977a433545 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:29.00328196 +0000 UTC m=+37.619943632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls") pod "cluster-samples-operator-65db858894-7gcml" (UID: "6c75a176-d0e0-4cee-9d0c-5e977a433545") : secret "samples-operator-tls" not found Jul 14 22:57:28.103739 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.103706 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:28.103903 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.103843 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 22:57:28.103940 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.103905 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls podName:3cdd0825-5bd6-47e8-86c1-f008e96a9f8b nodeName:}" failed. No retries permitted until 2026-07-14 22:57:29.103890533 +0000 UTC m=+37.720552211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls") pod "dns-default-tmglv" (UID: "3cdd0825-5bd6-47e8-86c1-f008e96a9f8b") : secret "dns-default-metrics-tls" not found Jul 14 22:57:28.112104 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.112071 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gjgwf" event={"ID":"f37c190b-70d5-41ae-ad87-96b058495645","Type":"ContainerStarted","Data":"6443bbfba13ba802da33bd96522853462bb6ef2c9cee0fc7f38c6ad724e3e770"} Jul 14 22:57:28.113181 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.113155 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nz8h8" event={"ID":"e797c696-68ce-4d0f-ac1d-dd74d0291fd2","Type":"ContainerStarted","Data":"d69ab4950419aff7e37d09b7cb62a642dd438e5bd63c061165c95b77c1b759bf"} Jul 14 22:57:28.114150 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.114128 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" event={"ID":"6a59d30e-3ddf-48a7-9de3-387c2e92f951","Type":"ContainerStarted","Data":"abe8c579329aeb391712030df9362a42494a19e7a2a8106848d325ceef455d82"} Jul 14 22:57:28.116845 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.116822 2572 generic.go:356] "Generic (PLEG): container finished" podID="511a080e-cdd5-4403-bc46-b986daa2fa40" containerID="5c0a371397330f25e2d58a442a4c55a7053ee3e5ca11220f9bd68c6c87699190" exitCode=0 Jul 14 22:57:28.116941 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.116901 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4b8q" event={"ID":"511a080e-cdd5-4403-bc46-b986daa2fa40","Type":"ContainerDied","Data":"5c0a371397330f25e2d58a442a4c55a7053ee3e5ca11220f9bd68c6c87699190"} Jul 14 22:57:28.118193 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.117949 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x9cqr" event={"ID":"1c15dde8-c2b7-4afd-a922-0bf324bb54c1","Type":"ContainerStarted","Data":"aef9860c49e5189c74821d41e8547a2e7d9005bdfb64f9cbbd9b766122f1478a"} Jul 14 22:57:28.118970 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.118952 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" event={"ID":"df375676-ba25-481c-babc-5c81539e7726","Type":"ContainerStarted","Data":"8cee49dc6893a73b8410692bafb195e9f97fc14e2be7be49332b55ddf0c9ddb8"} Jul 14 22:57:28.498387 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.498010 2572 configmap.go:193] Couldn't get configMap openshift-console-operator/console-operator-config: failed to sync configmap cache: timed out waiting for the condition Jul 14 22:57:28.498387 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.498130 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75599b0f-5f71-4919-8723-67aaa6ebe201-config podName:75599b0f-5f71-4919-8723-67aaa6ebe201 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:28.99810611 +0000 UTC m=+37.614767800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/75599b0f-5f71-4919-8723-67aaa6ebe201-config") pod "console-operator-7866497494-ppmpg" (UID: "75599b0f-5f71-4919-8723-67aaa6ebe201") : failed to sync configmap cache: timed out waiting for the condition Jul 14 22:57:28.511194 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.510796 2572 projected.go:291] Couldn't get configMap openshift-service-ca-operator/openshift-service-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 14 22:57:28.511194 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.510823 2572 projected.go:196] Error preparing data for projected volume kube-api-access-l24wm for pod openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c: failed to sync configmap cache: timed out waiting for the condition Jul 14 22:57:28.511194 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.510935 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9-kube-api-access-l24wm podName:4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:29.010912666 +0000 UTC m=+37.627574355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l24wm" (UniqueName: "kubernetes.io/projected/4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9-kube-api-access-l24wm") pod "service-ca-operator-7695fc6c8c-9dj2c" (UID: "4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9") : failed to sync configmap cache: timed out waiting for the condition Jul 14 22:57:28.583627 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.583405 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 14 22:57:28.852233 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.852150 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 14 22:57:28.852391 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.852311 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zp8gc\"" Jul 14 22:57:28.911066 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:28.911028 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:28.911228 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.911189 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 22:57:28.911228 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.911205 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dff44dd5f-rtvnn: secret "image-registry-tls" not found Jul 14 22:57:28.911320 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:28.911260 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls podName:f2c61efd-9ba4-4003-a455-8238eba3aec4 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:30.911241915 +0000 UTC m=+39.527903606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls") pod "image-registry-5dff44dd5f-rtvnn" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4") : secret "image-registry-tls" not found Jul 14 22:57:29.011962 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.011920 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:29.012152 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.011978 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:29.012152 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.012041 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:29.012276 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.012200 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l24wm\" (UniqueName: \"kubernetes.io/projected/4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9-kube-api-access-l24wm\") pod \"service-ca-operator-7695fc6c8c-9dj2c\" (UID: \"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" Jul 14 22:57:29.012276 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.012243 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7gcml\" (UID: \"6c75a176-d0e0-4cee-9d0c-5e977a433545\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:29.012380 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.012318 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75599b0f-5f71-4919-8723-67aaa6ebe201-config\") pod \"console-operator-7866497494-ppmpg\" (UID: \"75599b0f-5f71-4919-8723-67aaa6ebe201\") " pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:29.012563 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:29.012522 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 22:57:29.012653 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:29.012617 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls podName:13340f57-01a1-462f-b7c2-13985ec3ef72 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:31.012594691 +0000 UTC m=+39.629256381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4znxt" (UID: "13340f57-01a1-462f-b7c2-13985ec3ef72") : secret "cluster-monitoring-operator-tls" not found Jul 14 22:57:29.013456 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:29.012719 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 22:57:29.013456 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:29.012776 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs podName:dbf0442c-13e6-4e76-909f-280c9bc111ed nodeName:}" failed. No retries permitted until 2026-07-14 22:57:31.012759258 +0000 UTC m=+39.629420937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs") pod "router-default-6cbc88d98d-86h58" (UID: "dbf0442c-13e6-4e76-909f-280c9bc111ed") : secret "router-metrics-certs-default" not found Jul 14 22:57:29.013456 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:29.012814 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle podName:dbf0442c-13e6-4e76-909f-280c9bc111ed nodeName:}" failed. No retries permitted until 2026-07-14 22:57:31.012799302 +0000 UTC m=+39.629460991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle") pod "router-default-6cbc88d98d-86h58" (UID: "dbf0442c-13e6-4e76-909f-280c9bc111ed") : configmap references non-existent config key: service-ca.crt Jul 14 22:57:29.013456 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:29.012867 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 22:57:29.013456 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:29.012908 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls podName:6c75a176-d0e0-4cee-9d0c-5e977a433545 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:31.012894529 +0000 UTC m=+39.629556205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls") pod "cluster-samples-operator-65db858894-7gcml" (UID: "6c75a176-d0e0-4cee-9d0c-5e977a433545") : secret "samples-operator-tls" not found Jul 14 22:57:29.013456 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.013106 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75599b0f-5f71-4919-8723-67aaa6ebe201-config\") pod \"console-operator-7866497494-ppmpg\" (UID: \"75599b0f-5f71-4919-8723-67aaa6ebe201\") " pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:29.017382 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.017359 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l24wm\" (UniqueName: \"kubernetes.io/projected/4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9-kube-api-access-l24wm\") pod \"service-ca-operator-7695fc6c8c-9dj2c\" (UID: \"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" Jul 14 22:57:29.061243 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.061210 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:29.073444 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.073418 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" Jul 14 22:57:29.113509 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.112738 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:29.113509 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:29.113040 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 22:57:29.113509 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:29.113105 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls podName:3cdd0825-5bd6-47e8-86c1-f008e96a9f8b nodeName:}" failed. No retries permitted until 2026-07-14 22:57:31.113079181 +0000 UTC m=+39.729740857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls") pod "dns-default-tmglv" (UID: "3cdd0825-5bd6-47e8-86c1-f008e96a9f8b") : secret "dns-default-metrics-tls" not found Jul 14 22:57:29.127714 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.127576 2572 generic.go:356] "Generic (PLEG): container finished" podID="511a080e-cdd5-4403-bc46-b986daa2fa40" containerID="207df3d2a127ab75e366773e5ad768937c797ea7719c0de88e94274c53da7a13" exitCode=0 Jul 14 22:57:29.127714 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.127655 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4b8q" event={"ID":"511a080e-cdd5-4403-bc46-b986daa2fa40","Type":"ContainerDied","Data":"207df3d2a127ab75e366773e5ad768937c797ea7719c0de88e94274c53da7a13"} Jul 14 22:57:29.485876 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.485577 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-ppmpg"] Jul 14 22:57:29.492609 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:57:29.490875 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75599b0f_5f71_4919_8723_67aaa6ebe201.slice/crio-2f262c4d0a5f870ec1a1cc66f1954009d981957d29eb32cde63adcdb6b531be1 WatchSource:0}: Error finding container 2f262c4d0a5f870ec1a1cc66f1954009d981957d29eb32cde63adcdb6b531be1: Status 404 returned error can't find the container with id 2f262c4d0a5f870ec1a1cc66f1954009d981957d29eb32cde63adcdb6b531be1 Jul 14 22:57:29.492609 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:29.492466 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c"] Jul 14 22:57:29.497650 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:57:29.497601 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0171bd_b6f8_4c20_a09e_c87bfc3b60f9.slice/crio-95bbf37a6d9847dc7266ac9ab5889bbd51cb5a0458d1daab433a2f60dc02084a WatchSource:0}: Error finding container 95bbf37a6d9847dc7266ac9ab5889bbd51cb5a0458d1daab433a2f60dc02084a: Status 404 returned error can't find the container with id 95bbf37a6d9847dc7266ac9ab5889bbd51cb5a0458d1daab433a2f60dc02084a Jul 14 22:57:30.133325 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:30.133268 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x9cqr" event={"ID":"1c15dde8-c2b7-4afd-a922-0bf324bb54c1","Type":"ContainerStarted","Data":"7e52373f7142fe702f1c8cab522682d2d0e1d4c664da0ffb8f9b1cb7d5f421b5"} Jul 14 22:57:30.135005 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:30.134957 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-ppmpg" event={"ID":"75599b0f-5f71-4919-8723-67aaa6ebe201","Type":"ContainerStarted","Data":"2f262c4d0a5f870ec1a1cc66f1954009d981957d29eb32cde63adcdb6b531be1"} Jul 14 22:57:30.136349 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:30.136324 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" event={"ID":"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9","Type":"ContainerStarted","Data":"95bbf37a6d9847dc7266ac9ab5889bbd51cb5a0458d1daab433a2f60dc02084a"} Jul 14 22:57:30.140556 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:30.140518 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4b8q" event={"ID":"511a080e-cdd5-4403-bc46-b986daa2fa40","Type":"ContainerStarted","Data":"c3ef34be65cd425275a1326f664619bd125232c7c52016472702a32c1c057565"} Jul 14 22:57:30.158699 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:30.158623 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x9cqr" podStartSLOduration=27.396274665 podStartE2EDuration="29.158599721s" totalImagesPullingTime="1.762325056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:30.150115966 +0000 UTC m=+38.766777661" watchObservedRunningTime="2026-07-14 22:57:30.158599721 +0000 UTC m=+38.775261415" Jul 14 22:57:30.176222 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:30.176160 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s4b8q" podStartSLOduration=8.734804303 podStartE2EDuration="38.176144371s" totalImagesPullingTime="29.441340068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:56:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:30.175187426 +0000 UTC m=+38.791849116" watchObservedRunningTime="2026-07-14 22:57:30.176144371 +0000 UTC m=+38.792806066" Jul 14 22:57:30.233123 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:30.233072 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:30.297457 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:30.297413 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:30.397744 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:30.397665 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:30.498623 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:30.498586 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:30.934071 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:30.934034 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:30.934225 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:30.934186 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 22:57:30.934225 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:30.934204 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dff44dd5f-rtvnn: secret "image-registry-tls" not found Jul 14 22:57:30.934292 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:30.934257 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls podName:f2c61efd-9ba4-4003-a455-8238eba3aec4 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:34.934241464 +0000 UTC m=+43.550903136 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls") pod "image-registry-5dff44dd5f-rtvnn" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4") : secret "image-registry-tls" not found Jul 14 22:57:31.034692 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:31.034657 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:31.034892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:31.034752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7gcml\" (UID: \"6c75a176-d0e0-4cee-9d0c-5e977a433545\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:31.034892 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:31.034823 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 22:57:31.034892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:31.034846 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:31.034892 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:31.034875 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:31.035103 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:31.034897 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls podName:13340f57-01a1-462f-b7c2-13985ec3ef72 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:35.034880708 +0000 UTC m=+43.651542401 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4znxt" (UID: "13340f57-01a1-462f-b7c2-13985ec3ef72") : secret "cluster-monitoring-operator-tls" not found Jul 14 22:57:31.035103 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:31.034912 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 22:57:31.035103 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:31.034970 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls podName:6c75a176-d0e0-4cee-9d0c-5e977a433545 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:35.034954882 +0000 UTC m=+43.651616554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls") pod "cluster-samples-operator-65db858894-7gcml" (UID: "6c75a176-d0e0-4cee-9d0c-5e977a433545") : secret "samples-operator-tls" not found Jul 14 22:57:31.035103 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:31.034991 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle podName:dbf0442c-13e6-4e76-909f-280c9bc111ed nodeName:}" failed. No retries permitted until 2026-07-14 22:57:35.034981076 +0000 UTC m=+43.651642752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle") pod "router-default-6cbc88d98d-86h58" (UID: "dbf0442c-13e6-4e76-909f-280c9bc111ed") : configmap references non-existent config key: service-ca.crt Jul 14 22:57:31.035103 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:31.035001 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 22:57:31.035103 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:31.035040 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs podName:dbf0442c-13e6-4e76-909f-280c9bc111ed nodeName:}" failed. No retries permitted until 2026-07-14 22:57:35.035025674 +0000 UTC m=+43.651687372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs") pod "router-default-6cbc88d98d-86h58" (UID: "dbf0442c-13e6-4e76-909f-280c9bc111ed") : secret "router-metrics-certs-default" not found Jul 14 22:57:31.135601 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:31.135561 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:31.136022 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:31.135747 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 22:57:31.136022 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:31.135824 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls podName:3cdd0825-5bd6-47e8-86c1-f008e96a9f8b nodeName:}" failed. No retries permitted until 2026-07-14 22:57:35.13580602 +0000 UTC m=+43.752467692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls") pod "dns-default-tmglv" (UID: "3cdd0825-5bd6-47e8-86c1-f008e96a9f8b") : secret "dns-default-metrics-tls" not found Jul 14 22:57:31.675683 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:31.675630 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:31.734970 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:31.734855 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:33.682646 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:33.682616 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:33.782124 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:33.782087 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:34.753310 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:34.753170 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:34.822916 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:34.822869 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:34.932833 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:34.932800 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:34.971925 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:34.971889 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:34.972066 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:34.972043 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 22:57:34.972066 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:34.972058 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dff44dd5f-rtvnn: secret "image-registry-tls" not found Jul 14 22:57:34.972134 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:34.972109 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls podName:f2c61efd-9ba4-4003-a455-8238eba3aec4 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:42.97209376 +0000 UTC m=+51.588755452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls") pod "image-registry-5dff44dd5f-rtvnn" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4") : secret "image-registry-tls" not found Jul 14 22:57:35.033493 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:35.033421 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:35.073075 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:35.073041 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7gcml\" (UID: \"6c75a176-d0e0-4cee-9d0c-5e977a433545\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:35.073241 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:35.073143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:35.073241 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:35.073169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:35.073241 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:35.073217 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 22:57:35.073373 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:35.073253 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 22:57:35.073373 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:35.073272 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 22:57:35.073373 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:35.073282 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls podName:6c75a176-d0e0-4cee-9d0c-5e977a433545 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:43.073263564 +0000 UTC m=+51.689925253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls") pod "cluster-samples-operator-65db858894-7gcml" (UID: "6c75a176-d0e0-4cee-9d0c-5e977a433545") : secret "samples-operator-tls" not found Jul 14 22:57:35.073373 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:35.073310 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs podName:dbf0442c-13e6-4e76-909f-280c9bc111ed nodeName:}" failed. No retries permitted until 2026-07-14 22:57:43.073297844 +0000 UTC m=+51.689959519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs") pod "router-default-6cbc88d98d-86h58" (UID: "dbf0442c-13e6-4e76-909f-280c9bc111ed") : secret "router-metrics-certs-default" not found Jul 14 22:57:35.073373 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:35.073324 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls podName:13340f57-01a1-462f-b7c2-13985ec3ef72 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:43.073318234 +0000 UTC m=+51.689979906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4znxt" (UID: "13340f57-01a1-462f-b7c2-13985ec3ef72") : secret "cluster-monitoring-operator-tls" not found Jul 14 22:57:35.073373 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:35.073220 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:35.073373 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:35.073354 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle podName:dbf0442c-13e6-4e76-909f-280c9bc111ed nodeName:}" failed. No retries permitted until 2026-07-14 22:57:43.073335935 +0000 UTC m=+51.689997620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle") pod "router-default-6cbc88d98d-86h58" (UID: "dbf0442c-13e6-4e76-909f-280c9bc111ed") : configmap references non-existent config key: service-ca.crt Jul 14 22:57:35.133413 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:35.133374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:35.174098 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:35.174064 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:35.174264 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:35.174240 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 22:57:35.174321 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:35.174305 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls podName:3cdd0825-5bd6-47e8-86c1-f008e96a9f8b nodeName:}" failed. No retries permitted until 2026-07-14 22:57:43.174288524 +0000 UTC m=+51.790950196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls") pod "dns-default-tmglv" (UID: "3cdd0825-5bd6-47e8-86c1-f008e96a9f8b") : secret "dns-default-metrics-tls" not found Jul 14 22:57:35.233286 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:35.233251 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:36.159536 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.159499 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gjgwf" event={"ID":"f37c190b-70d5-41ae-ad87-96b058495645","Type":"ContainerStarted","Data":"fb388ca31d401ad894ad1fd239ee8709c8bfebb25a707d6d22b49b8c62d919bc"} Jul 14 22:57:36.161381 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.161347 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nz8h8" event={"ID":"e797c696-68ce-4d0f-ac1d-dd74d0291fd2","Type":"ContainerStarted","Data":"a7c607b4dcd19adfd2337da4469374f824583f179e0cf0a64465fa2c07a42fdd"} Jul 14 22:57:36.163157 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.163074 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" event={"ID":"6a59d30e-3ddf-48a7-9de3-387c2e92f951","Type":"ContainerStarted","Data":"9b984f1babd52e97e470e6641916a8dbc6c336085a973637f60ae181e606f430"} Jul 14 22:57:36.165147 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.165123 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" event={"ID":"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9","Type":"ContainerStarted","Data":"e1d792a5247f4a7db59eb2d2a0b88c9a5a4154336645747e9e553c268ce93403"} Jul 14 22:57:36.166838 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.166792 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" event={"ID":"df375676-ba25-481c-babc-5c81539e7726","Type":"ContainerStarted","Data":"a0028a814e4c8e19f6633b883fc19cdfafd9d847126f619e6dbdfe8d62c4b1a2"} Jul 14 22:57:36.168871 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.168850 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/0.log" Jul 14 22:57:36.169020 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.168890 2572 generic.go:356] "Generic (PLEG): container finished" podID="75599b0f-5f71-4919-8723-67aaa6ebe201" containerID="9fb35a33297802a9425ab2ff5a14a6ceb81991bc7537a58cdcd6497fa43362c1" exitCode=255 Jul 14 22:57:36.169020 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.168929 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-ppmpg" event={"ID":"75599b0f-5f71-4919-8723-67aaa6ebe201","Type":"ContainerDied","Data":"9fb35a33297802a9425ab2ff5a14a6ceb81991bc7537a58cdcd6497fa43362c1"} Jul 14 22:57:36.169298 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.169140 2572 scope.go:117] "RemoveContainer" containerID="9fb35a33297802a9425ab2ff5a14a6ceb81991bc7537a58cdcd6497fa43362c1" Jul 14 22:57:36.176344 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.176303 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gjgwf" podStartSLOduration=3.241221565 podStartE2EDuration="9.176289447s" totalImagesPullingTime="5.935067882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:36.175274908 +0000 UTC m=+44.791936602" watchObservedRunningTime="2026-07-14 22:57:36.176289447 +0000 UTC m=+44.792951182" Jul 14 22:57:36.199234 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.199181 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" podStartSLOduration=29.17548375 podStartE2EDuration="35.199160985s" totalImagesPullingTime="6.023677235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:36.198038321 +0000 UTC m=+44.814700016" watchObservedRunningTime="2026-07-14 22:57:36.199160985 +0000 UTC m=+44.815822679" Jul 14 22:57:36.236854 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.236801 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" podStartSLOduration=24.476154336 podStartE2EDuration="30.236780284s" totalImagesPullingTime="5.760625948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:36.235698753 +0000 UTC m=+44.852360448" watchObservedRunningTime="2026-07-14 22:57:36.236780284 +0000 UTC m=+44.853441979" Jul 14 22:57:36.257835 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.257751 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nz8h8" podStartSLOduration=21.787824143 podStartE2EDuration="29.257729318s" totalImagesPullingTime="7.469905175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:36.250705097 +0000 UTC m=+44.867366795" watchObservedRunningTime="2026-07-14 22:57:36.257729318 +0000 UTC m=+44.874391014" Jul 14 22:57:36.273754 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.273702 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" podStartSLOduration=26.323769374 podStartE2EDuration="32.273680959s" totalImagesPullingTime="5.949911585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:36.272381 +0000 UTC m=+44.889042695" watchObservedRunningTime="2026-07-14 22:57:36.273680959 +0000 UTC m=+44.890342655" Jul 14 22:57:36.342064 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.342030 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:36.441894 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.441812 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:36.697081 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.697002 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nrqc5"] Jul 14 22:57:36.720179 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.720152 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nrqc5"] Jul 14 22:57:36.720336 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.720270 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.723336 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.723316 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 22:57:36.723336 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.723319 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9vm8v\"" Jul 14 22:57:36.723527 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.723379 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 22:57:36.739482 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.739453 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:36.788970 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.788937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6h8k\" (UniqueName: \"kubernetes.io/projected/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-api-access-z6h8k\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.789149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.789006 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.789149 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.789137 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.789292 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.789181 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-data-volume\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.789292 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.789214 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-crio-socket\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.850120 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.850071 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:36.889975 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.889947 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6h8k\" (UniqueName: \"kubernetes.io/projected/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-api-access-z6h8k\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.890112 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.890006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.890112 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.890060 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.890112 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.890089 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-data-volume\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.890276 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.890114 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-crio-socket\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.890276 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:36.890136 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 22:57:36.890276 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:36.890189 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 22:57:36.890276 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:36.890201 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm podName:b494dbd0-9ebe-4937-a03b-a42e62f0d20f nodeName:}" failed. No retries permitted until 2026-07-14 22:57:37.390181265 +0000 UTC m=+46.006842964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nrqc5" (UID: "b494dbd0-9ebe-4937-a03b-a42e62f0d20f") : configmap "kube-rbac-proxy" not found Jul 14 22:57:36.890276 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:36.890240 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls podName:b494dbd0-9ebe-4937-a03b-a42e62f0d20f nodeName:}" failed. No retries permitted until 2026-07-14 22:57:37.390226526 +0000 UTC m=+46.006888198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nrqc5" (UID: "b494dbd0-9ebe-4937-a03b-a42e62f0d20f") : secret "insights-runtime-extractor-tls" not found Jul 14 22:57:36.890532 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.890322 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-crio-socket\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.890532 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.890500 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-data-volume\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.899490 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.899463 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6h8k\" (UniqueName: \"kubernetes.io/projected/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-api-access-z6h8k\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:36.937664 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:36.937621 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:37.018048 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:37.017965 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:37.116520 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:37.116483 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:37.173907 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:37.173882 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 22:57:37.174282 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:37.174231 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/0.log" Jul 14 22:57:37.174282 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:37.174263 2572 generic.go:356] "Generic (PLEG): container finished" podID="75599b0f-5f71-4919-8723-67aaa6ebe201" containerID="ab59e0fa11f4402002a0a303b575d26adc6232833cbc94df1cd7a3e937e35a89" exitCode=255 Jul 14 22:57:37.174377 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:37.174295 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-ppmpg" event={"ID":"75599b0f-5f71-4919-8723-67aaa6ebe201","Type":"ContainerDied","Data":"ab59e0fa11f4402002a0a303b575d26adc6232833cbc94df1cd7a3e937e35a89"} Jul 14 22:57:37.187233 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:37.187201 2572 scope.go:117] "RemoveContainer" containerID="9fb35a33297802a9425ab2ff5a14a6ceb81991bc7537a58cdcd6497fa43362c1" Jul 14 22:57:37.187393 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:37.187327 2572 scope.go:117] "RemoveContainer" containerID="ab59e0fa11f4402002a0a303b575d26adc6232833cbc94df1cd7a3e937e35a89" Jul 14 22:57:37.187574 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:37.187528 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-ppmpg_openshift-console-operator(75599b0f-5f71-4919-8723-67aaa6ebe201)\"" pod="openshift-console-operator/console-operator-7866497494-ppmpg" podUID="75599b0f-5f71-4919-8723-67aaa6ebe201" Jul 14 22:57:37.395882 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:37.395801 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:37.395882 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:37.395868 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:37.396063 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:37.395923 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 22:57:37.396063 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:37.396005 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm podName:b494dbd0-9ebe-4937-a03b-a42e62f0d20f nodeName:}" failed. No retries permitted until 2026-07-14 22:57:38.395989214 +0000 UTC m=+47.012650886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nrqc5" (UID: "b494dbd0-9ebe-4937-a03b-a42e62f0d20f") : configmap "kube-rbac-proxy" not found Jul 14 22:57:37.396063 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:37.396017 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 22:57:37.396166 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:37.396079 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls podName:b494dbd0-9ebe-4937-a03b-a42e62f0d20f nodeName:}" failed. No retries permitted until 2026-07-14 22:57:38.396064938 +0000 UTC m=+47.012726610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nrqc5" (UID: "b494dbd0-9ebe-4937-a03b-a42e62f0d20f") : secret "insights-runtime-extractor-tls" not found Jul 14 22:57:38.181440 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:38.181412 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 22:57:38.181829 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:38.181775 2572 scope.go:117] "RemoveContainer" containerID="ab59e0fa11f4402002a0a303b575d26adc6232833cbc94df1cd7a3e937e35a89" Jul 14 22:57:38.181960 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:38.181941 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-ppmpg_openshift-console-operator(75599b0f-5f71-4919-8723-67aaa6ebe201)\"" pod="openshift-console-operator/console-operator-7866497494-ppmpg" podUID="75599b0f-5f71-4919-8723-67aaa6ebe201" Jul 14 22:57:38.404938 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:38.404896 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:38.405172 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:38.404981 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:38.405172 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:38.405043 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 22:57:38.405172 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:38.405103 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 22:57:38.405172 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:38.405136 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm podName:b494dbd0-9ebe-4937-a03b-a42e62f0d20f nodeName:}" failed. No retries permitted until 2026-07-14 22:57:40.405115055 +0000 UTC m=+49.021776728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nrqc5" (UID: "b494dbd0-9ebe-4937-a03b-a42e62f0d20f") : configmap "kube-rbac-proxy" not found Jul 14 22:57:38.405172 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:38.405155 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls podName:b494dbd0-9ebe-4937-a03b-a42e62f0d20f nodeName:}" failed. No retries permitted until 2026-07-14 22:57:40.405146494 +0000 UTC m=+49.021808170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nrqc5" (UID: "b494dbd0-9ebe-4937-a03b-a42e62f0d20f") : secret "insights-runtime-extractor-tls" not found Jul 14 22:57:38.440221 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:38.440142 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:38.494031 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:38.494009 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5k7g_5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd/dns-node-resolver/0.log" Jul 14 22:57:38.502360 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:38.502328 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:38.672759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:38.672725 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:38.726264 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:38.726163 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:39.061679 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:39.061597 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:39.061827 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:39.061692 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:39.184922 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:39.184890 2572 scope.go:117] "RemoveContainer" containerID="ab59e0fa11f4402002a0a303b575d26adc6232833cbc94df1cd7a3e937e35a89" Jul 14 22:57:39.185331 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:39.185085 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-ppmpg_openshift-console-operator(75599b0f-5f71-4919-8723-67aaa6ebe201)\"" pod="openshift-console-operator/console-operator-7866497494-ppmpg" podUID="75599b0f-5f71-4919-8723-67aaa6ebe201" Jul 14 22:57:39.494917 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:39.494891 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xnjpp_657fd608-a02e-4549-8ddb-fc3804266929/node-ca/0.log" Jul 14 22:57:39.896976 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:39.896902 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gjgwf_f37c190b-70d5-41ae-ad87-96b058495645/serve-healthcheck-canary/0.log" Jul 14 22:57:39.944501 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:39.944458 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:40.422256 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:40.422215 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:40.422705 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:40.422315 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:40.422705 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:40.422336 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 22:57:40.422705 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:40.422395 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm podName:b494dbd0-9ebe-4937-a03b-a42e62f0d20f nodeName:}" failed. No retries permitted until 2026-07-14 22:57:44.422380104 +0000 UTC m=+53.039041776 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nrqc5" (UID: "b494dbd0-9ebe-4937-a03b-a42e62f0d20f") : configmap "kube-rbac-proxy" not found Jul 14 22:57:40.422705 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:40.422451 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 22:57:40.422705 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:40.422507 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls podName:b494dbd0-9ebe-4937-a03b-a42e62f0d20f nodeName:}" failed. No retries permitted until 2026-07-14 22:57:44.422493483 +0000 UTC m=+53.039155158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nrqc5" (UID: "b494dbd0-9ebe-4937-a03b-a42e62f0d20f") : secret "insights-runtime-extractor-tls" not found Jul 14 22:57:41.747659 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:41.747624 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:41.848347 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:41.848320 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:42.725224 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:42.725183 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:43.046025 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:43.045943 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:43.046371 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:43.046062 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 22:57:43.046371 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:43.046072 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dff44dd5f-rtvnn: secret "image-registry-tls" not found Jul 14 22:57:43.046371 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:43.046115 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls podName:f2c61efd-9ba4-4003-a455-8238eba3aec4 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:59.046101858 +0000 UTC m=+67.662763534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls") pod "image-registry-5dff44dd5f-rtvnn" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4") : secret "image-registry-tls" not found Jul 14 22:57:43.146525 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:43.146487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7gcml\" (UID: \"6c75a176-d0e0-4cee-9d0c-5e977a433545\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:43.146698 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:43.146584 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:43.146698 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:43.146602 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:43.146698 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:43.146638 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:43.146698 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:43.146644 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 22:57:43.146835 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:43.146710 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 22:57:43.146835 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:43.146724 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls podName:6c75a176-d0e0-4cee-9d0c-5e977a433545 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:59.146702896 +0000 UTC m=+67.763364600 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls") pod "cluster-samples-operator-65db858894-7gcml" (UID: "6c75a176-d0e0-4cee-9d0c-5e977a433545") : secret "samples-operator-tls" not found Jul 14 22:57:43.146835 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:43.146732 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 22:57:43.146835 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:43.146750 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs podName:dbf0442c-13e6-4e76-909f-280c9bc111ed nodeName:}" failed. No retries permitted until 2026-07-14 22:57:59.146740276 +0000 UTC m=+67.763401957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs") pod "router-default-6cbc88d98d-86h58" (UID: "dbf0442c-13e6-4e76-909f-280c9bc111ed") : secret "router-metrics-certs-default" not found Jul 14 22:57:43.146835 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:43.146771 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls podName:13340f57-01a1-462f-b7c2-13985ec3ef72 nodeName:}" failed. No retries permitted until 2026-07-14 22:57:59.146756548 +0000 UTC m=+67.763418220 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4znxt" (UID: "13340f57-01a1-462f-b7c2-13985ec3ef72") : secret "cluster-monitoring-operator-tls" not found Jul 14 22:57:43.146835 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:43.146793 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle podName:dbf0442c-13e6-4e76-909f-280c9bc111ed nodeName:}" failed. No retries permitted until 2026-07-14 22:57:59.146779665 +0000 UTC m=+67.763441340 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle") pod "router-default-6cbc88d98d-86h58" (UID: "dbf0442c-13e6-4e76-909f-280c9bc111ed") : configmap references non-existent config key: service-ca.crt Jul 14 22:57:43.153476 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:43.153448 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:43.247128 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:43.247089 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:43.247283 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:43.247238 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 22:57:43.247350 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:43.247308 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls podName:3cdd0825-5bd6-47e8-86c1-f008e96a9f8b nodeName:}" failed. No retries permitted until 2026-07-14 22:57:59.24729201 +0000 UTC m=+67.863953683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls") pod "dns-default-tmglv" (UID: "3cdd0825-5bd6-47e8-86c1-f008e96a9f8b") : secret "dns-default-metrics-tls" not found Jul 14 22:57:43.513183 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:43.513146 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:43.658525 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:43.658489 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:43.757610 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:43.757581 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:43.858102 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:43.858007 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:44.220258 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:44.220220 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:44.458747 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:44.458709 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:44.458888 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:44.458778 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:44.458961 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:44.458946 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 22:57:44.459018 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:57:44.459008 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls podName:b494dbd0-9ebe-4937-a03b-a42e62f0d20f nodeName:}" failed. No retries permitted until 2026-07-14 22:57:52.458992473 +0000 UTC m=+61.075654151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nrqc5" (UID: "b494dbd0-9ebe-4937-a03b-a42e62f0d20f") : secret "insights-runtime-extractor-tls" not found Jul 14 22:57:44.459279 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:44.459261 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:44.931951 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:44.931919 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:45.538934 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:45.538897 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:45.736442 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:45.736413 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:45.811126 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:45.811036 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:45.934987 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:45.934950 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:46.132235 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:46.132153 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:46.792730 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:46.792696 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:47.121939 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:47.121863 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:47.181586 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:47.181557 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:47.536051 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:47.536019 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:47.738471 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:47.738437 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:47.944096 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:47.944050 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:47.999164 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:47.999130 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:48.138223 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:48.138188 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:49.330717 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:49.330687 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:49.533732 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:49.533700 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:49.733827 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:49.733790 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:49.930459 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:49.930422 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:50.123516 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:50.123434 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:50.224726 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:50.224695 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:50.904527 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:50.904499 2572 scope.go:117] "RemoveContainer" containerID="ab59e0fa11f4402002a0a303b575d26adc6232833cbc94df1cd7a3e937e35a89" Jul 14 22:57:51.223962 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:51.223881 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 22:57:51.223962 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:51.223931 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-ppmpg" event={"ID":"75599b0f-5f71-4919-8723-67aaa6ebe201","Type":"ContainerStarted","Data":"fdb444146d15b400a342e8c345f77db76df3d0f1e053af3092b7858b8feda854"} Jul 14 22:57:51.224211 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:51.224185 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:51.246413 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:51.246366 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-ppmpg" podStartSLOduration=43.493921736 podStartE2EDuration="49.246352983s" totalImagesPullingTime="5.752431247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:51.245270246 +0000 UTC m=+59.861931940" watchObservedRunningTime="2026-07-14 22:57:51.246352983 +0000 UTC m=+59.863014677" Jul 14 22:57:51.337819 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:51.337785 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:51.537233 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:51.537136 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:51.754010 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:51.753979 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-ppmpg" Jul 14 22:57:51.780468 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:51.780428 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:51.936577 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:51.936520 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:52.041567 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.041514 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:52.110774 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.110746 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-98b67" Jul 14 22:57:52.136555 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.136510 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:52.236613 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.236525 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:52.294929 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.294894 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:52.419215 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.419177 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:52.486077 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.486041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:52.534810 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.534745 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:52.537090 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.537061 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b494dbd0-9ebe-4937-a03b-a42e62f0d20f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrqc5\" (UID: \"b494dbd0-9ebe-4937-a03b-a42e62f0d20f\") " pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:52.633091 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.633063 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9vm8v\"" Jul 14 22:57:52.640582 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.640532 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nrqc5" Jul 14 22:57:52.700558 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.700441 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:52.772081 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.772053 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nrqc5"] Jul 14 22:57:52.774895 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:57:52.774859 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb494dbd0_9ebe_4937_a03b_a42e62f0d20f.slice/crio-40e8fecccddef3034ec6059e2bfb17b9b045c90cf74d683551fe80d479fe8a22 WatchSource:0}: Error finding container 40e8fecccddef3034ec6059e2bfb17b9b045c90cf74d683551fe80d479fe8a22: Status 404 returned error can't find the container with id 40e8fecccddef3034ec6059e2bfb17b9b045c90cf74d683551fe80d479fe8a22 Jul 14 22:57:52.775725 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:52.775701 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:53.087477 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:53.087447 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:53.184504 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:53.184467 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:53.233580 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:53.233525 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nrqc5" event={"ID":"b494dbd0-9ebe-4937-a03b-a42e62f0d20f","Type":"ContainerStarted","Data":"40e8fecccddef3034ec6059e2bfb17b9b045c90cf74d683551fe80d479fe8a22"} Jul 14 22:57:53.343631 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:53.343518 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:53.536505 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:53.536475 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:53.681572 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:53.681527 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:53.782621 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:53.782526 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:53.883213 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:53.883173 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:53.982994 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:53.982901 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:54.133563 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:54.133510 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:54.538437 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:54.538360 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:54.905025 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:54.904984 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:56.732263 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:56.732141 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:56.832493 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:56.832459 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:57.249074 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.249039 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nrqc5" event={"ID":"b494dbd0-9ebe-4937-a03b-a42e62f0d20f","Type":"ContainerStarted","Data":"5baa8a3a1a6a3b7e9e2f8e822e897895ec5fd7d89152560d3970856839b1f23c"} Jul 14 22:57:57.249220 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.249108 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nrqc5" event={"ID":"b494dbd0-9ebe-4937-a03b-a42e62f0d20f","Type":"ContainerStarted","Data":"9da9530392a9994ab431f8a8088ec214ad3d8b05ce9cb3311cbbf719e85701cf"} Jul 14 22:57:57.585209 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.585171 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:57.585391 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.585231 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs\") pod \"network-metrics-daemon-fgjds\" (UID: \"47316235-0c7a-4121-9099-3b86679137ba\") " pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:57.588345 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.588322 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 22:57:57.589585 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.589569 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 22:57:57.597996 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.597973 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1024b4d-03b0-4d83-928e-d04a0fe55861-original-pull-secret\") pod \"global-pull-secret-syncer-pn6sh\" (UID: \"c1024b4d-03b0-4d83-928e-d04a0fe55861\") " pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:57.597996 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.597992 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47316235-0c7a-4121-9099-3b86679137ba-metrics-certs\") pod \"network-metrics-daemon-fgjds\" (UID: \"47316235-0c7a-4121-9099-3b86679137ba\") " pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:57.624487 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.624456 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d24rt\"" Jul 14 22:57:57.631822 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.631797 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgjds" Jul 14 22:57:57.631941 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.631844 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6sh" Jul 14 22:57:57.787660 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.787473 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn5rs\" (UniqueName: \"kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs\") pod \"network-check-target-84br9\" (UID: \"1c8536f6-15f3-4d84-9b99-4f051233feac\") " pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:57.790462 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.790435 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn5rs\" (UniqueName: \"kubernetes.io/projected/1c8536f6-15f3-4d84-9b99-4f051233feac-kube-api-access-dn5rs\") pod \"network-check-target-84br9\" (UID: \"1c8536f6-15f3-4d84-9b99-4f051233feac\") " pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:57.807030 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.807002 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fgjds"] Jul 14 22:57:57.809276 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:57:57.809248 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47316235_0c7a_4121_9099_3b86679137ba.slice/crio-8a8d21d57414de5bd23d7f0bec4df51d5c60d9f18fd83fff40b775755b2b305d WatchSource:0}: Error finding container 8a8d21d57414de5bd23d7f0bec4df51d5c60d9f18fd83fff40b775755b2b305d: Status 404 returned error can't find the container with id 8a8d21d57414de5bd23d7f0bec4df51d5c60d9f18fd83fff40b775755b2b305d Jul 14 22:57:57.813195 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.813172 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pn6sh"] Jul 14 22:57:57.816102 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:57:57.816077 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1024b4d_03b0_4d83_928e_d04a0fe55861.slice/crio-34712a1b0f9b2d4a2001738da56b712a31b329d74d1e15de0e27907896cede1a WatchSource:0}: Error finding container 34712a1b0f9b2d4a2001738da56b712a31b329d74d1e15de0e27907896cede1a: Status 404 returned error can't find the container with id 34712a1b0f9b2d4a2001738da56b712a31b329d74d1e15de0e27907896cede1a Jul 14 22:57:57.930492 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.930458 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wx244\"" Jul 14 22:57:57.938818 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:57.938790 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:58.082705 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:58.082666 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-84br9"] Jul 14 22:57:58.085367 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:57:58.085337 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8536f6_15f3_4d84_9b99_4f051233feac.slice/crio-502c5e139990fac324ec2941c27c3adbae49971f4ae742d07348531df97bfc0e WatchSource:0}: Error finding container 502c5e139990fac324ec2941c27c3adbae49971f4ae742d07348531df97bfc0e: Status 404 returned error can't find the container with id 502c5e139990fac324ec2941c27c3adbae49971f4ae742d07348531df97bfc0e Jul 14 22:57:58.254269 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:58.254181 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pn6sh" event={"ID":"c1024b4d-03b0-4d83-928e-d04a0fe55861","Type":"ContainerStarted","Data":"34712a1b0f9b2d4a2001738da56b712a31b329d74d1e15de0e27907896cede1a"} Jul 14 22:57:58.255729 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:58.255652 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fgjds" event={"ID":"47316235-0c7a-4121-9099-3b86679137ba","Type":"ContainerStarted","Data":"8a8d21d57414de5bd23d7f0bec4df51d5c60d9f18fd83fff40b775755b2b305d"} Jul 14 22:57:58.257440 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:58.257412 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-84br9" event={"ID":"1c8536f6-15f3-4d84-9b99-4f051233feac","Type":"ContainerStarted","Data":"4245eef53246cdbe6ddc5970f1ba7550905df578c69990e9e131d63b6544e1fa"} Jul 14 22:57:58.257581 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:58.257490 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-84br9" event={"ID":"1c8536f6-15f3-4d84-9b99-4f051233feac","Type":"ContainerStarted","Data":"502c5e139990fac324ec2941c27c3adbae49971f4ae742d07348531df97bfc0e"} Jul 14 22:57:58.257759 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:58.257743 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:57:58.274620 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:58.274563 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-84br9" podStartSLOduration=66.274525412 podStartE2EDuration="1m6.274525412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:57:58.274223588 +0000 UTC m=+66.890885283" watchObservedRunningTime="2026-07-14 22:57:58.274525412 +0000 UTC m=+66.891187106" Jul 14 22:57:58.926891 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:58.926817 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:59.012853 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.012821 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:59.101605 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.101569 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:59.104615 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.104587 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls\") pod \"image-registry-5dff44dd5f-rtvnn\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:59.109971 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.109875 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:59.202824 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.202740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:59.202824 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.202791 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:59.203056 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.202844 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:59.203056 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.203007 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7gcml\" (UID: \"6c75a176-d0e0-4cee-9d0c-5e977a433545\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:59.203645 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.203616 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbf0442c-13e6-4e76-909f-280c9bc111ed-service-ca-bundle\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:59.205777 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.205726 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c75a176-d0e0-4cee-9d0c-5e977a433545-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-7gcml\" (UID: \"6c75a176-d0e0-4cee-9d0c-5e977a433545\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:59.206399 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.206335 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13340f57-01a1-462f-b7c2-13985ec3ef72-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4znxt\" (UID: \"13340f57-01a1-462f-b7c2-13985ec3ef72\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:59.206399 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.206345 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbf0442c-13e6-4e76-909f-280c9bc111ed-metrics-certs\") pod \"router-default-6cbc88d98d-86h58\" (UID: \"dbf0442c-13e6-4e76-909f-280c9bc111ed\") " pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:59.209734 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.209709 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:59.304192 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.304147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:59.306875 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.306698 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cdd0825-5bd6-47e8-86c1-f008e96a9f8b-metrics-tls\") pod \"dns-default-tmglv\" (UID: \"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b\") " pod="openshift-dns/dns-default-tmglv" Jul 14 22:57:59.306875 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.306745 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gm9qp\"" Jul 14 22:57:59.310399 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.310360 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:59.314880 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.314845 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:57:59.318799 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.318776 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pvwlq\"" Jul 14 22:57:59.323375 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.323353 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ljkhq\"" Jul 14 22:57:59.326897 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.326746 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" Jul 14 22:57:59.331908 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.331878 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" Jul 14 22:57:59.339383 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.339341 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hxcx5\"" Jul 14 22:57:59.343442 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.343421 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:57:59.379756 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.379535 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:57:59.415169 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.415139 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdwsb\"" Jul 14 22:57:59.422773 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:57:59.422741 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tmglv" Jul 14 22:58:00.891588 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:00.891505 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml"] Jul 14 22:58:00.908929 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:00.908846 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dff44dd5f-rtvnn"] Jul 14 22:58:00.929227 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:00.928265 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6cbc88d98d-86h58"] Jul 14 22:58:00.948680 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:00.948610 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt"] Jul 14 22:58:01.152660 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:01.152630 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tmglv"] Jul 14 22:58:01.272378 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:01.272090 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nrqc5" event={"ID":"b494dbd0-9ebe-4937-a03b-a42e62f0d20f","Type":"ContainerStarted","Data":"a887911b33032e6a41c9785460eadd5c6965788029751822374689687a90975a"} Jul 14 22:58:01.273894 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:01.273862 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fgjds" event={"ID":"47316235-0c7a-4121-9099-3b86679137ba","Type":"ContainerStarted","Data":"7398a2f6623b9acdeb91702f35e3f446345fec86f82ab34c86426d36867ebe9a"} Jul 14 22:58:01.293004 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:01.292943 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nrqc5" podStartSLOduration=17.455710878 podStartE2EDuration="25.292920448s" totalImagesPullingTime="7.83720957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:57:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:01.291366442 +0000 UTC m=+69.908028137" watchObservedRunningTime="2026-07-14 22:58:01.292920448 +0000 UTC m=+69.909582143" Jul 14 22:58:02.347181 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:58:02.347146 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf0442c_13e6_4e76_909f_280c9bc111ed.slice/crio-d379565d51ebdb170092157d06af7ae68e47de0e27ae179508c7c7950269b3ab WatchSource:0}: Error finding container d379565d51ebdb170092157d06af7ae68e47de0e27ae179508c7c7950269b3ab: Status 404 returned error can't find the container with id d379565d51ebdb170092157d06af7ae68e47de0e27ae179508c7c7950269b3ab Jul 14 22:58:02.348138 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:58:02.347866 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13340f57_01a1_462f_b7c2_13985ec3ef72.slice/crio-32208fa4311e3916b90cd2c90d1abde42b56ee7de8c153bd9f8cd8437defeb44 WatchSource:0}: Error finding container 32208fa4311e3916b90cd2c90d1abde42b56ee7de8c153bd9f8cd8437defeb44: Status 404 returned error can't find the container with id 32208fa4311e3916b90cd2c90d1abde42b56ee7de8c153bd9f8cd8437defeb44 Jul 14 22:58:02.348946 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:58:02.348892 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c61efd_9ba4_4003_a455_8238eba3aec4.slice/crio-b9ffb12a07b91e45dc07098799125ff5995604208c57439040c29e24bcaed037 WatchSource:0}: Error finding container b9ffb12a07b91e45dc07098799125ff5995604208c57439040c29e24bcaed037: Status 404 returned error can't find the container with id b9ffb12a07b91e45dc07098799125ff5995604208c57439040c29e24bcaed037 Jul 14 22:58:02.349963 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:58:02.349811 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdd0825_5bd6_47e8_86c1_f008e96a9f8b.slice/crio-ec890ef2603f97c4d96af940ba1d3d554d9686419c32d73411e5f3647f0cdc34 WatchSource:0}: Error finding container ec890ef2603f97c4d96af940ba1d3d554d9686419c32d73411e5f3647f0cdc34: Status 404 returned error can't find the container with id ec890ef2603f97c4d96af940ba1d3d554d9686419c32d73411e5f3647f0cdc34 Jul 14 22:58:02.855035 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:02.854997 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:02.913563 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:02.912103 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:03.286843 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.286443 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6cbc88d98d-86h58" event={"ID":"dbf0442c-13e6-4e76-909f-280c9bc111ed","Type":"ContainerStarted","Data":"df4709dc7f3af8363c5adc785b7ca668fbc8acf9191eb1fef3f56f562d0234d3"} Jul 14 22:58:03.286843 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.286508 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6cbc88d98d-86h58" event={"ID":"dbf0442c-13e6-4e76-909f-280c9bc111ed","Type":"ContainerStarted","Data":"d379565d51ebdb170092157d06af7ae68e47de0e27ae179508c7c7950269b3ab"} Jul 14 22:58:03.288166 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.288138 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tmglv" event={"ID":"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b","Type":"ContainerStarted","Data":"ec890ef2603f97c4d96af940ba1d3d554d9686419c32d73411e5f3647f0cdc34"} Jul 14 22:58:03.289711 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.289646 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" event={"ID":"13340f57-01a1-462f-b7c2-13985ec3ef72","Type":"ContainerStarted","Data":"32208fa4311e3916b90cd2c90d1abde42b56ee7de8c153bd9f8cd8437defeb44"} Jul 14 22:58:03.292267 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.292138 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" event={"ID":"f2c61efd-9ba4-4003-a455-8238eba3aec4","Type":"ContainerStarted","Data":"c8126ee13440ce49438655abad55f5a305c9843121ac097a32abee47336d8279"} Jul 14 22:58:03.292267 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.292176 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" event={"ID":"f2c61efd-9ba4-4003-a455-8238eba3aec4","Type":"ContainerStarted","Data":"b9ffb12a07b91e45dc07098799125ff5995604208c57439040c29e24bcaed037"} Jul 14 22:58:03.292267 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.292237 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:58:03.294001 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.293950 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" event={"ID":"6c75a176-d0e0-4cee-9d0c-5e977a433545","Type":"ContainerStarted","Data":"2130671a7751bd387d3432f9bc2b0ddf80dd09465634cd1eab418bdd8c7cf854"} Jul 14 22:58:03.296226 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.296183 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pn6sh" event={"ID":"c1024b4d-03b0-4d83-928e-d04a0fe55861","Type":"ContainerStarted","Data":"2ea6070e54e1ad72b2771788fe2ae9ea34ccb4a41df44dabf0723a98b1f7d5de"} Jul 14 22:58:03.299018 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.298993 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fgjds" event={"ID":"47316235-0c7a-4121-9099-3b86679137ba","Type":"ContainerStarted","Data":"787ad8716de3d374731107765ce93abcc7c0321a51dd19d1d61a170987cf3445"} Jul 14 22:58:03.313411 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.312504 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6cbc88d98d-86h58" podStartSLOduration=62.312485092 podStartE2EDuration="1m2.312485092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:03.311632527 +0000 UTC m=+71.928294218" watchObservedRunningTime="2026-07-14 22:58:03.312485092 +0000 UTC m=+71.929146787" Jul 14 22:58:03.331851 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.331787 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fgjds" podStartSLOduration=68.443433509 podStartE2EDuration="1m11.331766351s" totalImagesPullingTime="2.888332842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:03.331127032 +0000 UTC m=+71.947788750" watchObservedRunningTime="2026-07-14 22:58:03.331766351 +0000 UTC m=+71.948428046" Jul 14 22:58:03.343832 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.343803 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:58:03.346466 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.346421 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:58:03.349391 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.349187 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pn6sh" podStartSLOduration=66.517641179 podStartE2EDuration="1m11.349169109s" totalImagesPullingTime="4.83152793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:03.348132696 +0000 UTC m=+71.964794391" watchObservedRunningTime="2026-07-14 22:58:03.349169109 +0000 UTC m=+71.965830802" Jul 14 22:58:03.438857 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.438785 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" podStartSLOduration=70.438769625 podStartE2EDuration="1m10.438769625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:03.374070331 +0000 UTC m=+71.990732041" watchObservedRunningTime="2026-07-14 22:58:03.438769625 +0000 UTC m=+72.055431319" Jul 14 22:58:03.519838 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.519795 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:03.588984 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.588884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:03.904440 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.904375 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:03.980653 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:03.980613 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:04.302460 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:04.302367 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:58:04.303441 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:04.303422 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6cbc88d98d-86h58" Jul 14 22:58:04.592591 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:04.592487 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:04.657984 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:04.657933 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:05.135516 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:05.135482 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:05.197475 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:05.197443 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:06.315862 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:06.315799 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tmglv" event={"ID":"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b","Type":"ContainerStarted","Data":"4e2c0ce2cb23f2256eb9f6446d833a3e4fac24cc3f12436200cd799f772888f8"} Jul 14 22:58:06.317923 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:06.317898 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" event={"ID":"13340f57-01a1-462f-b7c2-13985ec3ef72","Type":"ContainerStarted","Data":"2aec11506d4382e97f08f93454ba463381ed8268838eb3250b351bd3e6a20c31"} Jul 14 22:58:06.320007 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:06.319981 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" event={"ID":"6c75a176-d0e0-4cee-9d0c-5e977a433545","Type":"ContainerStarted","Data":"5e98e84a715796b267aba93c64496aaf983502b2afbe85bc82684e9efd6167ff"} Jul 14 22:58:06.335868 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:06.335816 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4znxt" podStartSLOduration=61.637845628 podStartE2EDuration="1m5.335796429s" totalImagesPullingTime="3.697950801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:06.334132911 +0000 UTC m=+74.950794606" watchObservedRunningTime="2026-07-14 22:58:06.335796429 +0000 UTC m=+74.952458116" Jul 14 22:58:06.505997 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:06.505955 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:06.594807 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:06.594757 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:06.659522 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:06.659482 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:06.759109 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:06.759014 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:06.970508 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:06.970473 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:07.325436 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:07.325405 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" event={"ID":"6c75a176-d0e0-4cee-9d0c-5e977a433545","Type":"ContainerStarted","Data":"66c9b9b733ff7499132d397932baa2e83282836742f48869a44953dec7c9f563"} Jul 14 22:58:07.327045 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:07.327016 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tmglv" event={"ID":"3cdd0825-5bd6-47e8-86c1-f008e96a9f8b","Type":"ContainerStarted","Data":"b14af7470da4fae83ce2b8a4488ea74e7858596a635be9bcc611d473b8378332"} Jul 14 22:58:07.342752 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:07.342711 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-7gcml" podStartSLOduration=62.715545671 podStartE2EDuration="1m6.342696836s" totalImagesPullingTime="3.627151165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:07.34177499 +0000 UTC m=+75.958436685" watchObservedRunningTime="2026-07-14 22:58:07.342696836 +0000 UTC m=+75.959358529" Jul 14 22:58:07.359158 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:07.359119 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tmglv" podStartSLOduration=36.666562261 podStartE2EDuration="40.359106692s" totalImagesPullingTime="3.692544431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:07.358228029 +0000 UTC m=+75.974889723" watchObservedRunningTime="2026-07-14 22:58:07.359106692 +0000 UTC m=+75.975768404" Jul 14 22:58:08.331073 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:08.331043 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tmglv" Jul 14 22:58:10.855604 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:10.855561 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:10.910458 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:10.910412 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:11.534506 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:11.534446 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:11.634086 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:11.634044 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:11.735606 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:11.735567 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:11.795707 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:11.795614 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:14.714931 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:14.714800 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:14.810847 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:14.810818 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:15.283173 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:15.283141 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:18.304656 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:18.304609 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:18.339248 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:18.339221 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tmglv" Jul 14 22:58:18.362692 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:18.362662 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:18.845807 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:18.845772 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:18.946253 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:18.946218 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:19.046781 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:19.046729 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:19.102927 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:19.102838 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:19.319110 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:19.319075 2572 patch_prober.go:28] interesting pod/image-registry-5dff44dd5f-rtvnn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 22:58:19.319457 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:19.319131 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" podUID="f2c61efd-9ba4-4003-a455-8238eba3aec4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 22:58:20.877439 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:20.877411 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:21.092908 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.092868 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:21.142664 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.142587 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tk6cc"] Jul 14 22:58:21.145512 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.145491 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.148664 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.148632 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 22:58:21.148664 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.148652 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 22:58:21.148839 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.148652 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 22:58:21.148839 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.148652 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ztnh6\"" Jul 14 22:58:21.149729 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.149715 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 22:58:21.167865 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.167835 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:21.168011 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.167988 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-root\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.168065 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.168020 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-tls\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.168065 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.168043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.168163 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.168065 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-metrics-client-ca\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.168163 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.168112 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-sys\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.168163 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.168128 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-textfile\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.168283 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.168178 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqbls\" (UniqueName: \"kubernetes.io/projected/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-kube-api-access-fqbls\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.168283 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.168215 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-wtmp\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.168283 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.168237 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.266925 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.266882 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:21.269467 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.269444 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-sys\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.269606 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.269471 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-textfile\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.269606 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.269491 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqbls\" (UniqueName: \"kubernetes.io/projected/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-kube-api-access-fqbls\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.269606 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.269515 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-wtmp\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.269606 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.269568 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-sys\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.269775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.269623 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.269775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.269686 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-root\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.269775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.269712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-tls\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.269775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.269724 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-wtmp\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.269775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.269740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.269775 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.269762 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-root\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.270047 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.269787 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-metrics-client-ca\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.270047 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.269823 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-textfile\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.270047 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:58:21.269846 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 14 22:58:21.270047 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:58:21.269905 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-tls podName:e16c04ff-0931-4a27-9fa8-a531c7cd03bf nodeName:}" failed. No retries permitted until 2026-07-14 22:58:21.769883647 +0000 UTC m=+90.386545334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-tls") pod "node-exporter-tk6cc" (UID: "e16c04ff-0931-4a27-9fa8-a531c7cd03bf") : secret "node-exporter-tls" not found Jul 14 22:58:21.270201 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.270150 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.270236 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.270214 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-metrics-client-ca\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.272053 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.272023 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.280456 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.280426 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqbls\" (UniqueName: \"kubernetes.io/projected/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-kube-api-access-fqbls\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.368369 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.368335 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:21.468234 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.468202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:21.694814 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.694780 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dff44dd5f-rtvnn"] Jul 14 22:58:21.698969 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.698936 2572 patch_prober.go:28] interesting pod/image-registry-5dff44dd5f-rtvnn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 22:58:21.699142 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.698986 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" podUID="f2c61efd-9ba4-4003-a455-8238eba3aec4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 22:58:21.728138 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.728054 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:21.773514 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.773478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-tls\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.775744 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.775715 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e16c04ff-0931-4a27-9fa8-a531c7cd03bf-node-exporter-tls\") pod \"node-exporter-tk6cc\" (UID: \"e16c04ff-0931-4a27-9fa8-a531c7cd03bf\") " pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:21.828957 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.828921 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:21.932597 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:21.932565 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:22.054408 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:22.054324 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tk6cc" Jul 14 22:58:22.067867 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:58:22.067822 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16c04ff_0931_4a27_9fa8_a531c7cd03bf.slice/crio-c8a577f1bf04275ec0cd36843fdaf5e74377da9ac909124b97208e15dffb9e3e WatchSource:0}: Error finding container c8a577f1bf04275ec0cd36843fdaf5e74377da9ac909124b97208e15dffb9e3e: Status 404 returned error can't find the container with id c8a577f1bf04275ec0cd36843fdaf5e74377da9ac909124b97208e15dffb9e3e Jul 14 22:58:22.098780 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:22.098736 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:22.199282 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:22.199238 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:22.310209 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:22.310113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:22.381986 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:22.381953 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tk6cc" event={"ID":"e16c04ff-0931-4a27-9fa8-a531c7cd03bf","Type":"ContainerStarted","Data":"c8a577f1bf04275ec0cd36843fdaf5e74377da9ac909124b97208e15dffb9e3e"} Jul 14 22:58:22.515128 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:22.515087 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:23.386862 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:23.386775 2572 generic.go:356] "Generic (PLEG): container finished" podID="e16c04ff-0931-4a27-9fa8-a531c7cd03bf" containerID="7543a47ca5b97aa894307eb443c912e3c418dca58fd40d3c05e9ca3097c368ce" exitCode=0 Jul 14 22:58:23.387217 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:23.386853 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tk6cc" event={"ID":"e16c04ff-0931-4a27-9fa8-a531c7cd03bf","Type":"ContainerDied","Data":"7543a47ca5b97aa894307eb443c912e3c418dca58fd40d3c05e9ca3097c368ce"} Jul 14 22:58:24.061061 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:24.061023 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:24.157379 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:24.157340 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:24.258979 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:24.258945 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:24.357325 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:24.357225 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:24.392085 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:24.392050 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tk6cc" event={"ID":"e16c04ff-0931-4a27-9fa8-a531c7cd03bf","Type":"ContainerStarted","Data":"9a873553a54b480ec14f96f702100e4fb3bd11e1c8d217b6d60d4bf9e92aff3c"} Jul 14 22:58:24.392456 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:24.392104 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tk6cc" event={"ID":"e16c04ff-0931-4a27-9fa8-a531c7cd03bf","Type":"ContainerStarted","Data":"e5eceaf928e02561c52edc0dd2bf2c90022aae423406e2aaa199ff6719e8f127"} Jul 14 22:58:24.413508 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:24.413457 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tk6cc" podStartSLOduration=2.402971368 podStartE2EDuration="3.413441412s" totalImagesPullingTime="944.186953ms" totalInitContainerRuntime="66.283091ms" isStatefulPod=true podCreationTimestamp="2026-07-14 22:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:58:24.412584929 +0000 UTC m=+93.029246623" watchObservedRunningTime="2026-07-14 22:58:24.413441412 +0000 UTC m=+93.030103106" Jul 14 22:58:25.110862 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:25.110826 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:25.215485 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:25.215449 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:25.904422 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:25.904392 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:25.968834 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:25.968800 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:26.170722 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:26.170632 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:26.716165 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:26.716127 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:26.826768 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:26.826731 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:27.367505 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:27.367464 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:27.526096 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:27.526056 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:27.630151 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:27.630051 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:27.709735 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:27.709690 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:29.264697 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:29.264668 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-84br9" Jul 14 22:58:29.575809 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:29.575710 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:29.641247 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:29.641206 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:31.699615 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:31.699589 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:58:34.171933 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:34.171893 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:34.273108 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:34.273071 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:34.752909 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:34.752867 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:34.853665 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:34.853626 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:34.953993 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:34.953956 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:36.600853 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:36.600817 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:36.671410 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:36.671363 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:37.994776 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:37.994745 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:38.095204 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:38.095172 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:38.166126 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:38.166089 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:38.619321 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:38.619290 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:38.691833 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:38.691799 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:41.453460 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:41.453422 2572 generic.go:356] "Generic (PLEG): container finished" podID="4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9" containerID="e1d792a5247f4a7db59eb2d2a0b88c9a5a4154336645747e9e553c268ce93403" exitCode=0 Jul 14 22:58:41.453875 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:41.453496 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" event={"ID":"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9","Type":"ContainerDied","Data":"e1d792a5247f4a7db59eb2d2a0b88c9a5a4154336645747e9e553c268ce93403"} Jul 14 22:58:41.453918 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:41.453881 2572 scope.go:117] "RemoveContainer" containerID="e1d792a5247f4a7db59eb2d2a0b88c9a5a4154336645747e9e553c268ce93403" Jul 14 22:58:41.734716 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:41.734613 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:41.794834 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:41.794794 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:42.459043 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:42.459010 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9dj2c" event={"ID":"4c0171bd-b6f8-4c20-a09e-c87bfc3b60f9","Type":"ContainerStarted","Data":"baff1e63b3544e9c570a0102bab44693b67a36bb6e42ec1b117072465ae3f12f"} Jul 14 22:58:46.577326 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:46.577288 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:46.714932 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:46.714875 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" podUID="f2c61efd-9ba4-4003-a455-8238eba3aec4" containerName="registry" containerID="cri-o://c8126ee13440ce49438655abad55f5a305c9843121ac097a32abee47336d8279" gracePeriod=30 Jul 14 22:58:46.949513 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:46.949490 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:58:47.067504 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.067465 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2c61efd-9ba4-4003-a455-8238eba3aec4-trusted-ca\") pod \"f2c61efd-9ba4-4003-a455-8238eba3aec4\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " Jul 14 22:58:47.067698 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.067532 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-certificates\") pod \"f2c61efd-9ba4-4003-a455-8238eba3aec4\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " Jul 14 22:58:47.067698 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.067591 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2c61efd-9ba4-4003-a455-8238eba3aec4-ca-trust-extracted\") pod \"f2c61efd-9ba4-4003-a455-8238eba3aec4\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " Jul 14 22:58:47.067698 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.067619 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f6c8\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-kube-api-access-4f6c8\") pod \"f2c61efd-9ba4-4003-a455-8238eba3aec4\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " Jul 14 22:58:47.067698 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.067674 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2c61efd-9ba4-4003-a455-8238eba3aec4-installation-pull-secrets\") pod \"f2c61efd-9ba4-4003-a455-8238eba3aec4\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " Jul 14 22:58:47.067914 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.067701 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2c61efd-9ba4-4003-a455-8238eba3aec4-image-registry-private-configuration\") pod \"f2c61efd-9ba4-4003-a455-8238eba3aec4\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " Jul 14 22:58:47.067914 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.067736 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-bound-sa-token\") pod \"f2c61efd-9ba4-4003-a455-8238eba3aec4\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " Jul 14 22:58:47.067914 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.067772 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls\") pod \"f2c61efd-9ba4-4003-a455-8238eba3aec4\" (UID: \"f2c61efd-9ba4-4003-a455-8238eba3aec4\") " Jul 14 22:58:47.068052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.067967 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f2c61efd-9ba4-4003-a455-8238eba3aec4" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 22:58:47.068052 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.067981 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2c61efd-9ba4-4003-a455-8238eba3aec4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f2c61efd-9ba4-4003-a455-8238eba3aec4" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 22:58:47.070199 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.070160 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2c61efd-9ba4-4003-a455-8238eba3aec4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f2c61efd-9ba4-4003-a455-8238eba3aec4" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 22:58:47.070576 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.070534 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f2c61efd-9ba4-4003-a455-8238eba3aec4" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:58:47.070679 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.070656 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-kube-api-access-4f6c8" (OuterVolumeSpecName: "kube-api-access-4f6c8") pod "f2c61efd-9ba4-4003-a455-8238eba3aec4" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4"). InnerVolumeSpecName "kube-api-access-4f6c8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:58:47.070679 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.070667 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2c61efd-9ba4-4003-a455-8238eba3aec4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f2c61efd-9ba4-4003-a455-8238eba3aec4" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 22:58:47.070754 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.070701 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f2c61efd-9ba4-4003-a455-8238eba3aec4" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:58:47.078424 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.078397 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c61efd-9ba4-4003-a455-8238eba3aec4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f2c61efd-9ba4-4003-a455-8238eba3aec4" (UID: "f2c61efd-9ba4-4003-a455-8238eba3aec4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:58:47.169283 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.169250 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-certificates\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 22:58:47.169283 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.169281 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2c61efd-9ba4-4003-a455-8238eba3aec4-ca-trust-extracted\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 22:58:47.169457 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.169291 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f6c8\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-kube-api-access-4f6c8\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 22:58:47.169457 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.169299 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2c61efd-9ba4-4003-a455-8238eba3aec4-installation-pull-secrets\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 22:58:47.169457 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.169308 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2c61efd-9ba4-4003-a455-8238eba3aec4-image-registry-private-configuration\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 22:58:47.169457 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.169318 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-bound-sa-token\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 22:58:47.169457 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.169328 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2c61efd-9ba4-4003-a455-8238eba3aec4-registry-tls\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 22:58:47.169457 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.169336 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2c61efd-9ba4-4003-a455-8238eba3aec4-trusted-ca\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 22:58:47.481634 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.481531 2572 generic.go:356] "Generic (PLEG): container finished" podID="f2c61efd-9ba4-4003-a455-8238eba3aec4" containerID="c8126ee13440ce49438655abad55f5a305c9843121ac097a32abee47336d8279" exitCode=0 Jul 14 22:58:47.481634 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.481573 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" event={"ID":"f2c61efd-9ba4-4003-a455-8238eba3aec4","Type":"ContainerDied","Data":"c8126ee13440ce49438655abad55f5a305c9843121ac097a32abee47336d8279"} Jul 14 22:58:47.481634 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.481599 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" Jul 14 22:58:47.481840 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.481637 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dff44dd5f-rtvnn" event={"ID":"f2c61efd-9ba4-4003-a455-8238eba3aec4","Type":"ContainerDied","Data":"b9ffb12a07b91e45dc07098799125ff5995604208c57439040c29e24bcaed037"} Jul 14 22:58:47.481840 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.481665 2572 scope.go:117] "RemoveContainer" containerID="c8126ee13440ce49438655abad55f5a305c9843121ac097a32abee47336d8279" Jul 14 22:58:47.490500 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.490482 2572 scope.go:117] "RemoveContainer" containerID="c8126ee13440ce49438655abad55f5a305c9843121ac097a32abee47336d8279" Jul 14 22:58:47.490778 ip-10-0-130-2 kubenswrapper[2572]: E0714 22:58:47.490760 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8126ee13440ce49438655abad55f5a305c9843121ac097a32abee47336d8279\": container with ID starting with c8126ee13440ce49438655abad55f5a305c9843121ac097a32abee47336d8279 not found: ID does not exist" containerID="c8126ee13440ce49438655abad55f5a305c9843121ac097a32abee47336d8279" Jul 14 22:58:47.490829 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.490788 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8126ee13440ce49438655abad55f5a305c9843121ac097a32abee47336d8279"} err="failed to get container status \"c8126ee13440ce49438655abad55f5a305c9843121ac097a32abee47336d8279\": rpc error: code = NotFound desc = could not find container \"c8126ee13440ce49438655abad55f5a305c9843121ac097a32abee47336d8279\": container with ID starting with c8126ee13440ce49438655abad55f5a305c9843121ac097a32abee47336d8279 not found: ID does not exist" Jul 14 22:58:47.504682 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.504652 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dff44dd5f-rtvnn"] Jul 14 22:58:47.509458 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.509426 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5dff44dd5f-rtvnn"] Jul 14 22:58:47.908466 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:47.908439 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2c61efd-9ba4-4003-a455-8238eba3aec4" path="/var/lib/kubelet/pods/f2c61efd-9ba4-4003-a455-8238eba3aec4/volumes" Jul 14 22:58:51.502656 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:51.502624 2572 generic.go:356] "Generic (PLEG): container finished" podID="6a59d30e-3ddf-48a7-9de3-387c2e92f951" containerID="9b984f1babd52e97e470e6641916a8dbc6c336085a973637f60ae181e606f430" exitCode=0 Jul 14 22:58:51.503050 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:51.502674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" event={"ID":"6a59d30e-3ddf-48a7-9de3-387c2e92f951","Type":"ContainerDied","Data":"9b984f1babd52e97e470e6641916a8dbc6c336085a973637f60ae181e606f430"} Jul 14 22:58:51.503050 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:51.502951 2572 scope.go:117] "RemoveContainer" containerID="9b984f1babd52e97e470e6641916a8dbc6c336085a973637f60ae181e606f430" Jul 14 22:58:52.508371 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:52.508326 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-w4djw" event={"ID":"6a59d30e-3ddf-48a7-9de3-387c2e92f951","Type":"ContainerStarted","Data":"b373f47a1b252c14065953194e7c33f2401c671f7c818b6676adb8b17b652010"} Jul 14 22:58:56.731373 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:56.731336 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:58:56.783102 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:58:56.783066 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:59:01.543924 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:01.541941 2572 generic.go:356] "Generic (PLEG): container finished" podID="df375676-ba25-481c-babc-5c81539e7726" containerID="a0028a814e4c8e19f6633b883fc19cdfafd9d847126f619e6dbdfe8d62c4b1a2" exitCode=0 Jul 14 22:59:01.543924 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:01.541989 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" event={"ID":"df375676-ba25-481c-babc-5c81539e7726","Type":"ContainerDied","Data":"a0028a814e4c8e19f6633b883fc19cdfafd9d847126f619e6dbdfe8d62c4b1a2"} Jul 14 22:59:01.543924 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:01.542828 2572 scope.go:117] "RemoveContainer" containerID="a0028a814e4c8e19f6633b883fc19cdfafd9d847126f619e6dbdfe8d62c4b1a2" Jul 14 22:59:02.547629 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:02.547594 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nhddc" event={"ID":"df375676-ba25-481c-babc-5c81539e7726","Type":"ContainerStarted","Data":"8c524bc23b30fae4c3ee469ccd9708b8bd7d3e28733a7501bab9665a73946bcb"} Jul 14 22:59:40.377379 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:40.377333 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:59:40.580077 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:40.580039 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:59:45.465090 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.464992 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-85d5f68f69-5pqw2"] Jul 14 22:59:45.466096 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.465474 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c61efd-9ba4-4003-a455-8238eba3aec4" containerName="registry" Jul 14 22:59:45.466096 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.465494 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c61efd-9ba4-4003-a455-8238eba3aec4" containerName="registry" Jul 14 22:59:45.466096 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.465597 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2c61efd-9ba4-4003-a455-8238eba3aec4" containerName="registry" Jul 14 22:59:45.468675 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.468659 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.471500 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.471473 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 14 22:59:45.471641 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.471576 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 14 22:59:45.471737 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.471661 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jxpgl\"" Jul 14 22:59:45.471737 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.471720 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 14 22:59:45.471737 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.471730 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 14 22:59:45.471906 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.471827 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 14 22:59:45.477678 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.477656 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 14 22:59:45.481095 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.481074 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85d5f68f69-5pqw2"] Jul 14 22:59:45.496836 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.496806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b462844b-a8b0-4bcf-9ade-0256400df826-secret-telemeter-client\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.496945 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.496845 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b462844b-a8b0-4bcf-9ade-0256400df826-federate-client-tls\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.496945 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.496867 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b462844b-a8b0-4bcf-9ade-0256400df826-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.497025 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.496944 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b462844b-a8b0-4bcf-9ade-0256400df826-telemeter-client-tls\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.497025 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.496970 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b462844b-a8b0-4bcf-9ade-0256400df826-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.497025 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.497002 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs985\" (UniqueName: \"kubernetes.io/projected/b462844b-a8b0-4bcf-9ade-0256400df826-kube-api-access-zs985\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.497118 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.497059 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b462844b-a8b0-4bcf-9ade-0256400df826-serving-certs-ca-bundle\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.497118 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.497088 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b462844b-a8b0-4bcf-9ade-0256400df826-metrics-client-ca\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.598340 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.598300 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs985\" (UniqueName: \"kubernetes.io/projected/b462844b-a8b0-4bcf-9ade-0256400df826-kube-api-access-zs985\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.598340 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.598352 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b462844b-a8b0-4bcf-9ade-0256400df826-serving-certs-ca-bundle\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.598635 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.598372 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b462844b-a8b0-4bcf-9ade-0256400df826-metrics-client-ca\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.598635 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.598393 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b462844b-a8b0-4bcf-9ade-0256400df826-secret-telemeter-client\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.598635 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.598422 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b462844b-a8b0-4bcf-9ade-0256400df826-federate-client-tls\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.598635 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.598439 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b462844b-a8b0-4bcf-9ade-0256400df826-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.598635 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.598465 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b462844b-a8b0-4bcf-9ade-0256400df826-telemeter-client-tls\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.598635 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.598480 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b462844b-a8b0-4bcf-9ade-0256400df826-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.599280 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.599251 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b462844b-a8b0-4bcf-9ade-0256400df826-serving-certs-ca-bundle\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.599457 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.599255 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b462844b-a8b0-4bcf-9ade-0256400df826-metrics-client-ca\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.599791 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.599763 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b462844b-a8b0-4bcf-9ade-0256400df826-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.601156 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.601129 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b462844b-a8b0-4bcf-9ade-0256400df826-secret-telemeter-client\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.601313 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.601293 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b462844b-a8b0-4bcf-9ade-0256400df826-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.601375 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.601339 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b462844b-a8b0-4bcf-9ade-0256400df826-telemeter-client-tls\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.601375 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.601364 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b462844b-a8b0-4bcf-9ade-0256400df826-federate-client-tls\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.607221 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.607201 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs985\" (UniqueName: \"kubernetes.io/projected/b462844b-a8b0-4bcf-9ade-0256400df826-kube-api-access-zs985\") pod \"telemeter-client-85d5f68f69-5pqw2\" (UID: \"b462844b-a8b0-4bcf-9ade-0256400df826\") " pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.778579 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.778466 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" Jul 14 22:59:45.917217 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:45.917188 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85d5f68f69-5pqw2"] Jul 14 22:59:45.918321 ip-10-0-130-2 kubenswrapper[2572]: W0714 22:59:45.918296 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb462844b_a8b0_4bcf_9ade_0256400df826.slice/crio-5d2eb887011fb4623533a033ea6f8b0161330018dcc12528b17c77f55c84ee3d WatchSource:0}: Error finding container 5d2eb887011fb4623533a033ea6f8b0161330018dcc12528b17c77f55c84ee3d: Status 404 returned error can't find the container with id 5d2eb887011fb4623533a033ea6f8b0161330018dcc12528b17c77f55c84ee3d Jul 14 22:59:46.712604 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:46.712515 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" event={"ID":"b462844b-a8b0-4bcf-9ade-0256400df826","Type":"ContainerStarted","Data":"5d2eb887011fb4623533a033ea6f8b0161330018dcc12528b17c77f55c84ee3d"} Jul 14 22:59:47.717469 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:47.717438 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" event={"ID":"b462844b-a8b0-4bcf-9ade-0256400df826","Type":"ContainerStarted","Data":"d63b99812e33a4602a5ca49978ea880cedff7c3240549b119b0225abaf470344"} Jul 14 22:59:49.726390 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:49.726349 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" event={"ID":"b462844b-a8b0-4bcf-9ade-0256400df826","Type":"ContainerStarted","Data":"ba3d655dfd3347f6f4e58731f91d7d37f94d923dd41ed712099cef9e023b808b"} Jul 14 22:59:49.726852 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:49.726411 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" event={"ID":"b462844b-a8b0-4bcf-9ade-0256400df826","Type":"ContainerStarted","Data":"2e1b0637d75cae01afdf60aa4427f591f8359da8a5d3c2f8a83834f2f735a5a7"} Jul 14 22:59:49.752457 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:49.752400 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-85d5f68f69-5pqw2" podStartSLOduration=2.054978074 podStartE2EDuration="4.752386s" totalImagesPullingTime="2.697407926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:59:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:59:49.751374709 +0000 UTC m=+178.368036404" watchObservedRunningTime="2026-07-14 22:59:49.752386 +0000 UTC m=+178.369047695" Jul 14 22:59:50.621147 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:50.621113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:59:50.721495 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:50.721457 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:59:55.651797 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:55.651763 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 22:59:55.713431 ip-10-0-130-2 kubenswrapper[2572]: I0714 22:59:55.713399 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:07.278148 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:07.278114 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:07.379467 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:07.379438 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:07.435899 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:07.435865 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:07.549440 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:07.549362 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:07.651801 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:07.651761 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:11.743525 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:11.743483 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:11.840909 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:11.840864 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:17.190994 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:17.190960 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:17.286702 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:17.286646 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:17.608157 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:17.608052 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:32.352586 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:32.352553 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:32.414305 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:32.414251 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:37.912621 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:37.912584 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:38.013216 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.013173 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:38.633659 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.633622 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96"] Jul 14 23:00:38.638157 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.638135 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" Jul 14 23:00:38.641082 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.641049 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 23:00:38.642354 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.642333 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 23:00:38.642354 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.642350 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6m7l\"" Jul 14 23:00:38.646681 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.646656 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96"] Jul 14 23:00:38.815153 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.815119 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/088562df-5c8a-4027-bd36-4170b84ea540-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96\" (UID: \"088562df-5c8a-4027-bd36-4170b84ea540\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" Jul 14 23:00:38.815315 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.815162 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/088562df-5c8a-4027-bd36-4170b84ea540-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96\" (UID: \"088562df-5c8a-4027-bd36-4170b84ea540\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" Jul 14 23:00:38.815315 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.815230 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnfpp\" (UniqueName: \"kubernetes.io/projected/088562df-5c8a-4027-bd36-4170b84ea540-kube-api-access-lnfpp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96\" (UID: \"088562df-5c8a-4027-bd36-4170b84ea540\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" Jul 14 23:00:38.916485 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.916453 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/088562df-5c8a-4027-bd36-4170b84ea540-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96\" (UID: \"088562df-5c8a-4027-bd36-4170b84ea540\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" Jul 14 23:00:38.916856 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.916495 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/088562df-5c8a-4027-bd36-4170b84ea540-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96\" (UID: \"088562df-5c8a-4027-bd36-4170b84ea540\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" Jul 14 23:00:38.916856 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.916532 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnfpp\" (UniqueName: \"kubernetes.io/projected/088562df-5c8a-4027-bd36-4170b84ea540-kube-api-access-lnfpp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96\" (UID: \"088562df-5c8a-4027-bd36-4170b84ea540\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" Jul 14 23:00:38.916856 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.916834 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/088562df-5c8a-4027-bd36-4170b84ea540-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96\" (UID: \"088562df-5c8a-4027-bd36-4170b84ea540\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" Jul 14 23:00:38.916979 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.916904 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/088562df-5c8a-4027-bd36-4170b84ea540-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96\" (UID: \"088562df-5c8a-4027-bd36-4170b84ea540\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" Jul 14 23:00:38.926753 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.926733 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnfpp\" (UniqueName: \"kubernetes.io/projected/088562df-5c8a-4027-bd36-4170b84ea540-kube-api-access-lnfpp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96\" (UID: \"088562df-5c8a-4027-bd36-4170b84ea540\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" Jul 14 23:00:38.947673 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:38.947649 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" Jul 14 23:00:39.072836 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:39.072803 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96"] Jul 14 23:00:39.075517 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:00:39.075488 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088562df_5c8a_4027_bd36_4170b84ea540.slice/crio-ec0d4a3ec7b94e574eb6fda5f51bd21e6f83a0ec0b913f23fabb5410ae13cafb WatchSource:0}: Error finding container ec0d4a3ec7b94e574eb6fda5f51bd21e6f83a0ec0b913f23fabb5410ae13cafb: Status 404 returned error can't find the container with id ec0d4a3ec7b94e574eb6fda5f51bd21e6f83a0ec0b913f23fabb5410ae13cafb Jul 14 23:00:39.916561 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:39.916501 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" event={"ID":"088562df-5c8a-4027-bd36-4170b84ea540","Type":"ContainerStarted","Data":"ec0d4a3ec7b94e574eb6fda5f51bd21e6f83a0ec0b913f23fabb5410ae13cafb"} Jul 14 23:00:44.932686 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:44.932647 2572 generic.go:356] "Generic (PLEG): container finished" podID="088562df-5c8a-4027-bd36-4170b84ea540" containerID="d40dc01296c78472e090df7ad53afa1f2451792e1532d950156266d41ac00c2e" exitCode=0 Jul 14 23:00:44.933072 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:44.932731 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" event={"ID":"088562df-5c8a-4027-bd36-4170b84ea540","Type":"ContainerDied","Data":"d40dc01296c78472e090df7ad53afa1f2451792e1532d950156266d41ac00c2e"} Jul 14 23:00:47.946383 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:47.946345 2572 generic.go:356] "Generic (PLEG): container finished" podID="088562df-5c8a-4027-bd36-4170b84ea540" containerID="d743b2101aba3c4ab417d51c9b18195da40e981cae7a2cfe952cfc674f7164d1" exitCode=0 Jul 14 23:00:47.946814 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:47.946399 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" event={"ID":"088562df-5c8a-4027-bd36-4170b84ea540","Type":"ContainerDied","Data":"d743b2101aba3c4ab417d51c9b18195da40e981cae7a2cfe952cfc674f7164d1"} Jul 14 23:00:55.980284 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:55.980242 2572 generic.go:356] "Generic (PLEG): container finished" podID="088562df-5c8a-4027-bd36-4170b84ea540" containerID="f04d336009f582bb04983aa3211f82c12baa2fe800f13af675411996acfea302" exitCode=0 Jul 14 23:00:55.980694 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:55.980294 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" event={"ID":"088562df-5c8a-4027-bd36-4170b84ea540","Type":"ContainerDied","Data":"f04d336009f582bb04983aa3211f82c12baa2fe800f13af675411996acfea302"} Jul 14 23:00:57.104452 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:57.104422 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" Jul 14 23:00:57.167999 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:57.167966 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/088562df-5c8a-4027-bd36-4170b84ea540-bundle\") pod \"088562df-5c8a-4027-bd36-4170b84ea540\" (UID: \"088562df-5c8a-4027-bd36-4170b84ea540\") " Jul 14 23:00:57.168184 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:57.168010 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/088562df-5c8a-4027-bd36-4170b84ea540-util\") pod \"088562df-5c8a-4027-bd36-4170b84ea540\" (UID: \"088562df-5c8a-4027-bd36-4170b84ea540\") " Jul 14 23:00:57.168184 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:57.168034 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnfpp\" (UniqueName: \"kubernetes.io/projected/088562df-5c8a-4027-bd36-4170b84ea540-kube-api-access-lnfpp\") pod \"088562df-5c8a-4027-bd36-4170b84ea540\" (UID: \"088562df-5c8a-4027-bd36-4170b84ea540\") " Jul 14 23:00:57.168701 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:57.168673 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/088562df-5c8a-4027-bd36-4170b84ea540-bundle" (OuterVolumeSpecName: "bundle") pod "088562df-5c8a-4027-bd36-4170b84ea540" (UID: "088562df-5c8a-4027-bd36-4170b84ea540"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:00:57.170250 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:57.170228 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/088562df-5c8a-4027-bd36-4170b84ea540-kube-api-access-lnfpp" (OuterVolumeSpecName: "kube-api-access-lnfpp") pod "088562df-5c8a-4027-bd36-4170b84ea540" (UID: "088562df-5c8a-4027-bd36-4170b84ea540"). InnerVolumeSpecName "kube-api-access-lnfpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:00:57.172895 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:57.172874 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/088562df-5c8a-4027-bd36-4170b84ea540-util" (OuterVolumeSpecName: "util") pod "088562df-5c8a-4027-bd36-4170b84ea540" (UID: "088562df-5c8a-4027-bd36-4170b84ea540"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:00:57.269477 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:57.269402 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/088562df-5c8a-4027-bd36-4170b84ea540-bundle\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:00:57.269477 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:57.269423 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/088562df-5c8a-4027-bd36-4170b84ea540-util\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:00:57.269477 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:57.269431 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnfpp\" (UniqueName: \"kubernetes.io/projected/088562df-5c8a-4027-bd36-4170b84ea540-kube-api-access-lnfpp\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:00:57.988878 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:57.988831 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" event={"ID":"088562df-5c8a-4027-bd36-4170b84ea540","Type":"ContainerDied","Data":"ec0d4a3ec7b94e574eb6fda5f51bd21e6f83a0ec0b913f23fabb5410ae13cafb"} Jul 14 23:00:57.989047 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:57.988897 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec0d4a3ec7b94e574eb6fda5f51bd21e6f83a0ec0b913f23fabb5410ae13cafb" Jul 14 23:00:57.989047 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:57.988855 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqv96" Jul 14 23:00:59.179323 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.179288 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl"] Jul 14 23:00:59.179720 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.179583 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="088562df-5c8a-4027-bd36-4170b84ea540" containerName="pull" Jul 14 23:00:59.179720 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.179597 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="088562df-5c8a-4027-bd36-4170b84ea540" containerName="pull" Jul 14 23:00:59.179720 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.179605 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="088562df-5c8a-4027-bd36-4170b84ea540" containerName="extract" Jul 14 23:00:59.179720 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.179610 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="088562df-5c8a-4027-bd36-4170b84ea540" containerName="extract" Jul 14 23:00:59.179720 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.179620 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="088562df-5c8a-4027-bd36-4170b84ea540" containerName="util" Jul 14 23:00:59.179720 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.179625 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="088562df-5c8a-4027-bd36-4170b84ea540" containerName="util" Jul 14 23:00:59.179720 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.179682 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="088562df-5c8a-4027-bd36-4170b84ea540" containerName="extract" Jul 14 23:00:59.182737 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.182717 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl" Jul 14 23:00:59.184408 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.184378 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:59.185783 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.185765 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 23:00:59.187445 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.187422 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2gf4g\"" Jul 14 23:00:59.187445 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.187442 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 23:00:59.187635 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.187496 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 23:00:59.187635 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.187508 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 14 23:00:59.193017 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.192996 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl"] Jul 14 23:00:59.284880 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.284847 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b6b55f56-aec2-4d14-b97b-8d7a055fa218-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86b84f7644-82xzl\" (UID: \"b6b55f56-aec2-4d14-b97b-8d7a055fa218\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl" Jul 14 23:00:59.285055 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.284898 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpx47\" (UniqueName: \"kubernetes.io/projected/b6b55f56-aec2-4d14-b97b-8d7a055fa218-kube-api-access-rpx47\") pod \"managed-serviceaccount-addon-agent-86b84f7644-82xzl\" (UID: \"b6b55f56-aec2-4d14-b97b-8d7a055fa218\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl" Jul 14 23:00:59.303914 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.303885 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:59.385765 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.385728 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpx47\" (UniqueName: \"kubernetes.io/projected/b6b55f56-aec2-4d14-b97b-8d7a055fa218-kube-api-access-rpx47\") pod \"managed-serviceaccount-addon-agent-86b84f7644-82xzl\" (UID: \"b6b55f56-aec2-4d14-b97b-8d7a055fa218\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl" Jul 14 23:00:59.385910 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.385808 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b6b55f56-aec2-4d14-b97b-8d7a055fa218-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86b84f7644-82xzl\" (UID: \"b6b55f56-aec2-4d14-b97b-8d7a055fa218\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl" Jul 14 23:00:59.388404 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.388365 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b6b55f56-aec2-4d14-b97b-8d7a055fa218-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86b84f7644-82xzl\" (UID: \"b6b55f56-aec2-4d14-b97b-8d7a055fa218\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl" Jul 14 23:00:59.400454 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.400427 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpx47\" (UniqueName: \"kubernetes.io/projected/b6b55f56-aec2-4d14-b97b-8d7a055fa218-kube-api-access-rpx47\") pod \"managed-serviceaccount-addon-agent-86b84f7644-82xzl\" (UID: \"b6b55f56-aec2-4d14-b97b-8d7a055fa218\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl" Jul 14 23:00:59.489732 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.489642 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b"] Jul 14 23:00:59.493150 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.493126 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.502502 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.502481 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl" Jul 14 23:00:59.502986 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.502954 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 14 23:00:59.503100 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.503014 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:59.503562 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.503527 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 14 23:00:59.523268 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.523245 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 14 23:00:59.523420 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.523404 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 14 23:00:59.570504 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.570459 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b"] Jul 14 23:00:59.588234 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.588196 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/387892b7-bf0d-4c87-843d-b92401bf4c85-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.588397 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.588262 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/387892b7-bf0d-4c87-843d-b92401bf4c85-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.588397 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.588299 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb745\" (UniqueName: \"kubernetes.io/projected/387892b7-bf0d-4c87-843d-b92401bf4c85-kube-api-access-vb745\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.588397 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.588336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/387892b7-bf0d-4c87-843d-b92401bf4c85-hub\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.588397 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.588395 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/387892b7-bf0d-4c87-843d-b92401bf4c85-additional-service-ca\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.588647 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.588433 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/387892b7-bf0d-4c87-843d-b92401bf4c85-ca\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.646566 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.646516 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl"] Jul 14 23:00:59.649634 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:00:59.649606 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6b55f56_aec2_4d14_b97b_8d7a055fa218.slice/crio-2a4baaaed2ae0fc0a76319dcf3f48886997e5abe6df6d8140c768c9a5e8b2b1f WatchSource:0}: Error finding container 2a4baaaed2ae0fc0a76319dcf3f48886997e5abe6df6d8140c768c9a5e8b2b1f: Status 404 returned error can't find the container with id 2a4baaaed2ae0fc0a76319dcf3f48886997e5abe6df6d8140c768c9a5e8b2b1f Jul 14 23:00:59.689626 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.689589 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/387892b7-bf0d-4c87-843d-b92401bf4c85-ca\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.689822 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.689650 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/387892b7-bf0d-4c87-843d-b92401bf4c85-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.689822 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.689677 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/387892b7-bf0d-4c87-843d-b92401bf4c85-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.689822 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.689698 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb745\" (UniqueName: \"kubernetes.io/projected/387892b7-bf0d-4c87-843d-b92401bf4c85-kube-api-access-vb745\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.689822 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.689722 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/387892b7-bf0d-4c87-843d-b92401bf4c85-hub\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.689822 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.689756 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/387892b7-bf0d-4c87-843d-b92401bf4c85-additional-service-ca\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.690592 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.690568 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/387892b7-bf0d-4c87-843d-b92401bf4c85-additional-service-ca\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.692296 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.692274 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/387892b7-bf0d-4c87-843d-b92401bf4c85-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.692413 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.692295 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/387892b7-bf0d-4c87-843d-b92401bf4c85-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.692515 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.692494 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/387892b7-bf0d-4c87-843d-b92401bf4c85-ca\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.692609 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.692593 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/387892b7-bf0d-4c87-843d-b92401bf4c85-hub\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.701621 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.701598 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb745\" (UniqueName: \"kubernetes.io/projected/387892b7-bf0d-4c87-843d-b92401bf4c85-kube-api-access-vb745\") pod \"cluster-proxy-proxy-agent-9c5595789-z285b\" (UID: \"387892b7-bf0d-4c87-843d-b92401bf4c85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.802590 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.802492 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" Jul 14 23:00:59.832893 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.832859 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:00:59.941507 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.941481 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b"] Jul 14 23:00:59.944073 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:00:59.944043 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod387892b7_bf0d_4c87_843d_b92401bf4c85.slice/crio-b368f4b1dd98fe5fe720fbe3fbf341a111c529a7e6b9490e667e8332d3a1200c WatchSource:0}: Error finding container b368f4b1dd98fe5fe720fbe3fbf341a111c529a7e6b9490e667e8332d3a1200c: Status 404 returned error can't find the container with id b368f4b1dd98fe5fe720fbe3fbf341a111c529a7e6b9490e667e8332d3a1200c Jul 14 23:00:59.997036 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.997005 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" event={"ID":"387892b7-bf0d-4c87-843d-b92401bf4c85","Type":"ContainerStarted","Data":"b368f4b1dd98fe5fe720fbe3fbf341a111c529a7e6b9490e667e8332d3a1200c"} Jul 14 23:00:59.998082 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:00:59.998058 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl" event={"ID":"b6b55f56-aec2-4d14-b97b-8d7a055fa218","Type":"ContainerStarted","Data":"2a4baaaed2ae0fc0a76319dcf3f48886997e5abe6df6d8140c768c9a5e8b2b1f"} Jul 14 23:01:00.839361 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:00.838785 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:03.661721 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:03.661667 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:03.762270 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:03.762219 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:05.021616 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:05.021567 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl" event={"ID":"b6b55f56-aec2-4d14-b97b-8d7a055fa218","Type":"ContainerStarted","Data":"399bd93ed208b36df7dbc07b2985b3d2418aff6db9482d6d632a62808405c65a"} Jul 14 23:01:05.023752 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:05.023724 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" event={"ID":"387892b7-bf0d-4c87-843d-b92401bf4c85","Type":"ContainerStarted","Data":"167dbad26aadd8442125fc9153dd4390ce93a4f047e0c3615394b7924c6d81a7"} Jul 14 23:01:05.023933 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:05.023763 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" event={"ID":"387892b7-bf0d-4c87-843d-b92401bf4c85","Type":"ContainerStarted","Data":"f25eef2bfaab509f50e87af70f86069a7213a00f5d07c7bea6bf1c02caad7843"} Jul 14 23:01:05.023933 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:05.023781 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" event={"ID":"387892b7-bf0d-4c87-843d-b92401bf4c85","Type":"ContainerStarted","Data":"bd0929b40d9bd996199d8bb09f8730be8e871cf05776cc6ba02d196939e5d310"} Jul 14 23:01:05.037293 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:05.037242 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b84f7644-82xzl" podStartSLOduration=1.1390329829999999 podStartE2EDuration="6.037225214s" totalImagesPullingTime="4.898192231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:01:05.036927877 +0000 UTC m=+253.653589571" watchObservedRunningTime="2026-07-14 23:01:05.037225214 +0000 UTC m=+253.653886908" Jul 14 23:01:05.055741 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:05.055691 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9c5595789-z285b" podStartSLOduration=1.437366269 podStartE2EDuration="6.055673967s" totalImagesPullingTime="4.618307698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:01:05.054616884 +0000 UTC m=+253.671278579" watchObservedRunningTime="2026-07-14 23:01:05.055673967 +0000 UTC m=+253.672335702" Jul 14 23:01:06.735527 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:06.735474 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:06.857750 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:06.857693 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:06.908743 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:06.908709 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5"] Jul 14 23:01:06.929456 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:06.929429 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5"] Jul 14 23:01:06.929620 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:06.929523 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" Jul 14 23:01:06.933160 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:06.933136 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 23:01:06.933308 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:06.933233 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6m7l\"" Jul 14 23:01:06.934555 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:06.934525 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 23:01:06.985634 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:06.985552 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:07.055405 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:07.055371 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e02938a-b81e-4b2b-b038-eb6577400512-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5\" (UID: \"7e02938a-b81e-4b2b-b038-eb6577400512\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" Jul 14 23:01:07.055405 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:07.055404 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwbdc\" (UniqueName: \"kubernetes.io/projected/7e02938a-b81e-4b2b-b038-eb6577400512-kube-api-access-zwbdc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5\" (UID: \"7e02938a-b81e-4b2b-b038-eb6577400512\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" Jul 14 23:01:07.055636 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:07.055468 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e02938a-b81e-4b2b-b038-eb6577400512-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5\" (UID: \"7e02938a-b81e-4b2b-b038-eb6577400512\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" Jul 14 23:01:07.156396 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:07.156361 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e02938a-b81e-4b2b-b038-eb6577400512-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5\" (UID: \"7e02938a-b81e-4b2b-b038-eb6577400512\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" Jul 14 23:01:07.156396 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:07.156396 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwbdc\" (UniqueName: \"kubernetes.io/projected/7e02938a-b81e-4b2b-b038-eb6577400512-kube-api-access-zwbdc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5\" (UID: \"7e02938a-b81e-4b2b-b038-eb6577400512\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" Jul 14 23:01:07.156622 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:07.156523 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e02938a-b81e-4b2b-b038-eb6577400512-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5\" (UID: \"7e02938a-b81e-4b2b-b038-eb6577400512\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" Jul 14 23:01:07.156771 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:07.156754 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e02938a-b81e-4b2b-b038-eb6577400512-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5\" (UID: \"7e02938a-b81e-4b2b-b038-eb6577400512\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" Jul 14 23:01:07.156875 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:07.156859 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e02938a-b81e-4b2b-b038-eb6577400512-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5\" (UID: \"7e02938a-b81e-4b2b-b038-eb6577400512\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" Jul 14 23:01:07.172950 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:07.172920 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwbdc\" (UniqueName: \"kubernetes.io/projected/7e02938a-b81e-4b2b-b038-eb6577400512-kube-api-access-zwbdc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5\" (UID: \"7e02938a-b81e-4b2b-b038-eb6577400512\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" Jul 14 23:01:07.240120 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:07.240033 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" Jul 14 23:01:07.392141 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:07.392117 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5"] Jul 14 23:01:07.393824 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:01:07.393792 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e02938a_b81e_4b2b_b038_eb6577400512.slice/crio-d7d9d066f9b7a21e9298a4dbbb15f7c834662db2549dc96d18764e8c2c0570b6 WatchSource:0}: Error finding container d7d9d066f9b7a21e9298a4dbbb15f7c834662db2549dc96d18764e8c2c0570b6: Status 404 returned error can't find the container with id d7d9d066f9b7a21e9298a4dbbb15f7c834662db2549dc96d18764e8c2c0570b6 Jul 14 23:01:08.036440 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:08.036401 2572 generic.go:356] "Generic (PLEG): container finished" podID="7e02938a-b81e-4b2b-b038-eb6577400512" containerID="469197631b69606fe81ba727a37ec8ad8ef1eb2872c1dffd662058c9efab2b4d" exitCode=0 Jul 14 23:01:08.036910 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:08.036492 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" event={"ID":"7e02938a-b81e-4b2b-b038-eb6577400512","Type":"ContainerDied","Data":"469197631b69606fe81ba727a37ec8ad8ef1eb2872c1dffd662058c9efab2b4d"} Jul 14 23:01:08.036910 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:08.036579 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" event={"ID":"7e02938a-b81e-4b2b-b038-eb6577400512","Type":"ContainerStarted","Data":"d7d9d066f9b7a21e9298a4dbbb15f7c834662db2549dc96d18764e8c2c0570b6"} Jul 14 23:01:09.325178 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:09.325138 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:09.533818 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:09.533781 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:10.243001 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:10.242924 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:10.304780 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:10.304744 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:11.050551 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:11.050520 2572 generic.go:356] "Generic (PLEG): container finished" podID="7e02938a-b81e-4b2b-b038-eb6577400512" containerID="7b2c10bb87950ce987016dd8182e05ca29edee69612d3151b67aa0bb156ab155" exitCode=0 Jul 14 23:01:11.050907 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:11.050594 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" event={"ID":"7e02938a-b81e-4b2b-b038-eb6577400512","Type":"ContainerDied","Data":"7b2c10bb87950ce987016dd8182e05ca29edee69612d3151b67aa0bb156ab155"} Jul 14 23:01:12.057138 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:12.057102 2572 generic.go:356] "Generic (PLEG): container finished" podID="7e02938a-b81e-4b2b-b038-eb6577400512" containerID="34515333494fcdb0a9bfcef5bc7d4636e9184ec1a04d758c805ba4830ffecceb" exitCode=0 Jul 14 23:01:12.057138 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:12.057141 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" event={"ID":"7e02938a-b81e-4b2b-b038-eb6577400512","Type":"ContainerDied","Data":"34515333494fcdb0a9bfcef5bc7d4636e9184ec1a04d758c805ba4830ffecceb"} Jul 14 23:01:13.185255 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:13.185228 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" Jul 14 23:01:13.310161 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:13.310119 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e02938a-b81e-4b2b-b038-eb6577400512-bundle\") pod \"7e02938a-b81e-4b2b-b038-eb6577400512\" (UID: \"7e02938a-b81e-4b2b-b038-eb6577400512\") " Jul 14 23:01:13.310364 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:13.310189 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwbdc\" (UniqueName: \"kubernetes.io/projected/7e02938a-b81e-4b2b-b038-eb6577400512-kube-api-access-zwbdc\") pod \"7e02938a-b81e-4b2b-b038-eb6577400512\" (UID: \"7e02938a-b81e-4b2b-b038-eb6577400512\") " Jul 14 23:01:13.310364 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:13.310222 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e02938a-b81e-4b2b-b038-eb6577400512-util\") pod \"7e02938a-b81e-4b2b-b038-eb6577400512\" (UID: \"7e02938a-b81e-4b2b-b038-eb6577400512\") " Jul 14 23:01:13.310608 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:13.310581 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e02938a-b81e-4b2b-b038-eb6577400512-bundle" (OuterVolumeSpecName: "bundle") pod "7e02938a-b81e-4b2b-b038-eb6577400512" (UID: "7e02938a-b81e-4b2b-b038-eb6577400512"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:01:13.312310 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:13.312261 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e02938a-b81e-4b2b-b038-eb6577400512-kube-api-access-zwbdc" (OuterVolumeSpecName: "kube-api-access-zwbdc") pod "7e02938a-b81e-4b2b-b038-eb6577400512" (UID: "7e02938a-b81e-4b2b-b038-eb6577400512"). InnerVolumeSpecName "kube-api-access-zwbdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:01:13.315233 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:13.315213 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e02938a-b81e-4b2b-b038-eb6577400512-util" (OuterVolumeSpecName: "util") pod "7e02938a-b81e-4b2b-b038-eb6577400512" (UID: "7e02938a-b81e-4b2b-b038-eb6577400512"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:01:13.411353 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:13.411318 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwbdc\" (UniqueName: \"kubernetes.io/projected/7e02938a-b81e-4b2b-b038-eb6577400512-kube-api-access-zwbdc\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:01:13.411353 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:13.411345 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e02938a-b81e-4b2b-b038-eb6577400512-util\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:01:13.411353 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:13.411355 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e02938a-b81e-4b2b-b038-eb6577400512-bundle\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:01:14.066242 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:14.066212 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" event={"ID":"7e02938a-b81e-4b2b-b038-eb6577400512","Type":"ContainerDied","Data":"d7d9d066f9b7a21e9298a4dbbb15f7c834662db2549dc96d18764e8c2c0570b6"} Jul 14 23:01:14.066471 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:14.066259 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7d9d066f9b7a21e9298a4dbbb15f7c834662db2549dc96d18764e8c2c0570b6" Jul 14 23:01:14.066471 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:14.066218 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frvfs5" Jul 14 23:01:16.898189 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:16.898157 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:18.749707 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:18.749674 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:18.839731 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:18.839688 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:19.226096 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:19.226063 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:19.333351 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:19.333316 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:24.204969 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:24.204937 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:24.302604 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:24.302564 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:26.147512 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.147476 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx"] Jul 14 23:01:26.147913 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.147816 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e02938a-b81e-4b2b-b038-eb6577400512" containerName="pull" Jul 14 23:01:26.147913 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.147830 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e02938a-b81e-4b2b-b038-eb6577400512" containerName="pull" Jul 14 23:01:26.147913 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.147837 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e02938a-b81e-4b2b-b038-eb6577400512" containerName="extract" Jul 14 23:01:26.147913 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.147844 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e02938a-b81e-4b2b-b038-eb6577400512" containerName="extract" Jul 14 23:01:26.147913 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.147859 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e02938a-b81e-4b2b-b038-eb6577400512" containerName="util" Jul 14 23:01:26.147913 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.147864 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e02938a-b81e-4b2b-b038-eb6577400512" containerName="util" Jul 14 23:01:26.147913 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.147909 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e02938a-b81e-4b2b-b038-eb6577400512" containerName="extract" Jul 14 23:01:26.149871 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.149852 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" Jul 14 23:01:26.152573 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.152525 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 23:01:26.153886 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.153848 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 23:01:26.154021 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.153855 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6m7l\"" Jul 14 23:01:26.159716 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.159691 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx"] Jul 14 23:01:26.318818 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.318781 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx\" (UID: \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" Jul 14 23:01:26.319012 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.318841 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx\" (UID: \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" Jul 14 23:01:26.319012 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.318894 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfv8p\" (UniqueName: \"kubernetes.io/projected/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-kube-api-access-mfv8p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx\" (UID: \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" Jul 14 23:01:26.419966 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.419932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx\" (UID: \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" Jul 14 23:01:26.420144 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.419994 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx\" (UID: \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" Jul 14 23:01:26.420144 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.420035 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfv8p\" (UniqueName: \"kubernetes.io/projected/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-kube-api-access-mfv8p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx\" (UID: \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" Jul 14 23:01:26.420401 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.420379 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx\" (UID: \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" Jul 14 23:01:26.420444 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.420388 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx\" (UID: \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" Jul 14 23:01:26.430064 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.430036 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:26.431994 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.431974 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfv8p\" (UniqueName: \"kubernetes.io/projected/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-kube-api-access-mfv8p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx\" (UID: \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" Jul 14 23:01:26.459870 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.459835 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" Jul 14 23:01:26.586675 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:26.586612 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx"] Jul 14 23:01:26.589113 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:01:26.589084 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36efac9e_fb8c_4bd7_9c85_bef7dcc2a45e.slice/crio-ea02e9cd2ad757dbb21a50aa227a756e1d63923618b0ceb3c99c672348f3caba WatchSource:0}: Error finding container ea02e9cd2ad757dbb21a50aa227a756e1d63923618b0ceb3c99c672348f3caba: Status 404 returned error can't find the container with id ea02e9cd2ad757dbb21a50aa227a756e1d63923618b0ceb3c99c672348f3caba Jul 14 23:01:27.118994 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:27.118911 2572 generic.go:356] "Generic (PLEG): container finished" podID="36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e" containerID="15b080d8c8554da7b600c17f69698177681189f7e72c49d11faf4b02898e0458" exitCode=0 Jul 14 23:01:27.119134 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:27.118991 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" event={"ID":"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e","Type":"ContainerDied","Data":"15b080d8c8554da7b600c17f69698177681189f7e72c49d11faf4b02898e0458"} Jul 14 23:01:27.119134 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:27.119037 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" event={"ID":"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e","Type":"ContainerStarted","Data":"ea02e9cd2ad757dbb21a50aa227a756e1d63923618b0ceb3c99c672348f3caba"} Jul 14 23:01:28.127088 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:28.126992 2572 generic.go:356] "Generic (PLEG): container finished" podID="36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e" containerID="a9c80ab082dbbb2b07b2579c977f4293083fd567d0f38c972aaf920ee3a673db" exitCode=0 Jul 14 23:01:28.127088 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:28.127074 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" event={"ID":"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e","Type":"ContainerDied","Data":"a9c80ab082dbbb2b07b2579c977f4293083fd567d0f38c972aaf920ee3a673db"} Jul 14 23:01:29.132566 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:29.132510 2572 generic.go:356] "Generic (PLEG): container finished" podID="36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e" containerID="f61eb2c5370ee1b6ec6f748512b5696d5cb153e391ad78e30c433d6877094874" exitCode=0 Jul 14 23:01:29.132927 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:29.132578 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" event={"ID":"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e","Type":"ContainerDied","Data":"f61eb2c5370ee1b6ec6f748512b5696d5cb153e391ad78e30c433d6877094874"} Jul 14 23:01:30.266896 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:30.266867 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" Jul 14 23:01:30.459996 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:30.459960 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfv8p\" (UniqueName: \"kubernetes.io/projected/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-kube-api-access-mfv8p\") pod \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\" (UID: \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\") " Jul 14 23:01:30.460144 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:30.460029 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-util\") pod \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\" (UID: \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\") " Jul 14 23:01:30.460144 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:30.460103 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-bundle\") pod \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\" (UID: \"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e\") " Jul 14 23:01:30.460848 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:30.460815 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-bundle" (OuterVolumeSpecName: "bundle") pod "36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e" (UID: "36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:01:30.462131 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:30.462101 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-kube-api-access-mfv8p" (OuterVolumeSpecName: "kube-api-access-mfv8p") pod "36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e" (UID: "36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e"). InnerVolumeSpecName "kube-api-access-mfv8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:01:30.466157 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:30.466045 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-util" (OuterVolumeSpecName: "util") pod "36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e" (UID: "36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:01:30.561131 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:30.561092 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-bundle\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:01:30.561131 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:30.561125 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfv8p\" (UniqueName: \"kubernetes.io/projected/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-kube-api-access-mfv8p\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:01:30.561131 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:30.561135 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e-util\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:01:31.142635 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:31.142606 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" Jul 14 23:01:31.142784 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:31.142605 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkn8fx" event={"ID":"36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e","Type":"ContainerDied","Data":"ea02e9cd2ad757dbb21a50aa227a756e1d63923618b0ceb3c99c672348f3caba"} Jul 14 23:01:31.142784 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:31.142725 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea02e9cd2ad757dbb21a50aa227a756e1d63923618b0ceb3c99c672348f3caba" Jul 14 23:01:43.095912 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:43.095868 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:43.194565 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:43.194502 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:43.869992 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:43.869951 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:44.128081 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.127996 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:44.232917 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.232883 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:44.284856 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.284822 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5"] Jul 14 23:01:44.285114 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.285102 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e" containerName="util" Jul 14 23:01:44.285160 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.285115 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e" containerName="util" Jul 14 23:01:44.285160 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.285125 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e" containerName="extract" Jul 14 23:01:44.285160 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.285131 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e" containerName="extract" Jul 14 23:01:44.285160 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.285145 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e" containerName="pull" Jul 14 23:01:44.285160 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.285150 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e" containerName="pull" Jul 14 23:01:44.285313 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.285200 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="36efac9e-fb8c-4bd7-9c85-bef7dcc2a45e" containerName="extract" Jul 14 23:01:44.287033 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.287017 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.289799 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.289773 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 23:01:44.289964 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.289943 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 23:01:44.290221 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.290206 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 23:01:44.290407 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.290392 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j4t6n\"" Jul 14 23:01:44.290483 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.290395 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 23:01:44.312462 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.312434 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5"] Jul 14 23:01:44.365177 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.365136 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7dedffb6-9829-425f-ad6f-1589dbc249e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.365177 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.365177 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dedffb6-9829-425f-ad6f-1589dbc249e6-tmp\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.365380 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.365198 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7dedffb6-9829-425f-ad6f-1589dbc249e6-manifests\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.365380 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.365265 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqwzx\" (UniqueName: \"kubernetes.io/projected/7dedffb6-9829-425f-ad6f-1589dbc249e6-kube-api-access-cqwzx\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.365380 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.365304 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dedffb6-9829-425f-ad6f-1589dbc249e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.430608 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.430572 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:44.466093 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.466061 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7dedffb6-9829-425f-ad6f-1589dbc249e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.466228 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.466098 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dedffb6-9829-425f-ad6f-1589dbc249e6-tmp\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.466228 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.466118 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7dedffb6-9829-425f-ad6f-1589dbc249e6-manifests\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.466228 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.466148 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqwzx\" (UniqueName: \"kubernetes.io/projected/7dedffb6-9829-425f-ad6f-1589dbc249e6-kube-api-access-cqwzx\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.466228 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.466181 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dedffb6-9829-425f-ad6f-1589dbc249e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.466495 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.466463 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7dedffb6-9829-425f-ad6f-1589dbc249e6-manifests\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.468492 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.468468 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dedffb6-9829-425f-ad6f-1589dbc249e6-tmp\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.468671 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.468650 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dedffb6-9829-425f-ad6f-1589dbc249e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.468718 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.468675 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7dedffb6-9829-425f-ad6f-1589dbc249e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.474781 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.474749 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqwzx\" (UniqueName: \"kubernetes.io/projected/7dedffb6-9829-425f-ad6f-1589dbc249e6-kube-api-access-cqwzx\") pod \"opendatahub-operator-controller-manager-7d756c8cff-x8rh5\" (UID: \"7dedffb6-9829-425f-ad6f-1589dbc249e6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.529898 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.529866 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:44.596855 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.596820 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:44.630454 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.630422 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:44.736817 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.736703 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:44.737394 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.737371 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5"] Jul 14 23:01:44.739319 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:01:44.739294 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dedffb6_9829_425f_ad6f_1589dbc249e6.slice/crio-1e2483db21963014ef7ae63048a44bbd3727eaa197e1d51a4972ce50d5593bd2 WatchSource:0}: Error finding container 1e2483db21963014ef7ae63048a44bbd3727eaa197e1d51a4972ce50d5593bd2: Status 404 returned error can't find the container with id 1e2483db21963014ef7ae63048a44bbd3727eaa197e1d51a4972ce50d5593bd2 Jul 14 23:01:44.870217 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.870181 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:44.970426 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:44.970389 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:45.199140 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:45.199105 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" event={"ID":"7dedffb6-9829-425f-ad6f-1589dbc249e6","Type":"ContainerStarted","Data":"1e2483db21963014ef7ae63048a44bbd3727eaa197e1d51a4972ce50d5593bd2"} Jul 14 23:01:48.215275 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:48.215239 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" event={"ID":"7dedffb6-9829-425f-ad6f-1589dbc249e6","Type":"ContainerStarted","Data":"4f4da7e5737f582040581c2a25bbadfe15f387535ef3b3bd432c69fc244a323b"} Jul 14 23:01:49.221768 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:49.221681 2572 generic.go:356] "Generic (PLEG): container finished" podID="7dedffb6-9829-425f-ad6f-1589dbc249e6" containerID="4f4da7e5737f582040581c2a25bbadfe15f387535ef3b3bd432c69fc244a323b" exitCode=0 Jul 14 23:01:49.222169 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:49.221766 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" event={"ID":"7dedffb6-9829-425f-ad6f-1589dbc249e6","Type":"ContainerDied","Data":"4f4da7e5737f582040581c2a25bbadfe15f387535ef3b3bd432c69fc244a323b"} Jul 14 23:01:50.038075 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:50.038039 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:50.131190 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:50.131156 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:50.228756 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:50.228720 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" event={"ID":"7dedffb6-9829-425f-ad6f-1589dbc249e6","Type":"ContainerStarted","Data":"a736e9cbdb7e30440865455f46392eae5ca51dc66b9fe63d6d9a7ea620e06708"} Jul 14 23:01:50.229221 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:50.228817 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:01:50.254550 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:50.254477 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" podStartSLOduration=1.8214654750000001 podStartE2EDuration="6.254456094s" totalImagesPullingTime="3.268951184s" totalInitContainerRuntime="1.164039435s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:01:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:01:50.252983605 +0000 UTC m=+298.869645314" watchObservedRunningTime="2026-07-14 23:01:50.254456094 +0000 UTC m=+298.871117789" Jul 14 23:01:51.812988 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:51.812961 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:01:51.814235 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:51.814214 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:01:51.818918 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:51.818888 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:01:51.819973 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:51.819954 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:01:51.827586 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:51.827566 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 23:01:55.920045 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:55.920004 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:01:58.119519 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:01:58.119482 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:01.235485 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:01.235442 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d756c8cff-x8rh5" Jul 14 23:02:03.672345 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:03.672306 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:04.261321 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:04.261284 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:04.704015 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:04.703980 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:04.805303 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:04.805266 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:04.907771 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:04.907732 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:05.028790 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:05.028700 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:05.226089 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:05.226044 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:05.460352 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:05.460312 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:05.795727 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:05.795628 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:05.910141 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:05.910113 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-946bb8597-twdrr"] Jul 14 23:02:05.915127 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:05.915104 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" Jul 14 23:02:05.918412 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:05.918392 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gt9kd\"" Jul 14 23:02:05.918537 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:05.918493 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 23:02:05.918537 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:05.918522 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 23:02:05.925821 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:05.925794 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-946bb8597-twdrr"] Jul 14 23:02:06.015972 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.015933 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:06.049018 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.048924 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b80f7a5f-cc91-4055-9d3e-f2e8f40c3414-tls-certs\") pod \"kube-auth-proxy-946bb8597-twdrr\" (UID: \"b80f7a5f-cc91-4055-9d3e-f2e8f40c3414\") " pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" Jul 14 23:02:06.049018 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.048971 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b80f7a5f-cc91-4055-9d3e-f2e8f40c3414-tmp\") pod \"kube-auth-proxy-946bb8597-twdrr\" (UID: \"b80f7a5f-cc91-4055-9d3e-f2e8f40c3414\") " pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" Jul 14 23:02:06.049018 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.048998 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvst6\" (UniqueName: \"kubernetes.io/projected/b80f7a5f-cc91-4055-9d3e-f2e8f40c3414-kube-api-access-lvst6\") pod \"kube-auth-proxy-946bb8597-twdrr\" (UID: \"b80f7a5f-cc91-4055-9d3e-f2e8f40c3414\") " pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" Jul 14 23:02:06.150479 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.150442 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b80f7a5f-cc91-4055-9d3e-f2e8f40c3414-tls-certs\") pod \"kube-auth-proxy-946bb8597-twdrr\" (UID: \"b80f7a5f-cc91-4055-9d3e-f2e8f40c3414\") " pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" Jul 14 23:02:06.150675 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.150488 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b80f7a5f-cc91-4055-9d3e-f2e8f40c3414-tmp\") pod \"kube-auth-proxy-946bb8597-twdrr\" (UID: \"b80f7a5f-cc91-4055-9d3e-f2e8f40c3414\") " pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" Jul 14 23:02:06.150675 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.150516 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvst6\" (UniqueName: \"kubernetes.io/projected/b80f7a5f-cc91-4055-9d3e-f2e8f40c3414-kube-api-access-lvst6\") pod \"kube-auth-proxy-946bb8597-twdrr\" (UID: \"b80f7a5f-cc91-4055-9d3e-f2e8f40c3414\") " pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" Jul 14 23:02:06.152870 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.152845 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b80f7a5f-cc91-4055-9d3e-f2e8f40c3414-tmp\") pod \"kube-auth-proxy-946bb8597-twdrr\" (UID: \"b80f7a5f-cc91-4055-9d3e-f2e8f40c3414\") " pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" Jul 14 23:02:06.153071 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.153050 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b80f7a5f-cc91-4055-9d3e-f2e8f40c3414-tls-certs\") pod \"kube-auth-proxy-946bb8597-twdrr\" (UID: \"b80f7a5f-cc91-4055-9d3e-f2e8f40c3414\") " pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" Jul 14 23:02:06.159441 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.159406 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvst6\" (UniqueName: \"kubernetes.io/projected/b80f7a5f-cc91-4055-9d3e-f2e8f40c3414-kube-api-access-lvst6\") pod \"kube-auth-proxy-946bb8597-twdrr\" (UID: \"b80f7a5f-cc91-4055-9d3e-f2e8f40c3414\") " pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" Jul 14 23:02:06.225058 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.225018 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" Jul 14 23:02:06.362221 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.362189 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-946bb8597-twdrr"] Jul 14 23:02:06.366397 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:02:06.366367 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80f7a5f_cc91_4055_9d3e_f2e8f40c3414.slice/crio-483f79467b732d8cfc5cbae446f1324ffcb3f33c47be522420191945bfce6703 WatchSource:0}: Error finding container 483f79467b732d8cfc5cbae446f1324ffcb3f33c47be522420191945bfce6703: Status 404 returned error can't find the container with id 483f79467b732d8cfc5cbae446f1324ffcb3f33c47be522420191945bfce6703 Jul 14 23:02:06.368799 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.368781 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 23:02:06.957934 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:06.957901 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:07.025908 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:07.025876 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:07.305579 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:07.305480 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" event={"ID":"b80f7a5f-cc91-4055-9d3e-f2e8f40c3414","Type":"ContainerStarted","Data":"483f79467b732d8cfc5cbae446f1324ffcb3f33c47be522420191945bfce6703"} Jul 14 23:02:08.064666 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:08.064616 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:10.319003 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:10.318967 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" event={"ID":"b80f7a5f-cc91-4055-9d3e-f2e8f40c3414","Type":"ContainerStarted","Data":"bec0d51acb3687abc8c2256d8c0963ef77ebb565a24df629e9a95cdd5b40571f"} Jul 14 23:02:10.352693 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:10.352614 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-946bb8597-twdrr" podStartSLOduration=2.419957712 podStartE2EDuration="5.352595118s" totalImagesPullingTime="2.932637406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:02:10.352468425 +0000 UTC m=+318.969130122" watchObservedRunningTime="2026-07-14 23:02:10.352595118 +0000 UTC m=+318.969256814" Jul 14 23:02:11.782336 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.782300 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr"] Jul 14 23:02:11.785551 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.785513 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:11.788876 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.788854 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 23:02:11.789009 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.788915 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nw8n9\"" Jul 14 23:02:11.789009 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.788928 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 23:02:11.789529 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.789505 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 23:02:11.789840 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.789630 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 23:02:11.803806 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.803783 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr"] Jul 14 23:02:11.902187 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.902134 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dce2752a-f053-4567-9f24-9f1431d550ac-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:11.902370 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.902216 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dce2752a-f053-4567-9f24-9f1431d550ac-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:11.902370 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.902258 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcvvk\" (UniqueName: \"kubernetes.io/projected/dce2752a-f053-4567-9f24-9f1431d550ac-kube-api-access-zcvvk\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:11.902370 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.902321 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dce2752a-f053-4567-9f24-9f1431d550ac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:11.902370 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.902357 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dce2752a-f053-4567-9f24-9f1431d550ac-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:11.902502 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.902380 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dce2752a-f053-4567-9f24-9f1431d550ac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:11.902502 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:11.902418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dce2752a-f053-4567-9f24-9f1431d550ac-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.002974 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.002886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dce2752a-f053-4567-9f24-9f1431d550ac-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.002974 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.002939 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dce2752a-f053-4567-9f24-9f1431d550ac-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.002974 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.002966 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcvvk\" (UniqueName: \"kubernetes.io/projected/dce2752a-f053-4567-9f24-9f1431d550ac-kube-api-access-zcvvk\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.003325 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.003001 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dce2752a-f053-4567-9f24-9f1431d550ac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.003325 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.003027 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dce2752a-f053-4567-9f24-9f1431d550ac-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.003325 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.003081 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dce2752a-f053-4567-9f24-9f1431d550ac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.003325 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.003123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dce2752a-f053-4567-9f24-9f1431d550ac-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.003751 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.003720 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dce2752a-f053-4567-9f24-9f1431d550ac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.005384 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.005353 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:12.005674 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.005652 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dce2752a-f053-4567-9f24-9f1431d550ac-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.005883 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.005862 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dce2752a-f053-4567-9f24-9f1431d550ac-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.006256 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.006239 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dce2752a-f053-4567-9f24-9f1431d550ac-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.006334 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.006281 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dce2752a-f053-4567-9f24-9f1431d550ac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.018109 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.018077 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dce2752a-f053-4567-9f24-9f1431d550ac-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.018223 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.018198 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcvvk\" (UniqueName: \"kubernetes.io/projected/dce2752a-f053-4567-9f24-9f1431d550ac-kube-api-access-zcvvk\") pod \"istiod-openshift-gateway-94bb8fbfd-cp9gr\" (UID: \"dce2752a-f053-4567-9f24-9f1431d550ac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.099594 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.099479 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:12.105728 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.105696 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:12.280030 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.279999 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr"] Jul 14 23:02:12.280995 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:02:12.280968 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce2752a_f053_4567_9f24_9f1431d550ac.slice/crio-2fefbb330657c0493084204da8111bfa9403e40dade4f054bce6f318230cdccf WatchSource:0}: Error finding container 2fefbb330657c0493084204da8111bfa9403e40dade4f054bce6f318230cdccf: Status 404 returned error can't find the container with id 2fefbb330657c0493084204da8111bfa9403e40dade4f054bce6f318230cdccf Jul 14 23:02:12.329048 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.329007 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" event={"ID":"dce2752a-f053-4567-9f24-9f1431d550ac","Type":"ContainerStarted","Data":"2fefbb330657c0493084204da8111bfa9403e40dade4f054bce6f318230cdccf"} Jul 14 23:02:12.964041 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:12.964007 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:13.356626 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:13.356525 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:13.565066 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:13.565027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:14.540025 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:14.539987 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 23:02:14.540301 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:14.540054 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 14 23:02:15.241731 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:15.241692 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:15.349486 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:15.349451 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" event={"ID":"dce2752a-f053-4567-9f24-9f1431d550ac","Type":"ContainerStarted","Data":"c8e31b59a8da286b76233be03689846e196bd507dbcf970fdeb33d99f2f245ca"} Jul 14 23:02:15.349702 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:15.349650 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:15.351202 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:15.351177 2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-cp9gr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 23:02:15.351318 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:15.351227 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" podUID="dce2752a-f053-4567-9f24-9f1431d550ac" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 23:02:15.387513 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:15.387481 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:15.506246 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:15.506153 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:15.981489 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:15.981457 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:16.359488 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:16.359416 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" Jul 14 23:02:16.386435 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:16.386388 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-cp9gr" podStartSLOduration=3.129592521 podStartE2EDuration="5.386374352s" totalImagesPullingTime="2.256781831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:02:15.398697178 +0000 UTC m=+324.015358873" watchObservedRunningTime="2026-07-14 23:02:16.386374352 +0000 UTC m=+325.003036046" Jul 14 23:02:16.576530 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:16.576489 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:16.661869 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:16.661828 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:16.802208 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:16.802161 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:22.158889 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:22.158853 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:22.216323 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:22.216290 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:40.084487 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:40.084441 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:02:40.182533 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:02:40.182490 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:05.088792 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.088688 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:05.188962 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.188922 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:05.218728 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.218694 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nwsnt"] Jul 14 23:03:05.227277 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.227246 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nwsnt" Jul 14 23:03:05.231047 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.231020 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-cf7b9\"" Jul 14 23:03:05.231290 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.231026 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 23:03:05.231409 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.231091 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 23:03:05.232058 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.232028 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nwsnt"] Jul 14 23:03:05.286020 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.285988 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:05.351646 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.351536 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5nh7\" (UniqueName: \"kubernetes.io/projected/def30d6f-8ab1-45c1-989e-9ac6e79c3ff9-kube-api-access-m5nh7\") pod \"kuadrant-operator-catalog-nwsnt\" (UID: \"def30d6f-8ab1-45c1-989e-9ac6e79c3ff9\") " pod="kuadrant-system/kuadrant-operator-catalog-nwsnt" Jul 14 23:03:05.452835 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.452795 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5nh7\" (UniqueName: \"kubernetes.io/projected/def30d6f-8ab1-45c1-989e-9ac6e79c3ff9-kube-api-access-m5nh7\") pod \"kuadrant-operator-catalog-nwsnt\" (UID: \"def30d6f-8ab1-45c1-989e-9ac6e79c3ff9\") " pod="kuadrant-system/kuadrant-operator-catalog-nwsnt" Jul 14 23:03:05.461795 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.461768 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5nh7\" (UniqueName: \"kubernetes.io/projected/def30d6f-8ab1-45c1-989e-9ac6e79c3ff9-kube-api-access-m5nh7\") pod \"kuadrant-operator-catalog-nwsnt\" (UID: \"def30d6f-8ab1-45c1-989e-9ac6e79c3ff9\") " pod="kuadrant-system/kuadrant-operator-catalog-nwsnt" Jul 14 23:03:05.538690 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.538652 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nwsnt" Jul 14 23:03:05.586957 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.586921 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nwsnt"] Jul 14 23:03:05.665945 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.665910 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nwsnt"] Jul 14 23:03:05.668209 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:03:05.668180 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef30d6f_8ab1_45c1_989e_9ac6e79c3ff9.slice/crio-266334ab7b53aa481c9856762c46412872937322bb219eb3df4d7c0a514004bb WatchSource:0}: Error finding container 266334ab7b53aa481c9856762c46412872937322bb219eb3df4d7c0a514004bb: Status 404 returned error can't find the container with id 266334ab7b53aa481c9856762c46412872937322bb219eb3df4d7c0a514004bb Jul 14 23:03:05.796997 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.796966 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t85k9"] Jul 14 23:03:05.801388 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.801371 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t85k9" Jul 14 23:03:05.809467 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.809444 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t85k9"] Jul 14 23:03:05.856747 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.856712 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk9lv\" (UniqueName: \"kubernetes.io/projected/9b0f5760-99e2-41aa-be61-64e43a1f1f04-kube-api-access-zk9lv\") pod \"kuadrant-operator-catalog-t85k9\" (UID: \"9b0f5760-99e2-41aa-be61-64e43a1f1f04\") " pod="kuadrant-system/kuadrant-operator-catalog-t85k9" Jul 14 23:03:05.957832 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.957795 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk9lv\" (UniqueName: \"kubernetes.io/projected/9b0f5760-99e2-41aa-be61-64e43a1f1f04-kube-api-access-zk9lv\") pod \"kuadrant-operator-catalog-t85k9\" (UID: \"9b0f5760-99e2-41aa-be61-64e43a1f1f04\") " pod="kuadrant-system/kuadrant-operator-catalog-t85k9" Jul 14 23:03:05.967158 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:05.967125 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk9lv\" (UniqueName: \"kubernetes.io/projected/9b0f5760-99e2-41aa-be61-64e43a1f1f04-kube-api-access-zk9lv\") pod \"kuadrant-operator-catalog-t85k9\" (UID: \"9b0f5760-99e2-41aa-be61-64e43a1f1f04\") " pod="kuadrant-system/kuadrant-operator-catalog-t85k9" Jul 14 23:03:06.111824 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:06.111781 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t85k9" Jul 14 23:03:06.239024 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:06.238998 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t85k9"] Jul 14 23:03:06.241482 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:03:06.241454 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b0f5760_99e2_41aa_be61_64e43a1f1f04.slice/crio-6b03761d91c128fc93599e76b88776d54d86e3f641cd892b8f97473226345916 WatchSource:0}: Error finding container 6b03761d91c128fc93599e76b88776d54d86e3f641cd892b8f97473226345916: Status 404 returned error can't find the container with id 6b03761d91c128fc93599e76b88776d54d86e3f641cd892b8f97473226345916 Jul 14 23:03:06.578721 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:06.578642 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nwsnt" event={"ID":"def30d6f-8ab1-45c1-989e-9ac6e79c3ff9","Type":"ContainerStarted","Data":"266334ab7b53aa481c9856762c46412872937322bb219eb3df4d7c0a514004bb"} Jul 14 23:03:06.579744 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:06.579714 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t85k9" event={"ID":"9b0f5760-99e2-41aa-be61-64e43a1f1f04","Type":"ContainerStarted","Data":"6b03761d91c128fc93599e76b88776d54d86e3f641cd892b8f97473226345916"} Jul 14 23:03:08.590673 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:08.590604 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nwsnt" event={"ID":"def30d6f-8ab1-45c1-989e-9ac6e79c3ff9","Type":"ContainerStarted","Data":"d9cb6ad8d6f82fde0e3ab16b529d07904c2bd5ef9691d218d0f504bd33a8dcdf"} Jul 14 23:03:08.591152 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:08.590676 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-nwsnt" podUID="def30d6f-8ab1-45c1-989e-9ac6e79c3ff9" containerName="registry-server" containerID="cri-o://d9cb6ad8d6f82fde0e3ab16b529d07904c2bd5ef9691d218d0f504bd33a8dcdf" gracePeriod=2 Jul 14 23:03:08.592254 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:08.592217 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t85k9" event={"ID":"9b0f5760-99e2-41aa-be61-64e43a1f1f04","Type":"ContainerStarted","Data":"01f6ae1ec6301548eb6aef3337660b8026ee9228fe5fbf2edb0ab0c7b6853969"} Jul 14 23:03:08.608021 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:08.607977 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nwsnt" podStartSLOduration=1.286532856 podStartE2EDuration="3.607961723s" totalImagesPullingTime="2.321428867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:03:08.606133273 +0000 UTC m=+377.222794969" watchObservedRunningTime="2026-07-14 23:03:08.607961723 +0000 UTC m=+377.224623416" Jul 14 23:03:08.622253 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:08.622211 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t85k9" podStartSLOduration=1.871063372 podStartE2EDuration="3.62219451s" totalImagesPullingTime="1.751131138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:03:08.621167559 +0000 UTC m=+377.237829255" watchObservedRunningTime="2026-07-14 23:03:08.62219451 +0000 UTC m=+377.238856205" Jul 14 23:03:08.837045 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:08.837016 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nwsnt" Jul 14 23:03:08.984856 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:08.984817 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5nh7\" (UniqueName: \"kubernetes.io/projected/def30d6f-8ab1-45c1-989e-9ac6e79c3ff9-kube-api-access-m5nh7\") pod \"def30d6f-8ab1-45c1-989e-9ac6e79c3ff9\" (UID: \"def30d6f-8ab1-45c1-989e-9ac6e79c3ff9\") " Jul 14 23:03:08.986989 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:08.986967 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def30d6f-8ab1-45c1-989e-9ac6e79c3ff9-kube-api-access-m5nh7" (OuterVolumeSpecName: "kube-api-access-m5nh7") pod "def30d6f-8ab1-45c1-989e-9ac6e79c3ff9" (UID: "def30d6f-8ab1-45c1-989e-9ac6e79c3ff9"). InnerVolumeSpecName "kube-api-access-m5nh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:03:09.085753 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:09.085725 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5nh7\" (UniqueName: \"kubernetes.io/projected/def30d6f-8ab1-45c1-989e-9ac6e79c3ff9-kube-api-access-m5nh7\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:03:09.599232 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:09.599194 2572 generic.go:356] "Generic (PLEG): container finished" podID="def30d6f-8ab1-45c1-989e-9ac6e79c3ff9" containerID="d9cb6ad8d6f82fde0e3ab16b529d07904c2bd5ef9691d218d0f504bd33a8dcdf" exitCode=0 Jul 14 23:03:09.599669 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:09.599241 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nwsnt" Jul 14 23:03:09.599669 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:09.599276 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nwsnt" event={"ID":"def30d6f-8ab1-45c1-989e-9ac6e79c3ff9","Type":"ContainerDied","Data":"d9cb6ad8d6f82fde0e3ab16b529d07904c2bd5ef9691d218d0f504bd33a8dcdf"} Jul 14 23:03:09.599669 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:09.599327 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nwsnt" event={"ID":"def30d6f-8ab1-45c1-989e-9ac6e79c3ff9","Type":"ContainerDied","Data":"266334ab7b53aa481c9856762c46412872937322bb219eb3df4d7c0a514004bb"} Jul 14 23:03:09.599669 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:09.599349 2572 scope.go:117] "RemoveContainer" containerID="d9cb6ad8d6f82fde0e3ab16b529d07904c2bd5ef9691d218d0f504bd33a8dcdf" Jul 14 23:03:09.609086 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:09.609067 2572 scope.go:117] "RemoveContainer" containerID="d9cb6ad8d6f82fde0e3ab16b529d07904c2bd5ef9691d218d0f504bd33a8dcdf" Jul 14 23:03:09.609326 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:03:09.609310 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9cb6ad8d6f82fde0e3ab16b529d07904c2bd5ef9691d218d0f504bd33a8dcdf\": container with ID starting with d9cb6ad8d6f82fde0e3ab16b529d07904c2bd5ef9691d218d0f504bd33a8dcdf not found: ID does not exist" containerID="d9cb6ad8d6f82fde0e3ab16b529d07904c2bd5ef9691d218d0f504bd33a8dcdf" Jul 14 23:03:09.609370 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:09.609334 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9cb6ad8d6f82fde0e3ab16b529d07904c2bd5ef9691d218d0f504bd33a8dcdf"} err="failed to get container status \"d9cb6ad8d6f82fde0e3ab16b529d07904c2bd5ef9691d218d0f504bd33a8dcdf\": rpc error: code = NotFound desc = could not find container \"d9cb6ad8d6f82fde0e3ab16b529d07904c2bd5ef9691d218d0f504bd33a8dcdf\": container with ID starting with d9cb6ad8d6f82fde0e3ab16b529d07904c2bd5ef9691d218d0f504bd33a8dcdf not found: ID does not exist" Jul 14 23:03:09.620772 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:09.620744 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nwsnt"] Jul 14 23:03:09.626295 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:09.626261 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nwsnt"] Jul 14 23:03:09.909075 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:09.909037 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="def30d6f-8ab1-45c1-989e-9ac6e79c3ff9" path="/var/lib/kubelet/pods/def30d6f-8ab1-45c1-989e-9ac6e79c3ff9/volumes" Jul 14 23:03:16.112249 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:16.112202 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-t85k9" Jul 14 23:03:16.112756 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:16.112277 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-t85k9" Jul 14 23:03:16.135044 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:16.135017 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-t85k9" Jul 14 23:03:16.655104 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:16.655077 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-t85k9" Jul 14 23:03:20.409652 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.409619 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j"] Jul 14 23:03:20.410025 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.409918 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def30d6f-8ab1-45c1-989e-9ac6e79c3ff9" containerName="registry-server" Jul 14 23:03:20.410025 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.409929 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="def30d6f-8ab1-45c1-989e-9ac6e79c3ff9" containerName="registry-server" Jul 14 23:03:20.410025 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.409983 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="def30d6f-8ab1-45c1-989e-9ac6e79c3ff9" containerName="registry-server" Jul 14 23:03:20.412961 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.412944 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" Jul 14 23:03:20.415680 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.415666 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c524q\"" Jul 14 23:03:20.422049 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.422026 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j"] Jul 14 23:03:20.581946 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.581907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee9ae486-e927-4435-ac41-c21d4d123b45-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j\" (UID: \"ee9ae486-e927-4435-ac41-c21d4d123b45\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" Jul 14 23:03:20.582127 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.581979 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kszfn\" (UniqueName: \"kubernetes.io/projected/ee9ae486-e927-4435-ac41-c21d4d123b45-kube-api-access-kszfn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j\" (UID: \"ee9ae486-e927-4435-ac41-c21d4d123b45\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" Jul 14 23:03:20.582127 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.582031 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee9ae486-e927-4435-ac41-c21d4d123b45-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j\" (UID: \"ee9ae486-e927-4435-ac41-c21d4d123b45\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" Jul 14 23:03:20.683174 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.683090 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee9ae486-e927-4435-ac41-c21d4d123b45-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j\" (UID: \"ee9ae486-e927-4435-ac41-c21d4d123b45\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" Jul 14 23:03:20.683174 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.683134 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee9ae486-e927-4435-ac41-c21d4d123b45-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j\" (UID: \"ee9ae486-e927-4435-ac41-c21d4d123b45\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" Jul 14 23:03:20.683359 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.683182 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kszfn\" (UniqueName: \"kubernetes.io/projected/ee9ae486-e927-4435-ac41-c21d4d123b45-kube-api-access-kszfn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j\" (UID: \"ee9ae486-e927-4435-ac41-c21d4d123b45\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" Jul 14 23:03:20.683461 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.683440 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee9ae486-e927-4435-ac41-c21d4d123b45-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j\" (UID: \"ee9ae486-e927-4435-ac41-c21d4d123b45\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" Jul 14 23:03:20.683563 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.683524 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee9ae486-e927-4435-ac41-c21d4d123b45-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j\" (UID: \"ee9ae486-e927-4435-ac41-c21d4d123b45\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" Jul 14 23:03:20.692140 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.692117 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kszfn\" (UniqueName: \"kubernetes.io/projected/ee9ae486-e927-4435-ac41-c21d4d123b45-kube-api-access-kszfn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j\" (UID: \"ee9ae486-e927-4435-ac41-c21d4d123b45\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" Jul 14 23:03:20.722089 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.722060 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" Jul 14 23:03:20.852470 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:20.852444 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j"] Jul 14 23:03:20.854174 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:03:20.854144 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9ae486_e927_4435_ac41_c21d4d123b45.slice/crio-172bb8d5e764d4121f2dc9894ece308550992dfa614df363254c7c5653ac6c4c WatchSource:0}: Error finding container 172bb8d5e764d4121f2dc9894ece308550992dfa614df363254c7c5653ac6c4c: Status 404 returned error can't find the container with id 172bb8d5e764d4121f2dc9894ece308550992dfa614df363254c7c5653ac6c4c Jul 14 23:03:21.204836 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.204755 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh"] Jul 14 23:03:21.208207 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.208185 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" Jul 14 23:03:21.216686 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.216661 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh"] Jul 14 23:03:21.389798 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.389746 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35de32f5-9a09-4f96-95e6-424431085613-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh\" (UID: \"35de32f5-9a09-4f96-95e6-424431085613\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" Jul 14 23:03:21.389798 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.389800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35de32f5-9a09-4f96-95e6-424431085613-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh\" (UID: \"35de32f5-9a09-4f96-95e6-424431085613\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" Jul 14 23:03:21.390023 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.389856 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7svh\" (UniqueName: \"kubernetes.io/projected/35de32f5-9a09-4f96-95e6-424431085613-kube-api-access-v7svh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh\" (UID: \"35de32f5-9a09-4f96-95e6-424431085613\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" Jul 14 23:03:21.491219 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.491121 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35de32f5-9a09-4f96-95e6-424431085613-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh\" (UID: \"35de32f5-9a09-4f96-95e6-424431085613\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" Jul 14 23:03:21.491219 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.491165 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35de32f5-9a09-4f96-95e6-424431085613-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh\" (UID: \"35de32f5-9a09-4f96-95e6-424431085613\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" Jul 14 23:03:21.491709 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.491282 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7svh\" (UniqueName: \"kubernetes.io/projected/35de32f5-9a09-4f96-95e6-424431085613-kube-api-access-v7svh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh\" (UID: \"35de32f5-9a09-4f96-95e6-424431085613\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" Jul 14 23:03:21.491709 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.491566 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35de32f5-9a09-4f96-95e6-424431085613-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh\" (UID: \"35de32f5-9a09-4f96-95e6-424431085613\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" Jul 14 23:03:21.491709 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.491578 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35de32f5-9a09-4f96-95e6-424431085613-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh\" (UID: \"35de32f5-9a09-4f96-95e6-424431085613\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" Jul 14 23:03:21.502970 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.502947 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7svh\" (UniqueName: \"kubernetes.io/projected/35de32f5-9a09-4f96-95e6-424431085613-kube-api-access-v7svh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh\" (UID: \"35de32f5-9a09-4f96-95e6-424431085613\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" Jul 14 23:03:21.518879 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.518851 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" Jul 14 23:03:21.618008 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.617976 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd"] Jul 14 23:03:21.631006 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.630927 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" Jul 14 23:03:21.632860 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.632758 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd"] Jul 14 23:03:21.653909 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.653886 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh"] Jul 14 23:03:21.656888 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:03:21.656860 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35de32f5_9a09_4f96_95e6_424431085613.slice/crio-88b6f0cb6f8219b95716a23e706b41ae95b0b0375be0cd38fe364cab98849199 WatchSource:0}: Error finding container 88b6f0cb6f8219b95716a23e706b41ae95b0b0375be0cd38fe364cab98849199: Status 404 returned error can't find the container with id 88b6f0cb6f8219b95716a23e706b41ae95b0b0375be0cd38fe364cab98849199 Jul 14 23:03:21.657990 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.657964 2572 generic.go:356] "Generic (PLEG): container finished" podID="ee9ae486-e927-4435-ac41-c21d4d123b45" containerID="857d75684cb9511baf128b46ad4b49d653d218e1352bbdac557c3610f1b522aa" exitCode=0 Jul 14 23:03:21.658117 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.658019 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" event={"ID":"ee9ae486-e927-4435-ac41-c21d4d123b45","Type":"ContainerDied","Data":"857d75684cb9511baf128b46ad4b49d653d218e1352bbdac557c3610f1b522aa"} Jul 14 23:03:21.658117 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.658054 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" event={"ID":"ee9ae486-e927-4435-ac41-c21d4d123b45","Type":"ContainerStarted","Data":"172bb8d5e764d4121f2dc9894ece308550992dfa614df363254c7c5653ac6c4c"} Jul 14 23:03:21.793419 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.793391 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w69hk\" (UniqueName: \"kubernetes.io/projected/71a2cc6e-239a-42e9-94a0-a6644273f00a-kube-api-access-w69hk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd\" (UID: \"71a2cc6e-239a-42e9-94a0-a6644273f00a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" Jul 14 23:03:21.793531 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.793439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71a2cc6e-239a-42e9-94a0-a6644273f00a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd\" (UID: \"71a2cc6e-239a-42e9-94a0-a6644273f00a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" Jul 14 23:03:21.793531 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.793478 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71a2cc6e-239a-42e9-94a0-a6644273f00a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd\" (UID: \"71a2cc6e-239a-42e9-94a0-a6644273f00a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" Jul 14 23:03:21.894707 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.894660 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w69hk\" (UniqueName: \"kubernetes.io/projected/71a2cc6e-239a-42e9-94a0-a6644273f00a-kube-api-access-w69hk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd\" (UID: \"71a2cc6e-239a-42e9-94a0-a6644273f00a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" Jul 14 23:03:21.894944 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.894731 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71a2cc6e-239a-42e9-94a0-a6644273f00a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd\" (UID: \"71a2cc6e-239a-42e9-94a0-a6644273f00a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" Jul 14 23:03:21.894944 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.894785 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71a2cc6e-239a-42e9-94a0-a6644273f00a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd\" (UID: \"71a2cc6e-239a-42e9-94a0-a6644273f00a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" Jul 14 23:03:21.895140 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.895108 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71a2cc6e-239a-42e9-94a0-a6644273f00a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd\" (UID: \"71a2cc6e-239a-42e9-94a0-a6644273f00a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" Jul 14 23:03:21.895204 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.895152 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71a2cc6e-239a-42e9-94a0-a6644273f00a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd\" (UID: \"71a2cc6e-239a-42e9-94a0-a6644273f00a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" Jul 14 23:03:21.904742 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.904719 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w69hk\" (UniqueName: \"kubernetes.io/projected/71a2cc6e-239a-42e9-94a0-a6644273f00a-kube-api-access-w69hk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd\" (UID: \"71a2cc6e-239a-42e9-94a0-a6644273f00a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" Jul 14 23:03:21.942261 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:21.942231 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" Jul 14 23:03:22.009291 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.009261 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj"] Jul 14 23:03:22.013926 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.013902 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" Jul 14 23:03:22.023663 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.023640 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj"] Jul 14 23:03:22.093953 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.093931 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd"] Jul 14 23:03:22.095798 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:03:22.095773 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a2cc6e_239a_42e9_94a0_a6644273f00a.slice/crio-ca07d9948f8cf8e0f60ff4e2b6a9657bb9f4fa4e466f416b334e9e8c5bc86781 WatchSource:0}: Error finding container ca07d9948f8cf8e0f60ff4e2b6a9657bb9f4fa4e466f416b334e9e8c5bc86781: Status 404 returned error can't find the container with id ca07d9948f8cf8e0f60ff4e2b6a9657bb9f4fa4e466f416b334e9e8c5bc86781 Jul 14 23:03:22.196273 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.196242 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f297ed68-a5f5-4ccf-9056-f4a621073217-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj\" (UID: \"f297ed68-a5f5-4ccf-9056-f4a621073217\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" Jul 14 23:03:22.196411 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.196388 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f297ed68-a5f5-4ccf-9056-f4a621073217-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj\" (UID: \"f297ed68-a5f5-4ccf-9056-f4a621073217\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" Jul 14 23:03:22.196465 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.196427 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56xf6\" (UniqueName: \"kubernetes.io/projected/f297ed68-a5f5-4ccf-9056-f4a621073217-kube-api-access-56xf6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj\" (UID: \"f297ed68-a5f5-4ccf-9056-f4a621073217\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" Jul 14 23:03:22.297677 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.297594 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f297ed68-a5f5-4ccf-9056-f4a621073217-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj\" (UID: \"f297ed68-a5f5-4ccf-9056-f4a621073217\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" Jul 14 23:03:22.297677 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.297636 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56xf6\" (UniqueName: \"kubernetes.io/projected/f297ed68-a5f5-4ccf-9056-f4a621073217-kube-api-access-56xf6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj\" (UID: \"f297ed68-a5f5-4ccf-9056-f4a621073217\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" Jul 14 23:03:22.297902 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.297745 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f297ed68-a5f5-4ccf-9056-f4a621073217-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj\" (UID: \"f297ed68-a5f5-4ccf-9056-f4a621073217\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" Jul 14 23:03:22.298054 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.298031 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f297ed68-a5f5-4ccf-9056-f4a621073217-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj\" (UID: \"f297ed68-a5f5-4ccf-9056-f4a621073217\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" Jul 14 23:03:22.298102 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.298057 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f297ed68-a5f5-4ccf-9056-f4a621073217-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj\" (UID: \"f297ed68-a5f5-4ccf-9056-f4a621073217\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" Jul 14 23:03:22.308129 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.308102 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56xf6\" (UniqueName: \"kubernetes.io/projected/f297ed68-a5f5-4ccf-9056-f4a621073217-kube-api-access-56xf6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj\" (UID: \"f297ed68-a5f5-4ccf-9056-f4a621073217\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" Jul 14 23:03:22.324750 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.324722 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" Jul 14 23:03:22.552923 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.552897 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj"] Jul 14 23:03:22.555007 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:03:22.554977 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf297ed68_a5f5_4ccf_9056_f4a621073217.slice/crio-a3790d6f1aef22daa681c7a1b00601d88d5ff829de0314ff2dc3ddc18182c5f2 WatchSource:0}: Error finding container a3790d6f1aef22daa681c7a1b00601d88d5ff829de0314ff2dc3ddc18182c5f2: Status 404 returned error can't find the container with id a3790d6f1aef22daa681c7a1b00601d88d5ff829de0314ff2dc3ddc18182c5f2 Jul 14 23:03:22.666184 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.666145 2572 generic.go:356] "Generic (PLEG): container finished" podID="ee9ae486-e927-4435-ac41-c21d4d123b45" containerID="bfe0c0aa7edb4b200b71800696eaafdd79b0adce0cbf9e043f1599e6c7c4efc6" exitCode=0 Jul 14 23:03:22.666349 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.666295 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" event={"ID":"ee9ae486-e927-4435-ac41-c21d4d123b45","Type":"ContainerDied","Data":"bfe0c0aa7edb4b200b71800696eaafdd79b0adce0cbf9e043f1599e6c7c4efc6"} Jul 14 23:03:22.668139 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.668116 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" event={"ID":"f297ed68-a5f5-4ccf-9056-f4a621073217","Type":"ContainerStarted","Data":"a6637e21d8c38fc8dad7039d0a99102501869882da28452d5da8529b7025beda"} Jul 14 23:03:22.668211 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.668179 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" event={"ID":"f297ed68-a5f5-4ccf-9056-f4a621073217","Type":"ContainerStarted","Data":"a3790d6f1aef22daa681c7a1b00601d88d5ff829de0314ff2dc3ddc18182c5f2"} Jul 14 23:03:22.669832 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.669809 2572 generic.go:356] "Generic (PLEG): container finished" podID="71a2cc6e-239a-42e9-94a0-a6644273f00a" containerID="887966783c3875330d25234338ebc43db0351a5fe3a1c9a65ac8be70cbc03059" exitCode=0 Jul 14 23:03:22.669947 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.669884 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" event={"ID":"71a2cc6e-239a-42e9-94a0-a6644273f00a","Type":"ContainerDied","Data":"887966783c3875330d25234338ebc43db0351a5fe3a1c9a65ac8be70cbc03059"} Jul 14 23:03:22.669947 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.669929 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" event={"ID":"71a2cc6e-239a-42e9-94a0-a6644273f00a","Type":"ContainerStarted","Data":"ca07d9948f8cf8e0f60ff4e2b6a9657bb9f4fa4e466f416b334e9e8c5bc86781"} Jul 14 23:03:22.671601 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.671578 2572 generic.go:356] "Generic (PLEG): container finished" podID="35de32f5-9a09-4f96-95e6-424431085613" containerID="8b53668d2e8b29e65efc1161edf0825bfba58462154c742aac5e4c72aeaa8d38" exitCode=0 Jul 14 23:03:22.671715 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.671664 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" event={"ID":"35de32f5-9a09-4f96-95e6-424431085613","Type":"ContainerDied","Data":"8b53668d2e8b29e65efc1161edf0825bfba58462154c742aac5e4c72aeaa8d38"} Jul 14 23:03:22.671715 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:22.671707 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" event={"ID":"35de32f5-9a09-4f96-95e6-424431085613","Type":"ContainerStarted","Data":"88b6f0cb6f8219b95716a23e706b41ae95b0b0375be0cd38fe364cab98849199"} Jul 14 23:03:23.679194 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:23.679159 2572 generic.go:356] "Generic (PLEG): container finished" podID="ee9ae486-e927-4435-ac41-c21d4d123b45" containerID="fbb848f9172555d65ab1bf0446463d4da51ec748ad51c3114f084941f797ed79" exitCode=0 Jul 14 23:03:23.679616 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:23.679232 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" event={"ID":"ee9ae486-e927-4435-ac41-c21d4d123b45","Type":"ContainerDied","Data":"fbb848f9172555d65ab1bf0446463d4da51ec748ad51c3114f084941f797ed79"} Jul 14 23:03:23.680817 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:23.680791 2572 generic.go:356] "Generic (PLEG): container finished" podID="f297ed68-a5f5-4ccf-9056-f4a621073217" containerID="a6637e21d8c38fc8dad7039d0a99102501869882da28452d5da8529b7025beda" exitCode=0 Jul 14 23:03:23.680909 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:23.680867 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" event={"ID":"f297ed68-a5f5-4ccf-9056-f4a621073217","Type":"ContainerDied","Data":"a6637e21d8c38fc8dad7039d0a99102501869882da28452d5da8529b7025beda"} Jul 14 23:03:23.682672 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:23.682647 2572 generic.go:356] "Generic (PLEG): container finished" podID="71a2cc6e-239a-42e9-94a0-a6644273f00a" containerID="7e40707d78a36905537053b77ec95cdc716b655e67a9fe121f9586bde69ad308" exitCode=0 Jul 14 23:03:23.682786 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:23.682724 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" event={"ID":"71a2cc6e-239a-42e9-94a0-a6644273f00a","Type":"ContainerDied","Data":"7e40707d78a36905537053b77ec95cdc716b655e67a9fe121f9586bde69ad308"} Jul 14 23:03:23.684677 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:23.684657 2572 generic.go:356] "Generic (PLEG): container finished" podID="35de32f5-9a09-4f96-95e6-424431085613" containerID="a07b8a6f1dc5aca103c80f34e793ee3c84e3b0f897ddf779d75f9be1a1297bdd" exitCode=0 Jul 14 23:03:23.684758 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:23.684685 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" event={"ID":"35de32f5-9a09-4f96-95e6-424431085613","Type":"ContainerDied","Data":"a07b8a6f1dc5aca103c80f34e793ee3c84e3b0f897ddf779d75f9be1a1297bdd"} Jul 14 23:03:24.691464 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:24.691427 2572 generic.go:356] "Generic (PLEG): container finished" podID="f297ed68-a5f5-4ccf-9056-f4a621073217" containerID="d865b2beb3a47d1b127eb07a5db03e4ba92a9ad99df43b86963a7925c04e00df" exitCode=0 Jul 14 23:03:24.691926 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:24.691515 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" event={"ID":"f297ed68-a5f5-4ccf-9056-f4a621073217","Type":"ContainerDied","Data":"d865b2beb3a47d1b127eb07a5db03e4ba92a9ad99df43b86963a7925c04e00df"} Jul 14 23:03:24.693745 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:24.693724 2572 generic.go:356] "Generic (PLEG): container finished" podID="71a2cc6e-239a-42e9-94a0-a6644273f00a" containerID="ecd2e294e9437d1a81c40c3fabf483260961bfa1876c49fc7c12d3d5ed3e7910" exitCode=0 Jul 14 23:03:24.693845 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:24.693800 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" event={"ID":"71a2cc6e-239a-42e9-94a0-a6644273f00a","Type":"ContainerDied","Data":"ecd2e294e9437d1a81c40c3fabf483260961bfa1876c49fc7c12d3d5ed3e7910"} Jul 14 23:03:24.695759 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:24.695730 2572 generic.go:356] "Generic (PLEG): container finished" podID="35de32f5-9a09-4f96-95e6-424431085613" containerID="c22196cc47df223821481465178b08da32a9c4e84e038cd3d8a7f3820fcc9977" exitCode=0 Jul 14 23:03:24.695893 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:24.695773 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" event={"ID":"35de32f5-9a09-4f96-95e6-424431085613","Type":"ContainerDied","Data":"c22196cc47df223821481465178b08da32a9c4e84e038cd3d8a7f3820fcc9977"} Jul 14 23:03:24.908673 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:24.908648 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" Jul 14 23:03:25.022948 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.022856 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee9ae486-e927-4435-ac41-c21d4d123b45-bundle\") pod \"ee9ae486-e927-4435-ac41-c21d4d123b45\" (UID: \"ee9ae486-e927-4435-ac41-c21d4d123b45\") " Jul 14 23:03:25.022948 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.022916 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kszfn\" (UniqueName: \"kubernetes.io/projected/ee9ae486-e927-4435-ac41-c21d4d123b45-kube-api-access-kszfn\") pod \"ee9ae486-e927-4435-ac41-c21d4d123b45\" (UID: \"ee9ae486-e927-4435-ac41-c21d4d123b45\") " Jul 14 23:03:25.023158 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.022958 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee9ae486-e927-4435-ac41-c21d4d123b45-util\") pod \"ee9ae486-e927-4435-ac41-c21d4d123b45\" (UID: \"ee9ae486-e927-4435-ac41-c21d4d123b45\") " Jul 14 23:03:25.023513 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.023472 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9ae486-e927-4435-ac41-c21d4d123b45-bundle" (OuterVolumeSpecName: "bundle") pod "ee9ae486-e927-4435-ac41-c21d4d123b45" (UID: "ee9ae486-e927-4435-ac41-c21d4d123b45"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:03:25.024991 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.024970 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee9ae486-e927-4435-ac41-c21d4d123b45-kube-api-access-kszfn" (OuterVolumeSpecName: "kube-api-access-kszfn") pod "ee9ae486-e927-4435-ac41-c21d4d123b45" (UID: "ee9ae486-e927-4435-ac41-c21d4d123b45"). InnerVolumeSpecName "kube-api-access-kszfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:03:25.028703 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.028681 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee9ae486-e927-4435-ac41-c21d4d123b45-util" (OuterVolumeSpecName: "util") pod "ee9ae486-e927-4435-ac41-c21d4d123b45" (UID: "ee9ae486-e927-4435-ac41-c21d4d123b45"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:03:25.123883 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.123827 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee9ae486-e927-4435-ac41-c21d4d123b45-bundle\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:03:25.123883 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.123875 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kszfn\" (UniqueName: \"kubernetes.io/projected/ee9ae486-e927-4435-ac41-c21d4d123b45-kube-api-access-kszfn\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:03:25.123883 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.123889 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee9ae486-e927-4435-ac41-c21d4d123b45-util\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:03:25.703032 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.703005 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" Jul 14 23:03:25.703390 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.703032 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j" event={"ID":"ee9ae486-e927-4435-ac41-c21d4d123b45","Type":"ContainerDied","Data":"172bb8d5e764d4121f2dc9894ece308550992dfa614df363254c7c5653ac6c4c"} Jul 14 23:03:25.703390 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.703083 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="172bb8d5e764d4121f2dc9894ece308550992dfa614df363254c7c5653ac6c4c" Jul 14 23:03:25.705183 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.705159 2572 generic.go:356] "Generic (PLEG): container finished" podID="f297ed68-a5f5-4ccf-9056-f4a621073217" containerID="ef035fccd1d20a49836fe9510ced4b70d21b30053dc4f1662ec0678cbe002444" exitCode=0 Jul 14 23:03:25.705276 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.705238 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" event={"ID":"f297ed68-a5f5-4ccf-9056-f4a621073217","Type":"ContainerDied","Data":"ef035fccd1d20a49836fe9510ced4b70d21b30053dc4f1662ec0678cbe002444"} Jul 14 23:03:25.860388 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.860369 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" Jul 14 23:03:25.862876 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:25.862856 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" Jul 14 23:03:26.031274 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.031203 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w69hk\" (UniqueName: \"kubernetes.io/projected/71a2cc6e-239a-42e9-94a0-a6644273f00a-kube-api-access-w69hk\") pod \"71a2cc6e-239a-42e9-94a0-a6644273f00a\" (UID: \"71a2cc6e-239a-42e9-94a0-a6644273f00a\") " Jul 14 23:03:26.031274 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.031255 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35de32f5-9a09-4f96-95e6-424431085613-bundle\") pod \"35de32f5-9a09-4f96-95e6-424431085613\" (UID: \"35de32f5-9a09-4f96-95e6-424431085613\") " Jul 14 23:03:26.031446 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.031278 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35de32f5-9a09-4f96-95e6-424431085613-util\") pod \"35de32f5-9a09-4f96-95e6-424431085613\" (UID: \"35de32f5-9a09-4f96-95e6-424431085613\") " Jul 14 23:03:26.031446 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.031355 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71a2cc6e-239a-42e9-94a0-a6644273f00a-bundle\") pod \"71a2cc6e-239a-42e9-94a0-a6644273f00a\" (UID: \"71a2cc6e-239a-42e9-94a0-a6644273f00a\") " Jul 14 23:03:26.031446 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.031384 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71a2cc6e-239a-42e9-94a0-a6644273f00a-util\") pod \"71a2cc6e-239a-42e9-94a0-a6644273f00a\" (UID: \"71a2cc6e-239a-42e9-94a0-a6644273f00a\") " Jul 14 23:03:26.031446 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.031426 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7svh\" (UniqueName: \"kubernetes.io/projected/35de32f5-9a09-4f96-95e6-424431085613-kube-api-access-v7svh\") pod \"35de32f5-9a09-4f96-95e6-424431085613\" (UID: \"35de32f5-9a09-4f96-95e6-424431085613\") " Jul 14 23:03:26.032030 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.031960 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a2cc6e-239a-42e9-94a0-a6644273f00a-bundle" (OuterVolumeSpecName: "bundle") pod "71a2cc6e-239a-42e9-94a0-a6644273f00a" (UID: "71a2cc6e-239a-42e9-94a0-a6644273f00a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:03:26.032199 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.032067 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35de32f5-9a09-4f96-95e6-424431085613-bundle" (OuterVolumeSpecName: "bundle") pod "35de32f5-9a09-4f96-95e6-424431085613" (UID: "35de32f5-9a09-4f96-95e6-424431085613"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:03:26.033592 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.033520 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35de32f5-9a09-4f96-95e6-424431085613-kube-api-access-v7svh" (OuterVolumeSpecName: "kube-api-access-v7svh") pod "35de32f5-9a09-4f96-95e6-424431085613" (UID: "35de32f5-9a09-4f96-95e6-424431085613"). InnerVolumeSpecName "kube-api-access-v7svh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:03:26.033721 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.033600 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a2cc6e-239a-42e9-94a0-a6644273f00a-kube-api-access-w69hk" (OuterVolumeSpecName: "kube-api-access-w69hk") pod "71a2cc6e-239a-42e9-94a0-a6644273f00a" (UID: "71a2cc6e-239a-42e9-94a0-a6644273f00a"). InnerVolumeSpecName "kube-api-access-w69hk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:03:26.037413 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.037390 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a2cc6e-239a-42e9-94a0-a6644273f00a-util" (OuterVolumeSpecName: "util") pod "71a2cc6e-239a-42e9-94a0-a6644273f00a" (UID: "71a2cc6e-239a-42e9-94a0-a6644273f00a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:03:26.040101 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.040078 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35de32f5-9a09-4f96-95e6-424431085613-util" (OuterVolumeSpecName: "util") pod "35de32f5-9a09-4f96-95e6-424431085613" (UID: "35de32f5-9a09-4f96-95e6-424431085613"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:03:26.132964 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.132917 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71a2cc6e-239a-42e9-94a0-a6644273f00a-bundle\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:03:26.133190 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.133175 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71a2cc6e-239a-42e9-94a0-a6644273f00a-util\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:03:26.133277 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.133266 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7svh\" (UniqueName: \"kubernetes.io/projected/35de32f5-9a09-4f96-95e6-424431085613-kube-api-access-v7svh\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:03:26.133353 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.133340 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w69hk\" (UniqueName: \"kubernetes.io/projected/71a2cc6e-239a-42e9-94a0-a6644273f00a-kube-api-access-w69hk\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:03:26.133452 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.133426 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35de32f5-9a09-4f96-95e6-424431085613-bundle\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:03:26.133529 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.133520 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35de32f5-9a09-4f96-95e6-424431085613-util\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:03:26.711795 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.711757 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" event={"ID":"71a2cc6e-239a-42e9-94a0-a6644273f00a","Type":"ContainerDied","Data":"ca07d9948f8cf8e0f60ff4e2b6a9657bb9f4fa4e466f416b334e9e8c5bc86781"} Jul 14 23:03:26.712243 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.711774 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd" Jul 14 23:03:26.712243 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.711851 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca07d9948f8cf8e0f60ff4e2b6a9657bb9f4fa4e466f416b334e9e8c5bc86781" Jul 14 23:03:26.713790 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.713766 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" Jul 14 23:03:26.713929 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.713784 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh" event={"ID":"35de32f5-9a09-4f96-95e6-424431085613","Type":"ContainerDied","Data":"88b6f0cb6f8219b95716a23e706b41ae95b0b0375be0cd38fe364cab98849199"} Jul 14 23:03:26.713929 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.713833 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88b6f0cb6f8219b95716a23e706b41ae95b0b0375be0cd38fe364cab98849199" Jul 14 23:03:26.847920 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:26.847894 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" Jul 14 23:03:27.041188 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:27.041101 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56xf6\" (UniqueName: \"kubernetes.io/projected/f297ed68-a5f5-4ccf-9056-f4a621073217-kube-api-access-56xf6\") pod \"f297ed68-a5f5-4ccf-9056-f4a621073217\" (UID: \"f297ed68-a5f5-4ccf-9056-f4a621073217\") " Jul 14 23:03:27.041188 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:27.041160 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f297ed68-a5f5-4ccf-9056-f4a621073217-util\") pod \"f297ed68-a5f5-4ccf-9056-f4a621073217\" (UID: \"f297ed68-a5f5-4ccf-9056-f4a621073217\") " Jul 14 23:03:27.041188 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:27.041189 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f297ed68-a5f5-4ccf-9056-f4a621073217-bundle\") pod \"f297ed68-a5f5-4ccf-9056-f4a621073217\" (UID: \"f297ed68-a5f5-4ccf-9056-f4a621073217\") " Jul 14 23:03:27.041735 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:27.041702 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f297ed68-a5f5-4ccf-9056-f4a621073217-bundle" (OuterVolumeSpecName: "bundle") pod "f297ed68-a5f5-4ccf-9056-f4a621073217" (UID: "f297ed68-a5f5-4ccf-9056-f4a621073217"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:03:27.043209 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:27.043183 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f297ed68-a5f5-4ccf-9056-f4a621073217-kube-api-access-56xf6" (OuterVolumeSpecName: "kube-api-access-56xf6") pod "f297ed68-a5f5-4ccf-9056-f4a621073217" (UID: "f297ed68-a5f5-4ccf-9056-f4a621073217"). InnerVolumeSpecName "kube-api-access-56xf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:03:27.049358 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:27.049335 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f297ed68-a5f5-4ccf-9056-f4a621073217-util" (OuterVolumeSpecName: "util") pod "f297ed68-a5f5-4ccf-9056-f4a621073217" (UID: "f297ed68-a5f5-4ccf-9056-f4a621073217"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:03:27.142597 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:27.142562 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f297ed68-a5f5-4ccf-9056-f4a621073217-util\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:03:27.142597 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:27.142591 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f297ed68-a5f5-4ccf-9056-f4a621073217-bundle\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:03:27.142597 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:27.142600 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56xf6\" (UniqueName: \"kubernetes.io/projected/f297ed68-a5f5-4ccf-9056-f4a621073217-kube-api-access-56xf6\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:03:27.720366 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:27.720337 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" Jul 14 23:03:27.720757 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:27.720371 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj" event={"ID":"f297ed68-a5f5-4ccf-9056-f4a621073217","Type":"ContainerDied","Data":"a3790d6f1aef22daa681c7a1b00601d88d5ff829de0314ff2dc3ddc18182c5f2"} Jul 14 23:03:27.720757 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:27.720411 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3790d6f1aef22daa681c7a1b00601d88d5ff829de0314ff2dc3ddc18182c5f2" Jul 14 23:03:33.559333 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:33.559271 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:34.091124 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:34.091083 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:35.096776 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:35.096737 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:37.553396 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553357 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pvz8x"] Jul 14 23:03:37.553879 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553810 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a2cc6e-239a-42e9-94a0-a6644273f00a" containerName="extract" Jul 14 23:03:37.553879 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553828 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a2cc6e-239a-42e9-94a0-a6644273f00a" containerName="extract" Jul 14 23:03:37.553879 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553840 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a2cc6e-239a-42e9-94a0-a6644273f00a" containerName="pull" Jul 14 23:03:37.553879 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553850 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a2cc6e-239a-42e9-94a0-a6644273f00a" containerName="pull" Jul 14 23:03:37.553879 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553859 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35de32f5-9a09-4f96-95e6-424431085613" containerName="pull" Jul 14 23:03:37.553879 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553867 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="35de32f5-9a09-4f96-95e6-424431085613" containerName="pull" Jul 14 23:03:37.553879 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553880 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a2cc6e-239a-42e9-94a0-a6644273f00a" containerName="util" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553887 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a2cc6e-239a-42e9-94a0-a6644273f00a" containerName="util" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553905 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f297ed68-a5f5-4ccf-9056-f4a621073217" containerName="extract" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553914 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f297ed68-a5f5-4ccf-9056-f4a621073217" containerName="extract" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553935 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee9ae486-e927-4435-ac41-c21d4d123b45" containerName="pull" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553944 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee9ae486-e927-4435-ac41-c21d4d123b45" containerName="pull" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553953 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee9ae486-e927-4435-ac41-c21d4d123b45" containerName="extract" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553960 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee9ae486-e927-4435-ac41-c21d4d123b45" containerName="extract" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553971 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f297ed68-a5f5-4ccf-9056-f4a621073217" containerName="util" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553980 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f297ed68-a5f5-4ccf-9056-f4a621073217" containerName="util" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.553996 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35de32f5-9a09-4f96-95e6-424431085613" containerName="extract" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.554004 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="35de32f5-9a09-4f96-95e6-424431085613" containerName="extract" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.554014 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee9ae486-e927-4435-ac41-c21d4d123b45" containerName="util" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.554022 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee9ae486-e927-4435-ac41-c21d4d123b45" containerName="util" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.554030 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35de32f5-9a09-4f96-95e6-424431085613" containerName="util" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.554038 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="35de32f5-9a09-4f96-95e6-424431085613" containerName="util" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.554047 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f297ed68-a5f5-4ccf-9056-f4a621073217" containerName="pull" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.554055 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f297ed68-a5f5-4ccf-9056-f4a621073217" containerName="pull" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.554133 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f297ed68-a5f5-4ccf-9056-f4a621073217" containerName="extract" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.554149 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="71a2cc6e-239a-42e9-94a0-a6644273f00a" containerName="extract" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.554159 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="35de32f5-9a09-4f96-95e6-424431085613" containerName="extract" Jul 14 23:03:37.554224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.554169 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee9ae486-e927-4435-ac41-c21d4d123b45" containerName="extract" Jul 14 23:03:37.558363 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.558343 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvz8x" Jul 14 23:03:37.561408 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.561386 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mnczb\"" Jul 14 23:03:37.570005 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.569981 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pvz8x"] Jul 14 23:03:37.615211 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.615169 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v2f7\" (UniqueName: \"kubernetes.io/projected/85b0383f-94ed-4b72-8200-e7df31866bec-kube-api-access-9v2f7\") pod \"authorino-operator-75cc8d5cb7-pvz8x\" (UID: \"85b0383f-94ed-4b72-8200-e7df31866bec\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvz8x" Jul 14 23:03:37.716604 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.716570 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v2f7\" (UniqueName: \"kubernetes.io/projected/85b0383f-94ed-4b72-8200-e7df31866bec-kube-api-access-9v2f7\") pod \"authorino-operator-75cc8d5cb7-pvz8x\" (UID: \"85b0383f-94ed-4b72-8200-e7df31866bec\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvz8x" Jul 14 23:03:37.738648 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.738623 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v2f7\" (UniqueName: \"kubernetes.io/projected/85b0383f-94ed-4b72-8200-e7df31866bec-kube-api-access-9v2f7\") pod \"authorino-operator-75cc8d5cb7-pvz8x\" (UID: \"85b0383f-94ed-4b72-8200-e7df31866bec\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvz8x" Jul 14 23:03:37.869984 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:37.869892 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvz8x" Jul 14 23:03:38.005389 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:38.005363 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pvz8x"] Jul 14 23:03:38.008090 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:03:38.008059 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b0383f_94ed_4b72_8200_e7df31866bec.slice/crio-ad0fce26e3fefd9fd745546be173cb4f9c76e43c0f515588d2bccaa7a387f200 WatchSource:0}: Error finding container ad0fce26e3fefd9fd745546be173cb4f9c76e43c0f515588d2bccaa7a387f200: Status 404 returned error can't find the container with id ad0fce26e3fefd9fd745546be173cb4f9c76e43c0f515588d2bccaa7a387f200 Jul 14 23:03:38.679134 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:38.679100 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:38.783524 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:38.783486 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvz8x" event={"ID":"85b0383f-94ed-4b72-8200-e7df31866bec","Type":"ContainerStarted","Data":"ad0fce26e3fefd9fd745546be173cb4f9c76e43c0f515588d2bccaa7a387f200"} Jul 14 23:03:40.794983 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:40.794946 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvz8x" event={"ID":"85b0383f-94ed-4b72-8200-e7df31866bec","Type":"ContainerStarted","Data":"82726591b16ce181073ef8119955f3609868ebd9abb77bc3d71c1ccdda1ba6ef"} Jul 14 23:03:40.795453 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:40.795074 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvz8x" Jul 14 23:03:40.815719 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:40.815674 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvz8x" podStartSLOduration=1.467014084 podStartE2EDuration="3.815660104s" totalImagesPullingTime="2.34864602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:03:40.814126966 +0000 UTC m=+409.430788673" watchObservedRunningTime="2026-07-14 23:03:40.815660104 +0000 UTC m=+409.432321798" Jul 14 23:03:41.072120 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:41.072024 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:41.416339 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:41.416305 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:43.591523 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:43.591478 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:43.693592 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:43.693532 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:46.154522 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:46.154493 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:47.395744 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:47.395709 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck"] Jul 14 23:03:47.398869 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:47.398851 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:03:47.403080 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:47.403062 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ckxkq\"" Jul 14 23:03:47.433005 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:47.432968 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck"] Jul 14 23:03:47.486106 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:47.486072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hwhv\" (UniqueName: \"kubernetes.io/projected/844805ab-8eed-426c-a461-8a6e3226d2de-kube-api-access-9hwhv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fxvck\" (UID: \"844805ab-8eed-426c-a461-8a6e3226d2de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:03:47.486291 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:47.486119 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/844805ab-8eed-426c-a461-8a6e3226d2de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fxvck\" (UID: \"844805ab-8eed-426c-a461-8a6e3226d2de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:03:47.586523 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:47.586475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hwhv\" (UniqueName: \"kubernetes.io/projected/844805ab-8eed-426c-a461-8a6e3226d2de-kube-api-access-9hwhv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fxvck\" (UID: \"844805ab-8eed-426c-a461-8a6e3226d2de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:03:47.586740 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:47.586564 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/844805ab-8eed-426c-a461-8a6e3226d2de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fxvck\" (UID: \"844805ab-8eed-426c-a461-8a6e3226d2de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:03:47.586899 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:47.586880 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/844805ab-8eed-426c-a461-8a6e3226d2de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fxvck\" (UID: \"844805ab-8eed-426c-a461-8a6e3226d2de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:03:47.595830 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:47.595804 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hwhv\" (UniqueName: \"kubernetes.io/projected/844805ab-8eed-426c-a461-8a6e3226d2de-kube-api-access-9hwhv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fxvck\" (UID: \"844805ab-8eed-426c-a461-8a6e3226d2de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:03:47.708802 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:47.708766 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:03:47.840227 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:47.840201 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck"] Jul 14 23:03:47.842403 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:03:47.842371 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod844805ab_8eed_426c_a461_8a6e3226d2de.slice/crio-b5c150607f246c79f87e6cf817a462377101aba72c949768d43eff6396a4dd5b WatchSource:0}: Error finding container b5c150607f246c79f87e6cf817a462377101aba72c949768d43eff6396a4dd5b: Status 404 returned error can't find the container with id b5c150607f246c79f87e6cf817a462377101aba72c949768d43eff6396a4dd5b Jul 14 23:03:48.680743 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:48.680700 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:48.800333 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:48.800293 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:48.836335 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:48.836293 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" event={"ID":"844805ab-8eed-426c-a461-8a6e3226d2de","Type":"ContainerStarted","Data":"b5c150607f246c79f87e6cf817a462377101aba72c949768d43eff6396a4dd5b"} Jul 14 23:03:48.926927 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:48.926807 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:49.147365 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:49.147145 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:51.803318 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:51.803286 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pvz8x" Jul 14 23:03:52.517194 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:52.517161 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:52.614051 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:52.613988 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:53.869425 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:53.869390 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" event={"ID":"844805ab-8eed-426c-a461-8a6e3226d2de","Type":"ContainerStarted","Data":"3854082988f26c2eafada60dde7e6743ad09eb1a947c2da7f158a859ba58a5c0"} Jul 14 23:03:53.869844 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:53.869493 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:03:53.906607 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:53.906531 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" podStartSLOduration=1.0783307149999999 podStartE2EDuration="6.906516259s" totalImagesPullingTime="5.828185544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:03:53.903727204 +0000 UTC m=+422.520388899" watchObservedRunningTime="2026-07-14 23:03:53.906516259 +0000 UTC m=+422.523177952" Jul 14 23:03:56.406686 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:56.406650 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:56.574354 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:56.574319 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:56.674154 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:56.674071 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:03:56.774678 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:03:56.774639 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:00.194136 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:00.194098 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:00.294520 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:00.294479 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:01.824263 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:01.824225 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:04.876507 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:04.876470 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:04:06.691027 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.690986 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck"] Jul 14 23:04:06.691521 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.691187 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" podUID="844805ab-8eed-426c-a461-8a6e3226d2de" containerName="manager" containerID="cri-o://3854082988f26c2eafada60dde7e6743ad09eb1a947c2da7f158a859ba58a5c0" gracePeriod=2 Jul 14 23:04:06.700974 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.700939 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck"] Jul 14 23:04:06.705060 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:04:06.705013 2572 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"844805ab-8eed-426c-a461-8a6e3226d2de\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-fxvck\": pods \"kuadrant-operator-controller-manager-8684c9ff49-fxvck\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:04:06.735356 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.735322 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp"] Jul 14 23:04:06.735651 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.735638 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="844805ab-8eed-426c-a461-8a6e3226d2de" containerName="manager" Jul 14 23:04:06.735701 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.735652 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="844805ab-8eed-426c-a461-8a6e3226d2de" containerName="manager" Jul 14 23:04:06.735750 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.735740 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="844805ab-8eed-426c-a461-8a6e3226d2de" containerName="manager" Jul 14 23:04:06.739028 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.739003 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" Jul 14 23:04:06.742091 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:04:06.742059 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fxvck\" is forbidden: User \"system:node:ip-10-0-130-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-2.ec2.internal' and this object" podUID="844805ab-8eed-426c-a461-8a6e3226d2de" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:04:06.768431 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.768402 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp"] Jul 14 23:04:06.823868 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.823831 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l57r4\" (UniqueName: \"kubernetes.io/projected/bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b-kube-api-access-l57r4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p6svp\" (UID: \"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" Jul 14 23:04:06.824003 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.823890 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p6svp\" (UID: \"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" Jul 14 23:04:06.924901 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.924871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l57r4\" (UniqueName: \"kubernetes.io/projected/bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b-kube-api-access-l57r4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p6svp\" (UID: \"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" Jul 14 23:04:06.925015 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.924933 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p6svp\" (UID: \"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" Jul 14 23:04:06.925256 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.925237 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p6svp\" (UID: \"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" Jul 14 23:04:06.933463 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.933438 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:04:06.933611 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.933434 2572 generic.go:356] "Generic (PLEG): container finished" podID="844805ab-8eed-426c-a461-8a6e3226d2de" containerID="3854082988f26c2eafada60dde7e6743ad09eb1a947c2da7f158a859ba58a5c0" exitCode=0 Jul 14 23:04:06.933611 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.933572 2572 scope.go:117] "RemoveContainer" containerID="3854082988f26c2eafada60dde7e6743ad09eb1a947c2da7f158a859ba58a5c0" Jul 14 23:04:06.936235 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:04:06.936202 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fxvck\" is forbidden: User \"system:node:ip-10-0-130-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-2.ec2.internal' and this object" podUID="844805ab-8eed-426c-a461-8a6e3226d2de" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:04:06.936423 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:06.936408 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l57r4\" (UniqueName: \"kubernetes.io/projected/bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b-kube-api-access-l57r4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p6svp\" (UID: \"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" Jul 14 23:04:07.025239 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.025205 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/844805ab-8eed-426c-a461-8a6e3226d2de-extensions-socket-volume\") pod \"844805ab-8eed-426c-a461-8a6e3226d2de\" (UID: \"844805ab-8eed-426c-a461-8a6e3226d2de\") " Jul 14 23:04:07.025397 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.025282 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hwhv\" (UniqueName: \"kubernetes.io/projected/844805ab-8eed-426c-a461-8a6e3226d2de-kube-api-access-9hwhv\") pod \"844805ab-8eed-426c-a461-8a6e3226d2de\" (UID: \"844805ab-8eed-426c-a461-8a6e3226d2de\") " Jul 14 23:04:07.025829 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.025802 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844805ab-8eed-426c-a461-8a6e3226d2de-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "844805ab-8eed-426c-a461-8a6e3226d2de" (UID: "844805ab-8eed-426c-a461-8a6e3226d2de"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:04:07.027333 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.027315 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/844805ab-8eed-426c-a461-8a6e3226d2de-kube-api-access-9hwhv" (OuterVolumeSpecName: "kube-api-access-9hwhv") pod "844805ab-8eed-426c-a461-8a6e3226d2de" (UID: "844805ab-8eed-426c-a461-8a6e3226d2de"). InnerVolumeSpecName "kube-api-access-9hwhv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:04:07.086727 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.086694 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" Jul 14 23:04:07.126032 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.125987 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/844805ab-8eed-426c-a461-8a6e3226d2de-extensions-socket-volume\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:04:07.126032 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.126028 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hwhv\" (UniqueName: \"kubernetes.io/projected/844805ab-8eed-426c-a461-8a6e3226d2de-kube-api-access-9hwhv\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:04:07.221713 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.221687 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp"] Jul 14 23:04:07.223605 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:04:07.223577 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcdba5f6_053f_47cb_9c27_ef3eeeb9e59b.slice/crio-ff8d5e103671db13add74e73b3d47905424936d5ec4d105c9c649ed969c258bd WatchSource:0}: Error finding container ff8d5e103671db13add74e73b3d47905424936d5ec4d105c9c649ed969c258bd: Status 404 returned error can't find the container with id ff8d5e103671db13add74e73b3d47905424936d5ec4d105c9c649ed969c258bd Jul 14 23:04:07.909485 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.909451 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="844805ab-8eed-426c-a461-8a6e3226d2de" path="/var/lib/kubelet/pods/844805ab-8eed-426c-a461-8a6e3226d2de/volumes" Jul 14 23:04:07.939789 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.939763 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fxvck" Jul 14 23:04:07.941926 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.941892 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" event={"ID":"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b","Type":"ContainerStarted","Data":"5a12f5fe003bd83b0772f1ffa0ecb676e6cb05f96f1052db13119cb7c82e15be"} Jul 14 23:04:07.942112 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.941954 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" event={"ID":"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b","Type":"ContainerStarted","Data":"ff8d5e103671db13add74e73b3d47905424936d5ec4d105c9c649ed969c258bd"} Jul 14 23:04:07.942112 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.942006 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" Jul 14 23:04:07.950025 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.949997 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:07.966131 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:07.966085 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" podStartSLOduration=1.9660714540000002 podStartE2EDuration="1.966071454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:04:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:04:07.964217694 +0000 UTC m=+436.580879388" watchObservedRunningTime="2026-07-14 23:04:07.966071454 +0000 UTC m=+436.582733147" Jul 14 23:04:08.052716 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:08.052681 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:08.158082 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:08.158040 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:08.610158 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:08.610122 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:08.707934 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:08.707901 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:10.986673 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:10.986624 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:11.117783 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:11.117744 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:16.287676 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:16.287589 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:16.388021 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:16.387990 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:18.691063 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:18.691025 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:18.792498 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:18.792458 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:18.949006 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:18.948924 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" Jul 14 23:04:23.244905 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.244869 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp"] Jul 14 23:04:23.245306 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.245106 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" podUID="bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b" containerName="manager" containerID="cri-o://5a12f5fe003bd83b0772f1ffa0ecb676e6cb05f96f1052db13119cb7c82e15be" gracePeriod=10 Jul 14 23:04:23.492960 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.492933 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" Jul 14 23:04:23.551627 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.551519 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b-extensions-socket-volume\") pod \"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b\" (UID: \"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b\") " Jul 14 23:04:23.551627 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.551605 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l57r4\" (UniqueName: \"kubernetes.io/projected/bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b-kube-api-access-l57r4\") pod \"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b\" (UID: \"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b\") " Jul 14 23:04:23.551907 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.551882 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b" (UID: "bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:04:23.553590 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.553565 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b-kube-api-access-l57r4" (OuterVolumeSpecName: "kube-api-access-l57r4") pod "bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b" (UID: "bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b"). InnerVolumeSpecName "kube-api-access-l57r4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:04:23.566382 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.566361 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5"] Jul 14 23:04:23.566690 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.566667 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b" containerName="manager" Jul 14 23:04:23.566690 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.566691 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b" containerName="manager" Jul 14 23:04:23.566782 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.566771 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b" containerName="manager" Jul 14 23:04:23.572717 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.572700 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" Jul 14 23:04:23.632852 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.632816 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5"] Jul 14 23:04:23.652263 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.652236 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2mrv\" (UniqueName: \"kubernetes.io/projected/d3ea7f22-c3a7-4a97-a933-b0e8b9952dae-kube-api-access-p2mrv\") pod \"kuadrant-operator-controller-manager-86878c769f-lsqt5\" (UID: \"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" Jul 14 23:04:23.652418 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.652362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3ea7f22-c3a7-4a97-a933-b0e8b9952dae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lsqt5\" (UID: \"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" Jul 14 23:04:23.652462 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.652430 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b-extensions-socket-volume\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:04:23.652462 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.652442 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l57r4\" (UniqueName: \"kubernetes.io/projected/bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b-kube-api-access-l57r4\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:04:23.752832 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.752795 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3ea7f22-c3a7-4a97-a933-b0e8b9952dae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lsqt5\" (UID: \"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" Jul 14 23:04:23.753042 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.752843 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2mrv\" (UniqueName: \"kubernetes.io/projected/d3ea7f22-c3a7-4a97-a933-b0e8b9952dae-kube-api-access-p2mrv\") pod \"kuadrant-operator-controller-manager-86878c769f-lsqt5\" (UID: \"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" Jul 14 23:04:23.753273 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.753254 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3ea7f22-c3a7-4a97-a933-b0e8b9952dae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lsqt5\" (UID: \"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" Jul 14 23:04:23.768109 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.768085 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2mrv\" (UniqueName: \"kubernetes.io/projected/d3ea7f22-c3a7-4a97-a933-b0e8b9952dae-kube-api-access-p2mrv\") pod \"kuadrant-operator-controller-manager-86878c769f-lsqt5\" (UID: \"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" Jul 14 23:04:23.882067 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:23.881979 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" Jul 14 23:04:24.023854 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:24.023824 2572 generic.go:356] "Generic (PLEG): container finished" podID="bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b" containerID="5a12f5fe003bd83b0772f1ffa0ecb676e6cb05f96f1052db13119cb7c82e15be" exitCode=0 Jul 14 23:04:24.024031 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:24.023873 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" Jul 14 23:04:24.024031 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:24.023885 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" event={"ID":"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b","Type":"ContainerDied","Data":"5a12f5fe003bd83b0772f1ffa0ecb676e6cb05f96f1052db13119cb7c82e15be"} Jul 14 23:04:24.024031 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:24.023954 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp" event={"ID":"bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b","Type":"ContainerDied","Data":"ff8d5e103671db13add74e73b3d47905424936d5ec4d105c9c649ed969c258bd"} Jul 14 23:04:24.024031 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:24.023987 2572 scope.go:117] "RemoveContainer" containerID="5a12f5fe003bd83b0772f1ffa0ecb676e6cb05f96f1052db13119cb7c82e15be" Jul 14 23:04:24.033108 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:24.033091 2572 scope.go:117] "RemoveContainer" containerID="5a12f5fe003bd83b0772f1ffa0ecb676e6cb05f96f1052db13119cb7c82e15be" Jul 14 23:04:24.033373 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:04:24.033355 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a12f5fe003bd83b0772f1ffa0ecb676e6cb05f96f1052db13119cb7c82e15be\": container with ID starting with 5a12f5fe003bd83b0772f1ffa0ecb676e6cb05f96f1052db13119cb7c82e15be not found: ID does not exist" containerID="5a12f5fe003bd83b0772f1ffa0ecb676e6cb05f96f1052db13119cb7c82e15be" Jul 14 23:04:24.033421 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:24.033382 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a12f5fe003bd83b0772f1ffa0ecb676e6cb05f96f1052db13119cb7c82e15be"} err="failed to get container status \"5a12f5fe003bd83b0772f1ffa0ecb676e6cb05f96f1052db13119cb7c82e15be\": rpc error: code = NotFound desc = could not find container \"5a12f5fe003bd83b0772f1ffa0ecb676e6cb05f96f1052db13119cb7c82e15be\": container with ID starting with 5a12f5fe003bd83b0772f1ffa0ecb676e6cb05f96f1052db13119cb7c82e15be not found: ID does not exist" Jul 14 23:04:24.038437 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:24.038419 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5"] Jul 14 23:04:24.040203 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:04:24.040180 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ea7f22_c3a7_4a97_a933_b0e8b9952dae.slice/crio-2a3a6d687f255d7b817dd3d1f87a99884c6d9363401ef70f43b0d8869eb786a6 WatchSource:0}: Error finding container 2a3a6d687f255d7b817dd3d1f87a99884c6d9363401ef70f43b0d8869eb786a6: Status 404 returned error can't find the container with id 2a3a6d687f255d7b817dd3d1f87a99884c6d9363401ef70f43b0d8869eb786a6 Jul 14 23:04:24.052137 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:24.052115 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp"] Jul 14 23:04:24.059113 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:24.059093 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6svp"] Jul 14 23:04:25.032927 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:25.032886 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" event={"ID":"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae","Type":"ContainerStarted","Data":"16d9703ed232fc2527d488309efa073294bde637388e7202b2536fb5a7f2daf8"} Jul 14 23:04:25.033318 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:25.032968 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" event={"ID":"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae","Type":"ContainerStarted","Data":"2a3a6d687f255d7b817dd3d1f87a99884c6d9363401ef70f43b0d8869eb786a6"} Jul 14 23:04:25.033318 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:25.033024 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" Jul 14 23:04:25.066695 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:25.066637 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" podStartSLOduration=2.06661774 podStartE2EDuration="2.06661774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:04:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:04:25.063701334 +0000 UTC m=+453.680363028" watchObservedRunningTime="2026-07-14 23:04:25.06661774 +0000 UTC m=+453.683279435" Jul 14 23:04:25.095403 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:25.095366 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:25.910363 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:25.910329 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b" path="/var/lib/kubelet/pods/bcdba5f6-053f-47cb-9c27-ef3eeeb9e59b/volumes" Jul 14 23:04:36.040062 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:36.040030 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" Jul 14 23:04:39.711946 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:39.711905 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:39.806843 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:39.806808 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:44.792072 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:44.792035 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:53.126760 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.126718 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66hp9"] Jul 14 23:04:53.129370 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.129322 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:53.132040 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.132023 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" Jul 14 23:04:53.135191 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.135175 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c524q\"" Jul 14 23:04:53.135460 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.135446 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 23:04:53.141801 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.141775 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66hp9"] Jul 14 23:04:53.219059 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.219026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/95b28227-4d8c-4f49-9a48-e1f9401cde40-config-file\") pod \"limitador-limitador-64c94fd64f-66hp9\" (UID: \"95b28227-4d8c-4f49-9a48-e1f9401cde40\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" Jul 14 23:04:53.219222 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.219083 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vjkj\" (UniqueName: \"kubernetes.io/projected/95b28227-4d8c-4f49-9a48-e1f9401cde40-kube-api-access-7vjkj\") pod \"limitador-limitador-64c94fd64f-66hp9\" (UID: \"95b28227-4d8c-4f49-9a48-e1f9401cde40\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" Jul 14 23:04:53.231356 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.231322 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66hp9"] Jul 14 23:04:53.240220 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.240187 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:53.315023 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.314972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:53.319763 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.319725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/95b28227-4d8c-4f49-9a48-e1f9401cde40-config-file\") pod \"limitador-limitador-64c94fd64f-66hp9\" (UID: \"95b28227-4d8c-4f49-9a48-e1f9401cde40\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" Jul 14 23:04:53.319937 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.319775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vjkj\" (UniqueName: \"kubernetes.io/projected/95b28227-4d8c-4f49-9a48-e1f9401cde40-kube-api-access-7vjkj\") pod \"limitador-limitador-64c94fd64f-66hp9\" (UID: \"95b28227-4d8c-4f49-9a48-e1f9401cde40\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" Jul 14 23:04:53.320340 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.320321 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/95b28227-4d8c-4f49-9a48-e1f9401cde40-config-file\") pod \"limitador-limitador-64c94fd64f-66hp9\" (UID: \"95b28227-4d8c-4f49-9a48-e1f9401cde40\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" Jul 14 23:04:53.330993 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.330967 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vjkj\" (UniqueName: \"kubernetes.io/projected/95b28227-4d8c-4f49-9a48-e1f9401cde40-kube-api-access-7vjkj\") pod \"limitador-limitador-64c94fd64f-66hp9\" (UID: \"95b28227-4d8c-4f49-9a48-e1f9401cde40\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" Jul 14 23:04:53.443380 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.443343 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" Jul 14 23:04:53.580128 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.580104 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66hp9"] Jul 14 23:04:53.582054 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:04:53.582024 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b28227_4d8c_4f49_9a48_e1f9401cde40.slice/crio-ea542bcd1c59c2c559cbc54c3463acb686108f34859c26feed2966bf0cd89f1e WatchSource:0}: Error finding container ea542bcd1c59c2c559cbc54c3463acb686108f34859c26feed2966bf0cd89f1e: Status 404 returned error can't find the container with id ea542bcd1c59c2c559cbc54c3463acb686108f34859c26feed2966bf0cd89f1e Jul 14 23:04:53.968985 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:53.968943 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:54.073863 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:54.073829 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:04:54.179753 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:54.179713 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" event={"ID":"95b28227-4d8c-4f49-9a48-e1f9401cde40","Type":"ContainerStarted","Data":"ea542bcd1c59c2c559cbc54c3463acb686108f34859c26feed2966bf0cd89f1e"} Jul 14 23:04:57.199890 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:57.199853 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" event={"ID":"95b28227-4d8c-4f49-9a48-e1f9401cde40","Type":"ContainerStarted","Data":"0e88423354519f9df9a92bd3443a0a265edd205451c3908cffee5107e41da8a4"} Jul 14 23:04:57.200300 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:57.199985 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" Jul 14 23:04:57.219134 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:57.219083 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" podStartSLOduration=1.404777494 podStartE2EDuration="4.21906871s" totalImagesPullingTime="2.814291216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:04:57.217342685 +0000 UTC m=+485.834004381" watchObservedRunningTime="2026-07-14 23:04:57.21906871 +0000 UTC m=+485.835730405" Jul 14 23:04:59.295156 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:04:59.295118 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:05:08.206159 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:08.206129 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" Jul 14 23:05:08.475005 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:08.474884 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66hp9"] Jul 14 23:05:08.475201 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:08.475125 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" podUID="95b28227-4d8c-4f49-9a48-e1f9401cde40" containerName="limitador" containerID="cri-o://0e88423354519f9df9a92bd3443a0a265edd205451c3908cffee5107e41da8a4" gracePeriod=30 Jul 14 23:05:09.260715 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:09.260683 2572 generic.go:356] "Generic (PLEG): container finished" podID="95b28227-4d8c-4f49-9a48-e1f9401cde40" containerID="0e88423354519f9df9a92bd3443a0a265edd205451c3908cffee5107e41da8a4" exitCode=0 Jul 14 23:05:09.261115 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:09.260735 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" event={"ID":"95b28227-4d8c-4f49-9a48-e1f9401cde40","Type":"ContainerDied","Data":"0e88423354519f9df9a92bd3443a0a265edd205451c3908cffee5107e41da8a4"} Jul 14 23:05:09.412508 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:09.412481 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" Jul 14 23:05:09.451302 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:09.451268 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/95b28227-4d8c-4f49-9a48-e1f9401cde40-config-file\") pod \"95b28227-4d8c-4f49-9a48-e1f9401cde40\" (UID: \"95b28227-4d8c-4f49-9a48-e1f9401cde40\") " Jul 14 23:05:09.451302 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:09.451306 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vjkj\" (UniqueName: \"kubernetes.io/projected/95b28227-4d8c-4f49-9a48-e1f9401cde40-kube-api-access-7vjkj\") pod \"95b28227-4d8c-4f49-9a48-e1f9401cde40\" (UID: \"95b28227-4d8c-4f49-9a48-e1f9401cde40\") " Jul 14 23:05:09.451709 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:09.451684 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b28227-4d8c-4f49-9a48-e1f9401cde40-config-file" (OuterVolumeSpecName: "config-file") pod "95b28227-4d8c-4f49-9a48-e1f9401cde40" (UID: "95b28227-4d8c-4f49-9a48-e1f9401cde40"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:05:09.453361 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:09.453339 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b28227-4d8c-4f49-9a48-e1f9401cde40-kube-api-access-7vjkj" (OuterVolumeSpecName: "kube-api-access-7vjkj") pod "95b28227-4d8c-4f49-9a48-e1f9401cde40" (UID: "95b28227-4d8c-4f49-9a48-e1f9401cde40"). InnerVolumeSpecName "kube-api-access-7vjkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:05:09.551976 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:09.551886 2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/95b28227-4d8c-4f49-9a48-e1f9401cde40-config-file\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:05:09.551976 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:09.551919 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vjkj\" (UniqueName: \"kubernetes.io/projected/95b28227-4d8c-4f49-9a48-e1f9401cde40-kube-api-access-7vjkj\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:05:10.184564 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:10.184458 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:05:10.266509 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:10.266479 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" Jul 14 23:05:10.266509 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:10.266500 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-66hp9" event={"ID":"95b28227-4d8c-4f49-9a48-e1f9401cde40","Type":"ContainerDied","Data":"ea542bcd1c59c2c559cbc54c3463acb686108f34859c26feed2966bf0cd89f1e"} Jul 14 23:05:10.267010 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:10.266591 2572 scope.go:117] "RemoveContainer" containerID="0e88423354519f9df9a92bd3443a0a265edd205451c3908cffee5107e41da8a4" Jul 14 23:05:10.285209 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:10.285178 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66hp9"] Jul 14 23:05:10.287041 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:10.287023 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-66hp9"] Jul 14 23:05:11.914841 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:11.914813 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95b28227-4d8c-4f49-9a48-e1f9401cde40" path="/var/lib/kubelet/pods/95b28227-4d8c-4f49-9a48-e1f9401cde40/volumes" Jul 14 23:05:12.897480 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:12.897444 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:05:12.982329 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:12.982292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:05:13.325687 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.325651 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6"] Jul 14 23:05:13.326086 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.326064 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95b28227-4d8c-4f49-9a48-e1f9401cde40" containerName="limitador" Jul 14 23:05:13.326086 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.326087 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="95b28227-4d8c-4f49-9a48-e1f9401cde40" containerName="limitador" Jul 14 23:05:13.326280 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.326192 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="95b28227-4d8c-4f49-9a48-e1f9401cde40" containerName="limitador" Jul 14 23:05:13.330449 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.330429 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6" Jul 14 23:05:13.334184 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.334151 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5xrxg\"" Jul 14 23:05:13.334449 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.334432 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 23:05:13.335912 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.335887 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 23:05:13.336022 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.335913 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 23:05:13.338858 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.338836 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6"] Jul 14 23:05:13.360498 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.360468 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:05:13.381905 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.381858 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mc4r\" (UniqueName: \"kubernetes.io/projected/4c42b17c-14d7-45b1-9825-89312b8048eb-kube-api-access-5mc4r\") pod \"postgres-69fb4594cf-w6rd6\" (UID: \"4c42b17c-14d7-45b1-9825-89312b8048eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6" Jul 14 23:05:13.382036 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.381920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c42b17c-14d7-45b1-9825-89312b8048eb-data\") pod \"postgres-69fb4594cf-w6rd6\" (UID: \"4c42b17c-14d7-45b1-9825-89312b8048eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6" Jul 14 23:05:13.483111 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.483074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mc4r\" (UniqueName: \"kubernetes.io/projected/4c42b17c-14d7-45b1-9825-89312b8048eb-kube-api-access-5mc4r\") pod \"postgres-69fb4594cf-w6rd6\" (UID: \"4c42b17c-14d7-45b1-9825-89312b8048eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6" Jul 14 23:05:13.483111 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.483120 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c42b17c-14d7-45b1-9825-89312b8048eb-data\") pod \"postgres-69fb4594cf-w6rd6\" (UID: \"4c42b17c-14d7-45b1-9825-89312b8048eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6" Jul 14 23:05:13.483478 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.483462 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4c42b17c-14d7-45b1-9825-89312b8048eb-data\") pod \"postgres-69fb4594cf-w6rd6\" (UID: \"4c42b17c-14d7-45b1-9825-89312b8048eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6" Jul 14 23:05:13.494078 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.494048 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mc4r\" (UniqueName: \"kubernetes.io/projected/4c42b17c-14d7-45b1-9825-89312b8048eb-kube-api-access-5mc4r\") pod \"postgres-69fb4594cf-w6rd6\" (UID: \"4c42b17c-14d7-45b1-9825-89312b8048eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6" Jul 14 23:05:13.642160 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.642067 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6" Jul 14 23:05:13.789040 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:13.789014 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6"] Jul 14 23:05:13.790868 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:05:13.790843 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c42b17c_14d7_45b1_9825_89312b8048eb.slice/crio-e128a8979d12bc40efc8be1828dd3b50fe0fa42a2ef61061725ee11d7c34fbeb WatchSource:0}: Error finding container e128a8979d12bc40efc8be1828dd3b50fe0fa42a2ef61061725ee11d7c34fbeb: Status 404 returned error can't find the container with id e128a8979d12bc40efc8be1828dd3b50fe0fa42a2ef61061725ee11d7c34fbeb Jul 14 23:05:14.288512 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:14.288472 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6" event={"ID":"4c42b17c-14d7-45b1-9825-89312b8048eb","Type":"ContainerStarted","Data":"e128a8979d12bc40efc8be1828dd3b50fe0fa42a2ef61061725ee11d7c34fbeb"} Jul 14 23:05:19.318781 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:19.318742 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6" event={"ID":"4c42b17c-14d7-45b1-9825-89312b8048eb","Type":"ContainerStarted","Data":"dddf3ec5c8ba52c5aa4035bc3189229026e4f544ca8d573c9be32c7a97669899"} Jul 14 23:05:19.319175 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:19.318801 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6" Jul 14 23:05:19.336360 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:19.336307 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6" podStartSLOduration=1.705736571 podStartE2EDuration="6.336294808s" totalImagesPullingTime="4.630558237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:05:19.335299952 +0000 UTC m=+507.951961648" watchObservedRunningTime="2026-07-14 23:05:19.336294808 +0000 UTC m=+507.952956571" Jul 14 23:05:25.353376 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:25.353342 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6rd6" Jul 14 23:05:25.670042 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:25.670002 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:05:25.787883 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:25.787811 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:05:28.875675 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:28.875636 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:05:32.196242 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.196200 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:05:32.204127 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.204101 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c59f8765d-n6fjk"] Jul 14 23:05:32.226444 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.226407 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c59f8765d-n6fjk"] Jul 14 23:05:32.226625 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.226553 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c59f8765d-n6fjk" Jul 14 23:05:32.231078 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.231056 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 23:05:32.231078 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.231057 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 23:05:32.231294 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.231057 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hrrjq\"" Jul 14 23:05:32.295399 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.295368 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:05:32.349566 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.349507 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9685ec27-01ed-437b-938d-2301ce7c3c1d-webhook-cert\") pod \"maas-controller-6c59f8765d-n6fjk\" (UID: \"9685ec27-01ed-437b-938d-2301ce7c3c1d\") " pod="opendatahub/maas-controller-6c59f8765d-n6fjk" Jul 14 23:05:32.349753 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.349645 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl24v\" (UniqueName: \"kubernetes.io/projected/9685ec27-01ed-437b-938d-2301ce7c3c1d-kube-api-access-wl24v\") pod \"maas-controller-6c59f8765d-n6fjk\" (UID: \"9685ec27-01ed-437b-938d-2301ce7c3c1d\") " pod="opendatahub/maas-controller-6c59f8765d-n6fjk" Jul 14 23:05:32.394462 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.394411 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:05:32.397226 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.397202 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56c469fc88-6d5wp"] Jul 14 23:05:32.399578 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.399562 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c469fc88-6d5wp" Jul 14 23:05:32.411947 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.411924 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c469fc88-6d5wp"] Jul 14 23:05:32.451088 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.450989 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d303daf-dc3e-4a6b-8c69-28020b54404b-webhook-cert\") pod \"maas-controller-56c469fc88-6d5wp\" (UID: \"2d303daf-dc3e-4a6b-8c69-28020b54404b\") " pod="opendatahub/maas-controller-56c469fc88-6d5wp" Jul 14 23:05:32.451088 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.451059 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9685ec27-01ed-437b-938d-2301ce7c3c1d-webhook-cert\") pod \"maas-controller-6c59f8765d-n6fjk\" (UID: \"9685ec27-01ed-437b-938d-2301ce7c3c1d\") " pod="opendatahub/maas-controller-6c59f8765d-n6fjk" Jul 14 23:05:32.451088 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.451080 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjbgq\" (UniqueName: \"kubernetes.io/projected/2d303daf-dc3e-4a6b-8c69-28020b54404b-kube-api-access-hjbgq\") pod \"maas-controller-56c469fc88-6d5wp\" (UID: \"2d303daf-dc3e-4a6b-8c69-28020b54404b\") " pod="opendatahub/maas-controller-56c469fc88-6d5wp" Jul 14 23:05:32.451404 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.451128 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl24v\" (UniqueName: \"kubernetes.io/projected/9685ec27-01ed-437b-938d-2301ce7c3c1d-kube-api-access-wl24v\") pod \"maas-controller-6c59f8765d-n6fjk\" (UID: \"9685ec27-01ed-437b-938d-2301ce7c3c1d\") " pod="opendatahub/maas-controller-6c59f8765d-n6fjk" Jul 14 23:05:32.453700 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.453673 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9685ec27-01ed-437b-938d-2301ce7c3c1d-webhook-cert\") pod \"maas-controller-6c59f8765d-n6fjk\" (UID: \"9685ec27-01ed-437b-938d-2301ce7c3c1d\") " pod="opendatahub/maas-controller-6c59f8765d-n6fjk" Jul 14 23:05:32.459904 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.459878 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl24v\" (UniqueName: \"kubernetes.io/projected/9685ec27-01ed-437b-938d-2301ce7c3c1d-kube-api-access-wl24v\") pod \"maas-controller-6c59f8765d-n6fjk\" (UID: \"9685ec27-01ed-437b-938d-2301ce7c3c1d\") " pod="opendatahub/maas-controller-6c59f8765d-n6fjk" Jul 14 23:05:32.537401 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.537364 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c59f8765d-n6fjk" Jul 14 23:05:32.551818 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.551790 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjbgq\" (UniqueName: \"kubernetes.io/projected/2d303daf-dc3e-4a6b-8c69-28020b54404b-kube-api-access-hjbgq\") pod \"maas-controller-56c469fc88-6d5wp\" (UID: \"2d303daf-dc3e-4a6b-8c69-28020b54404b\") " pod="opendatahub/maas-controller-56c469fc88-6d5wp" Jul 14 23:05:32.551965 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.551887 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d303daf-dc3e-4a6b-8c69-28020b54404b-webhook-cert\") pod \"maas-controller-56c469fc88-6d5wp\" (UID: \"2d303daf-dc3e-4a6b-8c69-28020b54404b\") " pod="opendatahub/maas-controller-56c469fc88-6d5wp" Jul 14 23:05:32.554263 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.554239 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d303daf-dc3e-4a6b-8c69-28020b54404b-webhook-cert\") pod \"maas-controller-56c469fc88-6d5wp\" (UID: \"2d303daf-dc3e-4a6b-8c69-28020b54404b\") " pod="opendatahub/maas-controller-56c469fc88-6d5wp" Jul 14 23:05:32.560719 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.560693 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjbgq\" (UniqueName: \"kubernetes.io/projected/2d303daf-dc3e-4a6b-8c69-28020b54404b-kube-api-access-hjbgq\") pod \"maas-controller-56c469fc88-6d5wp\" (UID: \"2d303daf-dc3e-4a6b-8c69-28020b54404b\") " pod="opendatahub/maas-controller-56c469fc88-6d5wp" Jul 14 23:05:32.668094 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.668065 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c59f8765d-n6fjk"] Jul 14 23:05:32.670036 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:05:32.670008 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9685ec27_01ed_437b_938d_2301ce7c3c1d.slice/crio-17261a24cc41dbc76e86094bf5cb89f4f2979c7feba67ddfb2acbd5f95bda8f5 WatchSource:0}: Error finding container 17261a24cc41dbc76e86094bf5cb89f4f2979c7feba67ddfb2acbd5f95bda8f5: Status 404 returned error can't find the container with id 17261a24cc41dbc76e86094bf5cb89f4f2979c7feba67ddfb2acbd5f95bda8f5 Jul 14 23:05:32.710408 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.710328 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c469fc88-6d5wp" Jul 14 23:05:32.841975 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:32.841950 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c469fc88-6d5wp"] Jul 14 23:05:32.842291 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:05:32.842269 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d303daf_dc3e_4a6b_8c69_28020b54404b.slice/crio-626ff74fde16eceeb2bf3354bdc7e0de4b346008d6de1d37651c711871f87ce4 WatchSource:0}: Error finding container 626ff74fde16eceeb2bf3354bdc7e0de4b346008d6de1d37651c711871f87ce4: Status 404 returned error can't find the container with id 626ff74fde16eceeb2bf3354bdc7e0de4b346008d6de1d37651c711871f87ce4 Jul 14 23:05:33.389252 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:33.389209 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c59f8765d-n6fjk" event={"ID":"9685ec27-01ed-437b-938d-2301ce7c3c1d","Type":"ContainerStarted","Data":"17261a24cc41dbc76e86094bf5cb89f4f2979c7feba67ddfb2acbd5f95bda8f5"} Jul 14 23:05:33.390608 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:33.390575 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c469fc88-6d5wp" event={"ID":"2d303daf-dc3e-4a6b-8c69-28020b54404b","Type":"ContainerStarted","Data":"626ff74fde16eceeb2bf3354bdc7e0de4b346008d6de1d37651c711871f87ce4"} Jul 14 23:05:34.915451 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:34.915408 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:05:35.015582 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:35.015465 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:05:35.408454 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:35.408409 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c469fc88-6d5wp" event={"ID":"2d303daf-dc3e-4a6b-8c69-28020b54404b","Type":"ContainerStarted","Data":"896ae94d3da82ef99003bd6af48a526ee1aa257597aa38d0c62aa1294a0de689"} Jul 14 23:05:35.408676 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:35.408597 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56c469fc88-6d5wp" Jul 14 23:05:35.410026 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:35.410001 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c59f8765d-n6fjk" event={"ID":"9685ec27-01ed-437b-938d-2301ce7c3c1d","Type":"ContainerStarted","Data":"8aec49b7517c8190489d27bca6e707a81cb5c27e33d6b40fdb52c8c18f2f027b"} Jul 14 23:05:35.410143 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:35.410054 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c59f8765d-n6fjk" Jul 14 23:05:35.431091 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:35.431029 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56c469fc88-6d5wp" podStartSLOduration=1.5411875959999999 podStartE2EDuration="3.431015021s" totalImagesPullingTime="1.889827425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:05:35.428457883 +0000 UTC m=+524.045119578" watchObservedRunningTime="2026-07-14 23:05:35.431015021 +0000 UTC m=+524.047676694" Jul 14 23:05:35.450787 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:35.450742 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c59f8765d-n6fjk" podStartSLOduration=1.398228702 podStartE2EDuration="3.450727307s" totalImagesPullingTime="2.052498605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:05:35.450292931 +0000 UTC m=+524.066954636" watchObservedRunningTime="2026-07-14 23:05:35.450727307 +0000 UTC m=+524.067389000" Jul 14 23:05:46.417630 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:46.417529 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56c469fc88-6d5wp" Jul 14 23:05:46.417630 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:46.417631 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c59f8765d-n6fjk" Jul 14 23:05:46.469080 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:46.469040 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c59f8765d-n6fjk"] Jul 14 23:05:46.469265 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:46.469236 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c59f8765d-n6fjk" podUID="9685ec27-01ed-437b-938d-2301ce7c3c1d" containerName="manager" containerID="cri-o://8aec49b7517c8190489d27bca6e707a81cb5c27e33d6b40fdb52c8c18f2f027b" gracePeriod=30 Jul 14 23:05:46.709575 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:46.709523 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c59f8765d-n6fjk" Jul 14 23:05:46.882257 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:46.882225 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9685ec27-01ed-437b-938d-2301ce7c3c1d-webhook-cert\") pod \"9685ec27-01ed-437b-938d-2301ce7c3c1d\" (UID: \"9685ec27-01ed-437b-938d-2301ce7c3c1d\") " Jul 14 23:05:46.882257 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:46.882261 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl24v\" (UniqueName: \"kubernetes.io/projected/9685ec27-01ed-437b-938d-2301ce7c3c1d-kube-api-access-wl24v\") pod \"9685ec27-01ed-437b-938d-2301ce7c3c1d\" (UID: \"9685ec27-01ed-437b-938d-2301ce7c3c1d\") " Jul 14 23:05:46.884434 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:46.884408 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9685ec27-01ed-437b-938d-2301ce7c3c1d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9685ec27-01ed-437b-938d-2301ce7c3c1d" (UID: "9685ec27-01ed-437b-938d-2301ce7c3c1d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 23:05:46.884556 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:46.884480 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9685ec27-01ed-437b-938d-2301ce7c3c1d-kube-api-access-wl24v" (OuterVolumeSpecName: "kube-api-access-wl24v") pod "9685ec27-01ed-437b-938d-2301ce7c3c1d" (UID: "9685ec27-01ed-437b-938d-2301ce7c3c1d"). InnerVolumeSpecName "kube-api-access-wl24v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:05:46.983440 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:46.983334 2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9685ec27-01ed-437b-938d-2301ce7c3c1d-webhook-cert\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:05:46.983440 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:46.983378 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl24v\" (UniqueName: \"kubernetes.io/projected/9685ec27-01ed-437b-938d-2301ce7c3c1d-kube-api-access-wl24v\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:05:47.474134 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:47.474092 2572 generic.go:356] "Generic (PLEG): container finished" podID="9685ec27-01ed-437b-938d-2301ce7c3c1d" containerID="8aec49b7517c8190489d27bca6e707a81cb5c27e33d6b40fdb52c8c18f2f027b" exitCode=0 Jul 14 23:05:47.474593 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:47.474147 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c59f8765d-n6fjk" Jul 14 23:05:47.474593 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:47.474175 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c59f8765d-n6fjk" event={"ID":"9685ec27-01ed-437b-938d-2301ce7c3c1d","Type":"ContainerDied","Data":"8aec49b7517c8190489d27bca6e707a81cb5c27e33d6b40fdb52c8c18f2f027b"} Jul 14 23:05:47.474593 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:47.474248 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c59f8765d-n6fjk" event={"ID":"9685ec27-01ed-437b-938d-2301ce7c3c1d","Type":"ContainerDied","Data":"17261a24cc41dbc76e86094bf5cb89f4f2979c7feba67ddfb2acbd5f95bda8f5"} Jul 14 23:05:47.474593 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:47.474270 2572 scope.go:117] "RemoveContainer" containerID="8aec49b7517c8190489d27bca6e707a81cb5c27e33d6b40fdb52c8c18f2f027b" Jul 14 23:05:47.483212 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:47.483198 2572 scope.go:117] "RemoveContainer" containerID="8aec49b7517c8190489d27bca6e707a81cb5c27e33d6b40fdb52c8c18f2f027b" Jul 14 23:05:47.483454 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:05:47.483436 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aec49b7517c8190489d27bca6e707a81cb5c27e33d6b40fdb52c8c18f2f027b\": container with ID starting with 8aec49b7517c8190489d27bca6e707a81cb5c27e33d6b40fdb52c8c18f2f027b not found: ID does not exist" containerID="8aec49b7517c8190489d27bca6e707a81cb5c27e33d6b40fdb52c8c18f2f027b" Jul 14 23:05:47.483521 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:47.483460 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aec49b7517c8190489d27bca6e707a81cb5c27e33d6b40fdb52c8c18f2f027b"} err="failed to get container status \"8aec49b7517c8190489d27bca6e707a81cb5c27e33d6b40fdb52c8c18f2f027b\": rpc error: code = NotFound desc = could not find container \"8aec49b7517c8190489d27bca6e707a81cb5c27e33d6b40fdb52c8c18f2f027b\": container with ID starting with 8aec49b7517c8190489d27bca6e707a81cb5c27e33d6b40fdb52c8c18f2f027b not found: ID does not exist" Jul 14 23:05:47.496643 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:47.496620 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c59f8765d-n6fjk"] Jul 14 23:05:47.502053 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:47.502032 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c59f8765d-n6fjk"] Jul 14 23:05:47.910276 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:05:47.910236 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9685ec27-01ed-437b-938d-2301ce7c3c1d" path="/var/lib/kubelet/pods/9685ec27-01ed-437b-938d-2301ce7c3c1d/volumes" Jul 14 23:06:03.657451 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:03.657401 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:06:03.760284 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:03.760246 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:06:04.140508 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.140424 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:06:04.325631 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.325569 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:06:04.718289 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.718252 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:06:04.805105 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.805064 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-rsr96"] Jul 14 23:06:04.805480 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.805461 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9685ec27-01ed-437b-938d-2301ce7c3c1d" containerName="manager" Jul 14 23:06:04.805590 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.805482 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9685ec27-01ed-437b-938d-2301ce7c3c1d" containerName="manager" Jul 14 23:06:04.805655 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.805622 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9685ec27-01ed-437b-938d-2301ce7c3c1d" containerName="manager" Jul 14 23:06:04.810107 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.810078 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:06:04.810346 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.810330 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-rsr96" Jul 14 23:06:04.813686 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.813664 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 23:06:04.813816 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.813794 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-glnkb\"" Jul 14 23:06:04.820567 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.820527 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-rsr96"] Jul 14 23:06:04.828536 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.828514 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7brsm\" (UniqueName: \"kubernetes.io/projected/9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7-kube-api-access-7brsm\") pod \"payload-processing-f9b8d9b9b-rsr96\" (UID: \"9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-rsr96" Jul 14 23:06:04.828668 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.828592 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-rsr96\" (UID: \"9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-rsr96" Jul 14 23:06:04.929498 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.929460 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7brsm\" (UniqueName: \"kubernetes.io/projected/9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7-kube-api-access-7brsm\") pod \"payload-processing-f9b8d9b9b-rsr96\" (UID: \"9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-rsr96" Jul 14 23:06:04.929710 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.929515 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-rsr96\" (UID: \"9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-rsr96" Jul 14 23:06:04.930266 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.930242 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-rsr96\" (UID: \"9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-rsr96" Jul 14 23:06:04.937803 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:04.937778 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7brsm\" (UniqueName: \"kubernetes.io/projected/9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7-kube-api-access-7brsm\") pod \"payload-processing-f9b8d9b9b-rsr96\" (UID: \"9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-rsr96" Jul 14 23:06:05.122608 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:05.122517 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-rsr96" Jul 14 23:06:05.260668 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:05.260645 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-rsr96"] Jul 14 23:06:05.262304 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:06:05.262273 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9035ad73_0d4f_4a69_9bb1_d3bcfd8118d7.slice/crio-5ab864c5489250ac1f0ffad6f87327391913b6cf864276dbcfb6b2615a2d0e68 WatchSource:0}: Error finding container 5ab864c5489250ac1f0ffad6f87327391913b6cf864276dbcfb6b2615a2d0e68: Status 404 returned error can't find the container with id 5ab864c5489250ac1f0ffad6f87327391913b6cf864276dbcfb6b2615a2d0e68 Jul 14 23:06:05.565830 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:05.565795 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-rsr96" event={"ID":"9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7","Type":"ContainerStarted","Data":"5ab864c5489250ac1f0ffad6f87327391913b6cf864276dbcfb6b2615a2d0e68"} Jul 14 23:06:07.577995 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:07.577957 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-rsr96" event={"ID":"9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7","Type":"ContainerStarted","Data":"d5d1c8d78d4eb7a18de294b2261a02b8aa07526170be24dc399425bc78423849"} Jul 14 23:06:07.578389 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:07.578035 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-rsr96" Jul 14 23:06:07.596798 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:07.596749 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-rsr96" podStartSLOduration=1.938438586 podStartE2EDuration="3.59673034s" totalImagesPullingTime="1.658291754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:06:07.595146728 +0000 UTC m=+556.211808423" watchObservedRunningTime="2026-07-14 23:06:07.59673034 +0000 UTC m=+556.213392035" Jul 14 23:06:14.820765 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:14.820728 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:06:14.944907 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:14.944866 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:06:18.584225 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:18.584196 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-rsr96" Jul 14 23:06:23.193466 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.193439 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj"] Jul 14 23:06:23.196816 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.196799 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.202510 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.202482 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9bm26\"" Jul 14 23:06:23.203822 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.203798 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 23:06:23.204021 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.204002 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 23:06:23.204140 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.204094 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 14 23:06:23.216046 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.216017 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj"] Jul 14 23:06:23.230419 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.230361 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:06:23.290752 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.290713 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/935a3387-19dd-4c42-b573-a78935023785-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.290752 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.290752 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9n2b\" (UniqueName: \"kubernetes.io/projected/935a3387-19dd-4c42-b573-a78935023785-kube-api-access-d9n2b\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.290966 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.290778 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/935a3387-19dd-4c42-b573-a78935023785-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.290966 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.290820 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/935a3387-19dd-4c42-b573-a78935023785-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.290966 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.290877 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/935a3387-19dd-4c42-b573-a78935023785-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.290966 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.290913 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/935a3387-19dd-4c42-b573-a78935023785-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.392182 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.392143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/935a3387-19dd-4c42-b573-a78935023785-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.392182 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.392180 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9n2b\" (UniqueName: \"kubernetes.io/projected/935a3387-19dd-4c42-b573-a78935023785-kube-api-access-d9n2b\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.392441 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.392201 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/935a3387-19dd-4c42-b573-a78935023785-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.392441 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.392225 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/935a3387-19dd-4c42-b573-a78935023785-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.392441 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.392291 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/935a3387-19dd-4c42-b573-a78935023785-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.392441 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.392338 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/935a3387-19dd-4c42-b573-a78935023785-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.392756 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.392726 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/935a3387-19dd-4c42-b573-a78935023785-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.392756 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.392743 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/935a3387-19dd-4c42-b573-a78935023785-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.392907 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.392801 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/935a3387-19dd-4c42-b573-a78935023785-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.394461 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.394444 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/935a3387-19dd-4c42-b573-a78935023785-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.394846 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.394831 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/935a3387-19dd-4c42-b573-a78935023785-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.403024 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.403002 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9n2b\" (UniqueName: \"kubernetes.io/projected/935a3387-19dd-4c42-b573-a78935023785-kube-api-access-d9n2b\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj\" (UID: \"935a3387-19dd-4c42-b573-a78935023785\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.508431 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.508323 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:23.654173 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.654145 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj"] Jul 14 23:06:23.656779 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:06:23.656747 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod935a3387_19dd_4c42_b573_a78935023785.slice/crio-8547ffe93ce3232f10fa289e2223fa017a9a7dc4c99feba2c876fbbf879aa1b0 WatchSource:0}: Error finding container 8547ffe93ce3232f10fa289e2223fa017a9a7dc4c99feba2c876fbbf879aa1b0: Status 404 returned error can't find the container with id 8547ffe93ce3232f10fa289e2223fa017a9a7dc4c99feba2c876fbbf879aa1b0 Jul 14 23:06:23.664005 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:23.663974 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" event={"ID":"935a3387-19dd-4c42-b573-a78935023785","Type":"ContainerStarted","Data":"8547ffe93ce3232f10fa289e2223fa017a9a7dc4c99feba2c876fbbf879aa1b0"} Jul 14 23:06:25.676909 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:25.676867 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" event={"ID":"935a3387-19dd-4c42-b573-a78935023785","Type":"ContainerStarted","Data":"aa7ffe944f2a8279cf7696cbd309bc0937cf6fbf4c376a48e355bf08212259af"} Jul 14 23:06:25.699344 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:25.699293 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" podStartSLOduration=1.507538907 podStartE2EDuration="2.699278955s" totalImagesPullingTime="1.191740048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:06:25.697348035 +0000 UTC m=+574.314009728" watchObservedRunningTime="2026-07-14 23:06:25.699278955 +0000 UTC m=+574.315940648" Jul 14 23:06:33.508905 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:33.508863 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:33.509316 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:33.508932 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:33.521822 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:33.521793 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:33.734425 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:33.734395 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj" Jul 14 23:06:43.815706 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:43.815659 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:06:49.226212 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:49.226174 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:06:51.850702 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:51.850657 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:06:51.851937 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:51.851915 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:06:51.855394 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:51.855371 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:06:51.856281 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:51.856264 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:06:56.794585 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.792306 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg"] Jul 14 23:06:56.796964 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.796946 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.799871 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.799855 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 14 23:06:56.804063 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.803735 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg"] Jul 14 23:06:56.879808 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.879772 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:06:56.889001 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.888974 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fede9d1-ee4e-4020-9576-059c9771eb92-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.889147 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.889011 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fede9d1-ee4e-4020-9576-059c9771eb92-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.889147 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.889087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fede9d1-ee4e-4020-9576-059c9771eb92-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.889147 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.889143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbh6g\" (UniqueName: \"kubernetes.io/projected/8fede9d1-ee4e-4020-9576-059c9771eb92-kube-api-access-dbh6g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.889255 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.889178 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fede9d1-ee4e-4020-9576-059c9771eb92-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.889255 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.889201 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fede9d1-ee4e-4020-9576-059c9771eb92-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.989884 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.989846 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fede9d1-ee4e-4020-9576-059c9771eb92-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.990070 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.989892 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fede9d1-ee4e-4020-9576-059c9771eb92-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.990070 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.989969 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbh6g\" (UniqueName: \"kubernetes.io/projected/8fede9d1-ee4e-4020-9576-059c9771eb92-kube-api-access-dbh6g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.990070 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.990013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fede9d1-ee4e-4020-9576-059c9771eb92-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.990070 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.990037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fede9d1-ee4e-4020-9576-059c9771eb92-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.990302 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.990129 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fede9d1-ee4e-4020-9576-059c9771eb92-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.990365 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.990326 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fede9d1-ee4e-4020-9576-059c9771eb92-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.990689 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.990664 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fede9d1-ee4e-4020-9576-059c9771eb92-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.990798 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.990675 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fede9d1-ee4e-4020-9576-059c9771eb92-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.992448 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.992421 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fede9d1-ee4e-4020-9576-059c9771eb92-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.992657 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.992640 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fede9d1-ee4e-4020-9576-059c9771eb92-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:56.999344 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:56.999319 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbh6g\" (UniqueName: \"kubernetes.io/projected/8fede9d1-ee4e-4020-9576-059c9771eb92-kube-api-access-dbh6g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z2wtg\" (UID: \"8fede9d1-ee4e-4020-9576-059c9771eb92\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:57.108024 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:57.107927 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:06:57.252168 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:57.252140 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg"] Jul 14 23:06:57.254802 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:06:57.254765 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fede9d1_ee4e_4020_9576_059c9771eb92.slice/crio-f3607f5a2d3cb3b373e4ec6b6d808f112307835a489f0283a659dc595a52f3c9 WatchSource:0}: Error finding container f3607f5a2d3cb3b373e4ec6b6d808f112307835a489f0283a659dc595a52f3c9: Status 404 returned error can't find the container with id f3607f5a2d3cb3b373e4ec6b6d808f112307835a489f0283a659dc595a52f3c9 Jul 14 23:06:57.843408 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:57.843300 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" event={"ID":"8fede9d1-ee4e-4020-9576-059c9771eb92","Type":"ContainerStarted","Data":"72f8bbf171c31b0ebe50566c5a4f92c62a83bc95567cb2ba20a5e6c9af9d7f54"} Jul 14 23:06:57.843408 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:57.843366 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" event={"ID":"8fede9d1-ee4e-4020-9576-059c9771eb92","Type":"ContainerStarted","Data":"f3607f5a2d3cb3b373e4ec6b6d808f112307835a489f0283a659dc595a52f3c9"} Jul 14 23:06:57.860493 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:06:57.860441 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" podStartSLOduration=1.6567002419999999 podStartE2EDuration="1.860426023s" totalImagesPullingTime="203.725781ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:06:57.860300313 +0000 UTC m=+606.476962006" watchObservedRunningTime="2026-07-14 23:06:57.860426023 +0000 UTC m=+606.477087716" Jul 14 23:07:05.524227 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:07:05.524189 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:07:07.108356 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:07:07.108318 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:07:07.108774 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:07:07.108395 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:07:07.120600 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:07:07.120573 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:07:07.912621 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:07:07.912591 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z2wtg" Jul 14 23:07:30.982141 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:07:30.982096 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:08:06.222161 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:08:06.222120 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:08:36.527871 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:08:36.527822 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:08:47.288557 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:08:47.288438 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:09:06.929579 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:09:06.929518 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:09:07.036500 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:09:07.036469 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:09:08.101083 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:09:08.101046 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:09:08.201603 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:09:08.201568 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:10:05.953735 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:05.953686 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:10:06.054348 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:06.054309 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:10:18.217123 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.217032 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:10:18.329795 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.329754 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56c469fc88-6d5wp"] Jul 14 23:10:18.330026 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.330001 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-56c469fc88-6d5wp" podUID="2d303daf-dc3e-4a6b-8c69-28020b54404b" containerName="manager" containerID="cri-o://896ae94d3da82ef99003bd6af48a526ee1aa257597aa38d0c62aa1294a0de689" gracePeriod=30 Jul 14 23:10:18.578174 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.578149 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c469fc88-6d5wp" Jul 14 23:10:18.763403 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.763318 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d303daf-dc3e-4a6b-8c69-28020b54404b-webhook-cert\") pod \"2d303daf-dc3e-4a6b-8c69-28020b54404b\" (UID: \"2d303daf-dc3e-4a6b-8c69-28020b54404b\") " Jul 14 23:10:18.763403 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.763399 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjbgq\" (UniqueName: \"kubernetes.io/projected/2d303daf-dc3e-4a6b-8c69-28020b54404b-kube-api-access-hjbgq\") pod \"2d303daf-dc3e-4a6b-8c69-28020b54404b\" (UID: \"2d303daf-dc3e-4a6b-8c69-28020b54404b\") " Jul 14 23:10:18.765445 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.765408 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d303daf-dc3e-4a6b-8c69-28020b54404b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2d303daf-dc3e-4a6b-8c69-28020b54404b" (UID: "2d303daf-dc3e-4a6b-8c69-28020b54404b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 23:10:18.765564 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.765503 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d303daf-dc3e-4a6b-8c69-28020b54404b-kube-api-access-hjbgq" (OuterVolumeSpecName: "kube-api-access-hjbgq") pod "2d303daf-dc3e-4a6b-8c69-28020b54404b" (UID: "2d303daf-dc3e-4a6b-8c69-28020b54404b"). InnerVolumeSpecName "kube-api-access-hjbgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:10:18.865049 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.864999 2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d303daf-dc3e-4a6b-8c69-28020b54404b-webhook-cert\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:10:18.865049 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.865047 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjbgq\" (UniqueName: \"kubernetes.io/projected/2d303daf-dc3e-4a6b-8c69-28020b54404b-kube-api-access-hjbgq\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:10:18.881416 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.881380 2572 generic.go:356] "Generic (PLEG): container finished" podID="2d303daf-dc3e-4a6b-8c69-28020b54404b" containerID="896ae94d3da82ef99003bd6af48a526ee1aa257597aa38d0c62aa1294a0de689" exitCode=0 Jul 14 23:10:18.881619 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.881425 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c469fc88-6d5wp" Jul 14 23:10:18.881619 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.881464 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c469fc88-6d5wp" event={"ID":"2d303daf-dc3e-4a6b-8c69-28020b54404b","Type":"ContainerDied","Data":"896ae94d3da82ef99003bd6af48a526ee1aa257597aa38d0c62aa1294a0de689"} Jul 14 23:10:18.881619 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.881517 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c469fc88-6d5wp" event={"ID":"2d303daf-dc3e-4a6b-8c69-28020b54404b","Type":"ContainerDied","Data":"626ff74fde16eceeb2bf3354bdc7e0de4b346008d6de1d37651c711871f87ce4"} Jul 14 23:10:18.881619 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.881553 2572 scope.go:117] "RemoveContainer" containerID="896ae94d3da82ef99003bd6af48a526ee1aa257597aa38d0c62aa1294a0de689" Jul 14 23:10:18.891016 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.890993 2572 scope.go:117] "RemoveContainer" containerID="896ae94d3da82ef99003bd6af48a526ee1aa257597aa38d0c62aa1294a0de689" Jul 14 23:10:18.891290 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:10:18.891272 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"896ae94d3da82ef99003bd6af48a526ee1aa257597aa38d0c62aa1294a0de689\": container with ID starting with 896ae94d3da82ef99003bd6af48a526ee1aa257597aa38d0c62aa1294a0de689 not found: ID does not exist" containerID="896ae94d3da82ef99003bd6af48a526ee1aa257597aa38d0c62aa1294a0de689" Jul 14 23:10:18.891330 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.891299 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896ae94d3da82ef99003bd6af48a526ee1aa257597aa38d0c62aa1294a0de689"} err="failed to get container status \"896ae94d3da82ef99003bd6af48a526ee1aa257597aa38d0c62aa1294a0de689\": rpc error: code = NotFound desc = could not find container \"896ae94d3da82ef99003bd6af48a526ee1aa257597aa38d0c62aa1294a0de689\": container with ID starting with 896ae94d3da82ef99003bd6af48a526ee1aa257597aa38d0c62aa1294a0de689 not found: ID does not exist" Jul 14 23:10:18.903978 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.903952 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56c469fc88-6d5wp"] Jul 14 23:10:18.907798 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:18.907776 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56c469fc88-6d5wp"] Jul 14 23:10:19.564116 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.564086 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:10:19.671532 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.671486 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56c469fc88-tk78j"] Jul 14 23:10:19.672056 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.672026 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d303daf-dc3e-4a6b-8c69-28020b54404b" containerName="manager" Jul 14 23:10:19.672056 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.672052 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d303daf-dc3e-4a6b-8c69-28020b54404b" containerName="manager" Jul 14 23:10:19.672228 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.672129 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d303daf-dc3e-4a6b-8c69-28020b54404b" containerName="manager" Jul 14 23:10:19.676762 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.676746 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c469fc88-tk78j" Jul 14 23:10:19.681371 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.681342 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 23:10:19.681499 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.681343 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 23:10:19.681607 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.681347 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hrrjq\"" Jul 14 23:10:19.684894 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.684866 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c469fc88-tk78j"] Jul 14 23:10:19.774667 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.774634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16cbc206-0c9a-409e-bc90-6094205263c8-webhook-cert\") pod \"maas-controller-56c469fc88-tk78j\" (UID: \"16cbc206-0c9a-409e-bc90-6094205263c8\") " pod="opendatahub/maas-controller-56c469fc88-tk78j" Jul 14 23:10:19.774667 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.774668 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkzpd\" (UniqueName: \"kubernetes.io/projected/16cbc206-0c9a-409e-bc90-6094205263c8-kube-api-access-pkzpd\") pod \"maas-controller-56c469fc88-tk78j\" (UID: \"16cbc206-0c9a-409e-bc90-6094205263c8\") " pod="opendatahub/maas-controller-56c469fc88-tk78j" Jul 14 23:10:19.876001 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.875899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16cbc206-0c9a-409e-bc90-6094205263c8-webhook-cert\") pod \"maas-controller-56c469fc88-tk78j\" (UID: \"16cbc206-0c9a-409e-bc90-6094205263c8\") " pod="opendatahub/maas-controller-56c469fc88-tk78j" Jul 14 23:10:19.876001 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.875951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkzpd\" (UniqueName: \"kubernetes.io/projected/16cbc206-0c9a-409e-bc90-6094205263c8-kube-api-access-pkzpd\") pod \"maas-controller-56c469fc88-tk78j\" (UID: \"16cbc206-0c9a-409e-bc90-6094205263c8\") " pod="opendatahub/maas-controller-56c469fc88-tk78j" Jul 14 23:10:19.878330 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.878298 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16cbc206-0c9a-409e-bc90-6094205263c8-webhook-cert\") pod \"maas-controller-56c469fc88-tk78j\" (UID: \"16cbc206-0c9a-409e-bc90-6094205263c8\") " pod="opendatahub/maas-controller-56c469fc88-tk78j" Jul 14 23:10:19.885263 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.885236 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkzpd\" (UniqueName: \"kubernetes.io/projected/16cbc206-0c9a-409e-bc90-6094205263c8-kube-api-access-pkzpd\") pod \"maas-controller-56c469fc88-tk78j\" (UID: \"16cbc206-0c9a-409e-bc90-6094205263c8\") " pod="opendatahub/maas-controller-56c469fc88-tk78j" Jul 14 23:10:19.910153 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.910122 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d303daf-dc3e-4a6b-8c69-28020b54404b" path="/var/lib/kubelet/pods/2d303daf-dc3e-4a6b-8c69-28020b54404b/volumes" Jul 14 23:10:19.988095 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:19.988062 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56c469fc88-tk78j" Jul 14 23:10:20.125821 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:20.125798 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56c469fc88-tk78j"] Jul 14 23:10:20.128855 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:10:20.128823 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16cbc206_0c9a_409e_bc90_6094205263c8.slice/crio-7e0d1eb69470bc0e893168b4c127e71db37e506868a0f556c0707525df5f61fb WatchSource:0}: Error finding container 7e0d1eb69470bc0e893168b4c127e71db37e506868a0f556c0707525df5f61fb: Status 404 returned error can't find the container with id 7e0d1eb69470bc0e893168b4c127e71db37e506868a0f556c0707525df5f61fb Jul 14 23:10:20.130200 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:20.130181 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 23:10:20.895112 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:20.895074 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c469fc88-tk78j" event={"ID":"16cbc206-0c9a-409e-bc90-6094205263c8","Type":"ContainerStarted","Data":"825c28000f51140fb0718522df3fcb3a372c792c741a7e4a1e8015b74bc8ad0f"} Jul 14 23:10:20.895524 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:20.895152 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56c469fc88-tk78j" event={"ID":"16cbc206-0c9a-409e-bc90-6094205263c8","Type":"ContainerStarted","Data":"7e0d1eb69470bc0e893168b4c127e71db37e506868a0f556c0707525df5f61fb"} Jul 14 23:10:20.895524 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:20.895202 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56c469fc88-tk78j" Jul 14 23:10:20.916796 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:20.916741 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56c469fc88-tk78j" podStartSLOduration=1.3170456 podStartE2EDuration="1.916724564s" totalImagesPullingTime="599.678964ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:10:20.913608319 +0000 UTC m=+809.530270013" watchObservedRunningTime="2026-07-14 23:10:20.916724564 +0000 UTC m=+809.533386304" Jul 14 23:10:30.775504 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:30.775470 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:10:31.909681 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:10:31.909654 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56c469fc88-tk78j" Jul 14 23:11:00.243061 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:00.243027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:11:00.336662 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:00.336631 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:11:00.440950 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:00.440915 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:11:06.161252 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:06.161193 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:11:06.262443 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:06.262412 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:11:06.361358 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:06.361321 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:11:06.517949 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:06.517857 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:11:12.241909 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:12.241875 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:11:12.306524 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:12.306489 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:11:23.635650 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:23.635609 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:11:51.890767 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:51.890740 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:11:51.893034 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:51.893011 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:11:51.895498 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:51.895480 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:11:51.897550 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:11:51.897521 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:14:31.580611 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:14:31.580581 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:14:32.622868 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:14:32.622832 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:15:08.640906 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:08.640824 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5"] Jul 14 23:15:08.641419 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:08.641064 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" podUID="d3ea7f22-c3a7-4a97-a933-b0e8b9952dae" containerName="manager" containerID="cri-o://16d9703ed232fc2527d488309efa073294bde637388e7202b2536fb5a7f2daf8" gracePeriod=10 Jul 14 23:15:12.196246 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.196220 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" Jul 14 23:15:12.378879 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.378776 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2mrv\" (UniqueName: \"kubernetes.io/projected/d3ea7f22-c3a7-4a97-a933-b0e8b9952dae-kube-api-access-p2mrv\") pod \"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae\" (UID: \"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae\") " Jul 14 23:15:12.378879 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.378869 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3ea7f22-c3a7-4a97-a933-b0e8b9952dae-extensions-socket-volume\") pod \"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae\" (UID: \"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae\") " Jul 14 23:15:12.379261 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.379225 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ea7f22-c3a7-4a97-a933-b0e8b9952dae-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d3ea7f22-c3a7-4a97-a933-b0e8b9952dae" (UID: "d3ea7f22-c3a7-4a97-a933-b0e8b9952dae"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 23:15:12.380949 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.380923 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ea7f22-c3a7-4a97-a933-b0e8b9952dae-kube-api-access-p2mrv" (OuterVolumeSpecName: "kube-api-access-p2mrv") pod "d3ea7f22-c3a7-4a97-a933-b0e8b9952dae" (UID: "d3ea7f22-c3a7-4a97-a933-b0e8b9952dae"). InnerVolumeSpecName "kube-api-access-p2mrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:15:12.402727 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.402697 2572 generic.go:356] "Generic (PLEG): container finished" podID="d3ea7f22-c3a7-4a97-a933-b0e8b9952dae" containerID="16d9703ed232fc2527d488309efa073294bde637388e7202b2536fb5a7f2daf8" exitCode=0 Jul 14 23:15:12.402873 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.402743 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" Jul 14 23:15:12.402873 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.402760 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" event={"ID":"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae","Type":"ContainerDied","Data":"16d9703ed232fc2527d488309efa073294bde637388e7202b2536fb5a7f2daf8"} Jul 14 23:15:12.402873 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.402812 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5" event={"ID":"d3ea7f22-c3a7-4a97-a933-b0e8b9952dae","Type":"ContainerDied","Data":"2a3a6d687f255d7b817dd3d1f87a99884c6d9363401ef70f43b0d8869eb786a6"} Jul 14 23:15:12.402873 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.402843 2572 scope.go:117] "RemoveContainer" containerID="16d9703ed232fc2527d488309efa073294bde637388e7202b2536fb5a7f2daf8" Jul 14 23:15:12.413493 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.413472 2572 scope.go:117] "RemoveContainer" containerID="16d9703ed232fc2527d488309efa073294bde637388e7202b2536fb5a7f2daf8" Jul 14 23:15:12.413791 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:15:12.413772 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16d9703ed232fc2527d488309efa073294bde637388e7202b2536fb5a7f2daf8\": container with ID starting with 16d9703ed232fc2527d488309efa073294bde637388e7202b2536fb5a7f2daf8 not found: ID does not exist" containerID="16d9703ed232fc2527d488309efa073294bde637388e7202b2536fb5a7f2daf8" Jul 14 23:15:12.413867 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.413801 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d9703ed232fc2527d488309efa073294bde637388e7202b2536fb5a7f2daf8"} err="failed to get container status \"16d9703ed232fc2527d488309efa073294bde637388e7202b2536fb5a7f2daf8\": rpc error: code = NotFound desc = could not find container \"16d9703ed232fc2527d488309efa073294bde637388e7202b2536fb5a7f2daf8\": container with ID starting with 16d9703ed232fc2527d488309efa073294bde637388e7202b2536fb5a7f2daf8 not found: ID does not exist" Jul 14 23:15:12.428094 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.428069 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5"] Jul 14 23:15:12.431637 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.431616 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsqt5"] Jul 14 23:15:12.480349 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.480323 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2mrv\" (UniqueName: \"kubernetes.io/projected/d3ea7f22-c3a7-4a97-a933-b0e8b9952dae-kube-api-access-p2mrv\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:15:12.480349 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:12.480348 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3ea7f22-c3a7-4a97-a933-b0e8b9952dae-extensions-socket-volume\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:15:13.910830 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:15:13.910799 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ea7f22-c3a7-4a97-a933-b0e8b9952dae" path="/var/lib/kubelet/pods/d3ea7f22-c3a7-4a97-a933-b0e8b9952dae/volumes" Jul 14 23:16:09.820590 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:09.820558 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz"] Jul 14 23:16:09.821040 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:09.820903 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ea7f22-c3a7-4a97-a933-b0e8b9952dae" containerName="manager" Jul 14 23:16:09.821040 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:09.820914 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ea7f22-c3a7-4a97-a933-b0e8b9952dae" containerName="manager" Jul 14 23:16:09.821040 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:09.820978 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ea7f22-c3a7-4a97-a933-b0e8b9952dae" containerName="manager" Jul 14 23:16:09.825195 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:09.825179 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz" Jul 14 23:16:09.828002 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:09.827980 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ckxkq\"" Jul 14 23:16:09.835973 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:09.835948 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz"] Jul 14 23:16:09.890677 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:09.890637 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd2e2656-e3c5-4d8d-87ff-64e89abeb415-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r6gwz\" (UID: \"dd2e2656-e3c5-4d8d-87ff-64e89abeb415\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz" Jul 14 23:16:09.890880 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:09.890723 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48rwh\" (UniqueName: \"kubernetes.io/projected/dd2e2656-e3c5-4d8d-87ff-64e89abeb415-kube-api-access-48rwh\") pod \"kuadrant-operator-controller-manager-86878c769f-r6gwz\" (UID: \"dd2e2656-e3c5-4d8d-87ff-64e89abeb415\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz" Jul 14 23:16:09.991875 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:09.991829 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48rwh\" (UniqueName: \"kubernetes.io/projected/dd2e2656-e3c5-4d8d-87ff-64e89abeb415-kube-api-access-48rwh\") pod \"kuadrant-operator-controller-manager-86878c769f-r6gwz\" (UID: \"dd2e2656-e3c5-4d8d-87ff-64e89abeb415\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz" Jul 14 23:16:09.992076 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:09.991915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd2e2656-e3c5-4d8d-87ff-64e89abeb415-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r6gwz\" (UID: \"dd2e2656-e3c5-4d8d-87ff-64e89abeb415\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz" Jul 14 23:16:09.992298 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:09.992278 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd2e2656-e3c5-4d8d-87ff-64e89abeb415-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r6gwz\" (UID: \"dd2e2656-e3c5-4d8d-87ff-64e89abeb415\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz" Jul 14 23:16:10.000857 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:10.000829 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48rwh\" (UniqueName: \"kubernetes.io/projected/dd2e2656-e3c5-4d8d-87ff-64e89abeb415-kube-api-access-48rwh\") pod \"kuadrant-operator-controller-manager-86878c769f-r6gwz\" (UID: \"dd2e2656-e3c5-4d8d-87ff-64e89abeb415\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz" Jul 14 23:16:10.136774 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:10.136678 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz" Jul 14 23:16:10.275797 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:10.275769 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz"] Jul 14 23:16:10.277942 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:16:10.277916 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2e2656_e3c5_4d8d_87ff_64e89abeb415.slice/crio-53a6c46896b320b7a681c8e1334b876f514dada5496ef8051a11f9756d117845 WatchSource:0}: Error finding container 53a6c46896b320b7a681c8e1334b876f514dada5496ef8051a11f9756d117845: Status 404 returned error can't find the container with id 53a6c46896b320b7a681c8e1334b876f514dada5496ef8051a11f9756d117845 Jul 14 23:16:10.699297 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:10.699261 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz" event={"ID":"dd2e2656-e3c5-4d8d-87ff-64e89abeb415","Type":"ContainerStarted","Data":"3120c9c0c1eaa9f61aeebd97a094bae134512608367aa22977f163b426478eb8"} Jul 14 23:16:10.699505 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:10.699310 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz" event={"ID":"dd2e2656-e3c5-4d8d-87ff-64e89abeb415","Type":"ContainerStarted","Data":"53a6c46896b320b7a681c8e1334b876f514dada5496ef8051a11f9756d117845"} Jul 14 23:16:10.699505 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:10.699442 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz" Jul 14 23:16:10.718429 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:10.718382 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz" podStartSLOduration=1.718368543 podStartE2EDuration="1.718368543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:16:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:16:10.716929238 +0000 UTC m=+1159.333590932" watchObservedRunningTime="2026-07-14 23:16:10.718368543 +0000 UTC m=+1159.335030237" Jul 14 23:16:21.707019 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:21.706940 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6gwz" Jul 14 23:16:51.925226 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:51.925188 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:16:51.928000 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:51.927975 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:16:51.930230 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:51.930209 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:16:51.933061 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:16:51.933042 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:17:58.181125 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:17:58.181046 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:18:06.432812 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:18:06.432768 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:18:32.524896 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:18:32.524863 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:18:32.648307 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:18:32.648272 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:21:51.964983 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:21:51.964951 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:21:51.968707 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:21:51.968685 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:21:51.972078 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:21:51.972053 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:21:51.977376 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:21:51.977356 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:21:53.055149 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:21:53.055114 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:21:59.437194 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:21:59.437157 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:07.702110 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:07.702079 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:12.800426 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:12.800391 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:15.863305 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:15.863207 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:15.961993 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:15.961957 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:16.319779 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:16.319743 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:21.962145 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:21.962096 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:22.025581 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:22.025518 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:22.185341 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:22.185300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:22.283535 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:22.283442 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:23.363251 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:23.363211 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:23.466360 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:23.466327 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:23.596188 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:23.596155 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:23.851573 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:23.851502 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:24.158451 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:24.158420 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:24.266258 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:24.266221 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:22:25.917239 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:22:25.917202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:29.210756 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:29.210718 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:33.545050 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:33.545013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:39.536793 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:39.536758 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:39.595860 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:39.595822 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:42.389532 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:42.389490 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:42.490487 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:42.490433 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:43.734163 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:43.734126 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:44.096785 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:44.096697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:44.196642 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:44.196535 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:44.298894 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:44.298854 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:45.536025 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:45.535987 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:45.717844 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:45.717803 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:45.897179 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:45.897079 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:46.263805 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:46.263766 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:46.364478 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:46.364443 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:50.050515 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:50.050481 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx"] Jul 14 23:23:50.054759 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:50.054733 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx" Jul 14 23:23:50.057645 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:50.057621 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jw626\"" Jul 14 23:23:50.064215 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:50.064189 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx"] Jul 14 23:23:50.073596 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:50.073557 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:50.171013 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:50.170963 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:50.195943 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:50.195907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c001700-1694-4992-ac28-f15e52a6d3a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx\" (UID: \"2c001700-1694-4992-ac28-f15e52a6d3a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx" Jul 14 23:23:50.297163 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:50.297119 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c001700-1694-4992-ac28-f15e52a6d3a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx\" (UID: \"2c001700-1694-4992-ac28-f15e52a6d3a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx" Jul 14 23:23:50.297800 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:50.297781 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c001700-1694-4992-ac28-f15e52a6d3a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx\" (UID: \"2c001700-1694-4992-ac28-f15e52a6d3a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx" Jul 14 23:23:50.370280 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:50.370202 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx" Jul 14 23:23:50.506872 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:50.506844 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx"] Jul 14 23:23:50.508251 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:23:50.508227 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c001700_1694_4992_ac28_f15e52a6d3a8.slice/crio-295d1091d6fc3a9c3e2386f3d885c86bf491f88cc19eadf82571d5998fdbcb3d WatchSource:0}: Error finding container 295d1091d6fc3a9c3e2386f3d885c86bf491f88cc19eadf82571d5998fdbcb3d: Status 404 returned error can't find the container with id 295d1091d6fc3a9c3e2386f3d885c86bf491f88cc19eadf82571d5998fdbcb3d Jul 14 23:23:50.510187 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:50.510168 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 23:23:51.075236 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:51.075202 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx" event={"ID":"2c001700-1694-4992-ac28-f15e52a6d3a8","Type":"ContainerStarted","Data":"295d1091d6fc3a9c3e2386f3d885c86bf491f88cc19eadf82571d5998fdbcb3d"} Jul 14 23:23:53.649136 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:53.649099 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:23:54.093793 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:54.093758 2572 generic.go:356] "Generic (PLEG): container finished" podID="2c001700-1694-4992-ac28-f15e52a6d3a8" containerID="d89c7b05e5aa7cfacba162b53974a977afad3b07eb0af992d89698b3d3c86c6c" exitCode=7 Jul 14 23:23:54.093967 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:54.093838 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx" event={"ID":"2c001700-1694-4992-ac28-f15e52a6d3a8","Type":"ContainerDied","Data":"d89c7b05e5aa7cfacba162b53974a977afad3b07eb0af992d89698b3d3c86c6c"} Jul 14 23:23:54.094012 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:54.093998 2572 scope.go:117] "RemoveContainer" containerID="d89c7b05e5aa7cfacba162b53974a977afad3b07eb0af992d89698b3d3c86c6c" Jul 14 23:23:55.100338 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:55.100301 2572 generic.go:356] "Generic (PLEG): container finished" podID="2c001700-1694-4992-ac28-f15e52a6d3a8" containerID="4b087bdf44060161b199be3f7113e1229be1517c92af26810be40239b5971d12" exitCode=0 Jul 14 23:23:55.100766 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:55.100364 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx" event={"ID":"2c001700-1694-4992-ac28-f15e52a6d3a8","Type":"ContainerDied","Data":"4b087bdf44060161b199be3f7113e1229be1517c92af26810be40239b5971d12"} Jul 14 23:23:55.100766 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:55.100451 2572 scope.go:117] "RemoveContainer" containerID="d89c7b05e5aa7cfacba162b53974a977afad3b07eb0af992d89698b3d3c86c6c" Jul 14 23:23:56.243155 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:56.243131 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx" Jul 14 23:23:56.350632 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:56.350599 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c001700-1694-4992-ac28-f15e52a6d3a8-maas-api-service-ca\") pod \"2c001700-1694-4992-ac28-f15e52a6d3a8\" (UID: \"2c001700-1694-4992-ac28-f15e52a6d3a8\") " Jul 14 23:23:56.351005 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:56.350982 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c001700-1694-4992-ac28-f15e52a6d3a8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2c001700-1694-4992-ac28-f15e52a6d3a8" (UID: "2c001700-1694-4992-ac28-f15e52a6d3a8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:23:56.451836 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:56.451803 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c001700-1694-4992-ac28-f15e52a6d3a8-maas-api-service-ca\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:23:57.112985 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:57.112957 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx" Jul 14 23:23:57.112985 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:57.112979 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx" event={"ID":"2c001700-1694-4992-ac28-f15e52a6d3a8","Type":"ContainerDied","Data":"295d1091d6fc3a9c3e2386f3d885c86bf491f88cc19eadf82571d5998fdbcb3d"} Jul 14 23:23:57.113215 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:23:57.113027 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="295d1091d6fc3a9c3e2386f3d885c86bf491f88cc19eadf82571d5998fdbcb3d" Jul 14 23:24:00.544433 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:00.544391 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:05.131463 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:05.131399 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:10.866815 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:10.866778 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:10.967368 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:10.967332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:15.342952 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:15.342914 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:15.665536 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:15.665500 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:16.810174 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:16.810139 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:16.907707 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:16.907667 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:17.038009 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:17.037970 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:17.288027 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:17.287996 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:17.622840 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:17.622753 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:17.724604 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:17.724561 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:21.914599 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:21.914568 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn"] Jul 14 23:24:21.914977 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:21.914930 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c001700-1694-4992-ac28-f15e52a6d3a8" containerName="revoke-keys" Jul 14 23:24:21.914977 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:21.914946 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c001700-1694-4992-ac28-f15e52a6d3a8" containerName="revoke-keys" Jul 14 23:24:21.914977 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:21.914958 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c001700-1694-4992-ac28-f15e52a6d3a8" containerName="revoke-keys" Jul 14 23:24:21.914977 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:21.914964 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c001700-1694-4992-ac28-f15e52a6d3a8" containerName="revoke-keys" Jul 14 23:24:21.915105 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:21.915024 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c001700-1694-4992-ac28-f15e52a6d3a8" containerName="revoke-keys" Jul 14 23:24:21.915105 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:21.915035 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c001700-1694-4992-ac28-f15e52a6d3a8" containerName="revoke-keys" Jul 14 23:24:21.917934 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:21.917905 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:21.918601 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:21.918585 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" Jul 14 23:24:21.921247 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:21.921226 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jw626\"" Jul 14 23:24:21.930299 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:21.928516 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn"] Jul 14 23:24:21.974800 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:21.974751 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:21.977939 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:21.977910 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54ea0d4-40b5-49eb-b92a-927d31c91fdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn\" (UID: \"f54ea0d4-40b5-49eb-b92a-927d31c91fdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" Jul 14 23:24:22.079007 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:22.078966 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54ea0d4-40b5-49eb-b92a-927d31c91fdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn\" (UID: \"f54ea0d4-40b5-49eb-b92a-927d31c91fdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" Jul 14 23:24:22.079640 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:22.079615 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54ea0d4-40b5-49eb-b92a-927d31c91fdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn\" (UID: \"f54ea0d4-40b5-49eb-b92a-927d31c91fdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" Jul 14 23:24:22.238666 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:22.238636 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" Jul 14 23:24:22.578266 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:22.578234 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn"] Jul 14 23:24:22.579306 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:24:22.579267 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54ea0d4_40b5_49eb_b92a_927d31c91fdd.slice/crio-32f0ce1429081895d23b8541f1d0c4cc45167c3fb07a027dec800aaa52959d8b WatchSource:0}: Error finding container 32f0ce1429081895d23b8541f1d0c4cc45167c3fb07a027dec800aaa52959d8b: Status 404 returned error can't find the container with id 32f0ce1429081895d23b8541f1d0c4cc45167c3fb07a027dec800aaa52959d8b Jul 14 23:24:23.252674 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:23.252640 2572 generic.go:356] "Generic (PLEG): container finished" podID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" containerID="e26dc652a0d666e254f916b36ad4789b1305b4d2ab4959f14d0bb51e3129ff2f" exitCode=7 Jul 14 23:24:23.253090 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:23.252734 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" event={"ID":"f54ea0d4-40b5-49eb-b92a-927d31c91fdd","Type":"ContainerDied","Data":"e26dc652a0d666e254f916b36ad4789b1305b4d2ab4959f14d0bb51e3129ff2f"} Jul 14 23:24:23.253090 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:23.252789 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" event={"ID":"f54ea0d4-40b5-49eb-b92a-927d31c91fdd","Type":"ContainerStarted","Data":"32f0ce1429081895d23b8541f1d0c4cc45167c3fb07a027dec800aaa52959d8b"} Jul 14 23:24:23.253090 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:23.252875 2572 scope.go:117] "RemoveContainer" containerID="e26dc652a0d666e254f916b36ad4789b1305b4d2ab4959f14d0bb51e3129ff2f" Jul 14 23:24:24.259426 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:24.259394 2572 generic.go:356] "Generic (PLEG): container finished" podID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" containerID="26adef8872739576d926a534ed292d870b3e18340ce570b091611420bbca95ea" exitCode=7 Jul 14 23:24:24.259893 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:24.259458 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" event={"ID":"f54ea0d4-40b5-49eb-b92a-927d31c91fdd","Type":"ContainerDied","Data":"26adef8872739576d926a534ed292d870b3e18340ce570b091611420bbca95ea"} Jul 14 23:24:24.259893 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:24.259499 2572 scope.go:117] "RemoveContainer" containerID="e26dc652a0d666e254f916b36ad4789b1305b4d2ab4959f14d0bb51e3129ff2f" Jul 14 23:24:24.259893 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:24.259682 2572 scope.go:117] "RemoveContainer" containerID="26adef8872739576d926a534ed292d870b3e18340ce570b091611420bbca95ea" Jul 14 23:24:24.260058 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:24:24.259930 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn_odh-ai-gateway-infra(f54ea0d4-40b5-49eb-b92a-927d31c91fdd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" podUID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" Jul 14 23:24:25.266297 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:25.266252 2572 scope.go:117] "RemoveContainer" containerID="26adef8872739576d926a534ed292d870b3e18340ce570b091611420bbca95ea" Jul 14 23:24:25.266710 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:24:25.266428 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn_odh-ai-gateway-infra(f54ea0d4-40b5-49eb-b92a-927d31c91fdd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" podUID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" Jul 14 23:24:25.870562 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:25.870510 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:24:36.904806 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:36.904773 2572 scope.go:117] "RemoveContainer" containerID="26adef8872739576d926a534ed292d870b3e18340ce570b091611420bbca95ea" Jul 14 23:24:37.329763 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:37.329726 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" event={"ID":"f54ea0d4-40b5-49eb-b92a-927d31c91fdd","Type":"ContainerStarted","Data":"e588185bcad154753615b652eba9791bcf33a55bd947e65ac052024b2ad672a4"} Jul 14 23:24:37.351409 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:37.351355 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" podStartSLOduration=16.351338422 podStartE2EDuration="16.351338422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:24:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:24:37.349258974 +0000 UTC m=+1665.965920671" watchObservedRunningTime="2026-07-14 23:24:37.351338422 +0000 UTC m=+1665.968000115" Jul 14 23:24:38.337626 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:38.337589 2572 generic.go:356] "Generic (PLEG): container finished" podID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" containerID="e588185bcad154753615b652eba9791bcf33a55bd947e65ac052024b2ad672a4" exitCode=0 Jul 14 23:24:38.338076 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:38.337663 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" event={"ID":"f54ea0d4-40b5-49eb-b92a-927d31c91fdd","Type":"ContainerDied","Data":"e588185bcad154753615b652eba9791bcf33a55bd947e65ac052024b2ad672a4"} Jul 14 23:24:38.338076 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:38.337722 2572 scope.go:117] "RemoveContainer" containerID="26adef8872739576d926a534ed292d870b3e18340ce570b091611420bbca95ea" Jul 14 23:24:38.364327 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:38.364298 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn"] Jul 14 23:24:39.483439 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:39.483408 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" Jul 14 23:24:39.640603 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:39.640467 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54ea0d4-40b5-49eb-b92a-927d31c91fdd-maas-api-service-ca\") pod \"f54ea0d4-40b5-49eb-b92a-927d31c91fdd\" (UID: \"f54ea0d4-40b5-49eb-b92a-927d31c91fdd\") " Jul 14 23:24:39.640849 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:39.640826 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f54ea0d4-40b5-49eb-b92a-927d31c91fdd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f54ea0d4-40b5-49eb-b92a-927d31c91fdd" (UID: "f54ea0d4-40b5-49eb-b92a-927d31c91fdd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:24:39.741941 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:39.741888 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54ea0d4-40b5-49eb-b92a-927d31c91fdd-maas-api-service-ca\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:24:40.351413 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:40.351333 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" Jul 14 23:24:40.351413 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:40.351372 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn" event={"ID":"f54ea0d4-40b5-49eb-b92a-927d31c91fdd","Type":"ContainerDied","Data":"32f0ce1429081895d23b8541f1d0c4cc45167c3fb07a027dec800aaa52959d8b"} Jul 14 23:24:40.351613 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:40.351421 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32f0ce1429081895d23b8541f1d0c4cc45167c3fb07a027dec800aaa52959d8b" Jul 14 23:24:40.383254 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:40.383217 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn"] Jul 14 23:24:40.385284 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:40.385259 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c1ba7d12-q67sn"] Jul 14 23:24:41.910792 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:41.910762 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" path="/var/lib/kubelet/pods/f54ea0d4-40b5-49eb-b92a-927d31c91fdd/volumes" Jul 14 23:24:53.500934 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:24:53.500881 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:21.558582 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:21.558477 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:21.616103 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:21.616064 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:22.555063 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:22.555028 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:27.046482 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:27.046436 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:32.726750 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:32.726715 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:32.826396 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:32.826360 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:38.145066 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:38.145026 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:38.421789 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:38.421757 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:39.533996 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:39.533954 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:39.627291 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:39.627260 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:39.703784 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:39.703729 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:40.052058 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:40.052017 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:40.308345 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:40.308258 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:40.409737 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:40.409699 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:41.696516 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:41.696477 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:41.783552 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:41.783509 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:42.455004 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:42.454959 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:42.561577 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:42.561525 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:43.930777 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:43.930741 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw"] Jul 14 23:25:43.931253 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:43.931129 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" containerName="revoke-keys" Jul 14 23:25:43.931253 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:43.931146 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" containerName="revoke-keys" Jul 14 23:25:43.931253 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:43.931160 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" containerName="revoke-keys" Jul 14 23:25:43.931253 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:43.931166 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" containerName="revoke-keys" Jul 14 23:25:43.931253 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:43.931232 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" containerName="revoke-keys" Jul 14 23:25:43.931253 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:43.931242 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" containerName="revoke-keys" Jul 14 23:25:43.931253 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:43.931249 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" containerName="revoke-keys" Jul 14 23:25:43.934240 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:43.934221 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" Jul 14 23:25:43.936979 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:43.936957 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jw626\"" Jul 14 23:25:43.941696 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:43.941670 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw"] Jul 14 23:25:44.012741 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:44.012706 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec0cd08-9777-4e18-8c8d-34bab48a7774-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-758a442d-gklqw\" (UID: \"9ec0cd08-9777-4e18-8c8d-34bab48a7774\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" Jul 14 23:25:44.114004 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:44.113968 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec0cd08-9777-4e18-8c8d-34bab48a7774-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-758a442d-gklqw\" (UID: \"9ec0cd08-9777-4e18-8c8d-34bab48a7774\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" Jul 14 23:25:44.114664 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:44.114643 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec0cd08-9777-4e18-8c8d-34bab48a7774-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-758a442d-gklqw\" (UID: \"9ec0cd08-9777-4e18-8c8d-34bab48a7774\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" Jul 14 23:25:44.248165 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:44.248083 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" Jul 14 23:25:44.444379 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:44.444346 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:44.506079 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:44.505977 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:44.592449 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:44.592417 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw"] Jul 14 23:25:44.594214 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:25:44.594187 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec0cd08_9777_4e18_8c8d_34bab48a7774.slice/crio-e9fcad312c7f5bed8a67f569e365d931fdcf55bf25b0657fadfeea117f5670ce WatchSource:0}: Error finding container e9fcad312c7f5bed8a67f569e365d931fdcf55bf25b0657fadfeea117f5670ce: Status 404 returned error can't find the container with id e9fcad312c7f5bed8a67f569e365d931fdcf55bf25b0657fadfeea117f5670ce Jul 14 23:25:44.695271 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:44.695230 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" event={"ID":"9ec0cd08-9777-4e18-8c8d-34bab48a7774","Type":"ContainerStarted","Data":"e9fcad312c7f5bed8a67f569e365d931fdcf55bf25b0657fadfeea117f5670ce"} Jul 14 23:25:45.701402 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:45.701372 2572 generic.go:356] "Generic (PLEG): container finished" podID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" containerID="c37afe093bb2a04609d4e4dbcce819fc79646320da3bf17d7b693210f77e2339" exitCode=7 Jul 14 23:25:45.701818 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:45.701429 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" event={"ID":"9ec0cd08-9777-4e18-8c8d-34bab48a7774","Type":"ContainerDied","Data":"c37afe093bb2a04609d4e4dbcce819fc79646320da3bf17d7b693210f77e2339"} Jul 14 23:25:45.701818 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:45.701688 2572 scope.go:117] "RemoveContainer" containerID="c37afe093bb2a04609d4e4dbcce819fc79646320da3bf17d7b693210f77e2339" Jul 14 23:25:46.709462 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:46.709424 2572 generic.go:356] "Generic (PLEG): container finished" podID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" containerID="dbc1cf0e3f0fc8570d1734853fc8795737d02c502d6a573ebe5d68e19f0f03d3" exitCode=7 Jul 14 23:25:46.709943 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:46.709519 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" event={"ID":"9ec0cd08-9777-4e18-8c8d-34bab48a7774","Type":"ContainerDied","Data":"dbc1cf0e3f0fc8570d1734853fc8795737d02c502d6a573ebe5d68e19f0f03d3"} Jul 14 23:25:46.709943 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:46.709647 2572 scope.go:117] "RemoveContainer" containerID="c37afe093bb2a04609d4e4dbcce819fc79646320da3bf17d7b693210f77e2339" Jul 14 23:25:46.709943 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:46.709705 2572 scope.go:117] "RemoveContainer" containerID="dbc1cf0e3f0fc8570d1734853fc8795737d02c502d6a573ebe5d68e19f0f03d3" Jul 14 23:25:46.709943 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:25:46.709936 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-758a442d-gklqw_odh-ai-gateway-infra(9ec0cd08-9777-4e18-8c8d-34bab48a7774)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" podUID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" Jul 14 23:25:47.715332 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:47.715293 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:25:47.717099 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:47.717079 2572 scope.go:117] "RemoveContainer" containerID="dbc1cf0e3f0fc8570d1734853fc8795737d02c502d6a573ebe5d68e19f0f03d3" Jul 14 23:25:47.717296 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:25:47.717280 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-758a442d-gklqw_odh-ai-gateway-infra(9ec0cd08-9777-4e18-8c8d-34bab48a7774)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" podUID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" Jul 14 23:25:59.904861 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:25:59.904824 2572 scope.go:117] "RemoveContainer" containerID="dbc1cf0e3f0fc8570d1734853fc8795737d02c502d6a573ebe5d68e19f0f03d3" Jul 14 23:26:00.788248 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:00.788217 2572 generic.go:356] "Generic (PLEG): container finished" podID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" containerID="0e3ff7e6116ca1a7ee934b87225f4b0ea74691e07bebdc2f8c110c8606891629" exitCode=0 Jul 14 23:26:00.788445 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:00.788280 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" event={"ID":"9ec0cd08-9777-4e18-8c8d-34bab48a7774","Type":"ContainerDied","Data":"0e3ff7e6116ca1a7ee934b87225f4b0ea74691e07bebdc2f8c110c8606891629"} Jul 14 23:26:00.788445 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:00.788340 2572 scope.go:117] "RemoveContainer" containerID="dbc1cf0e3f0fc8570d1734853fc8795737d02c502d6a573ebe5d68e19f0f03d3" Jul 14 23:26:01.816755 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:01.816719 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw"] Jul 14 23:26:01.926860 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:01.926828 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" Jul 14 23:26:02.068978 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:02.068891 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec0cd08-9777-4e18-8c8d-34bab48a7774-maas-api-service-ca\") pod \"9ec0cd08-9777-4e18-8c8d-34bab48a7774\" (UID: \"9ec0cd08-9777-4e18-8c8d-34bab48a7774\") " Jul 14 23:26:02.069369 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:02.069339 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ec0cd08-9777-4e18-8c8d-34bab48a7774-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9ec0cd08-9777-4e18-8c8d-34bab48a7774" (UID: "9ec0cd08-9777-4e18-8c8d-34bab48a7774"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:26:02.170373 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:02.170337 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ec0cd08-9777-4e18-8c8d-34bab48a7774-maas-api-service-ca\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:26:02.802098 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:02.802063 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" Jul 14 23:26:02.802279 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:02.802102 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw" event={"ID":"9ec0cd08-9777-4e18-8c8d-34bab48a7774","Type":"ContainerDied","Data":"e9fcad312c7f5bed8a67f569e365d931fdcf55bf25b0657fadfeea117f5670ce"} Jul 14 23:26:02.802279 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:02.802150 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9fcad312c7f5bed8a67f569e365d931fdcf55bf25b0657fadfeea117f5670ce" Jul 14 23:26:02.832878 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:02.832847 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw"] Jul 14 23:26:02.836137 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:02.836110 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-gklqw"] Jul 14 23:26:03.909980 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:03.909937 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" path="/var/lib/kubelet/pods/9ec0cd08-9777-4e18-8c8d-34bab48a7774/volumes" Jul 14 23:26:18.736708 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:18.736677 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:26:33.977155 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.977118 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4"] Jul 14 23:26:33.977595 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.977465 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" containerName="revoke-keys" Jul 14 23:26:33.977595 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.977476 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f54ea0d4-40b5-49eb-b92a-927d31c91fdd" containerName="revoke-keys" Jul 14 23:26:33.977595 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.977485 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" containerName="revoke-keys" Jul 14 23:26:33.977595 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.977491 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" containerName="revoke-keys" Jul 14 23:26:33.977595 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.977500 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" containerName="revoke-keys" Jul 14 23:26:33.977595 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.977505 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" containerName="revoke-keys" Jul 14 23:26:33.977595 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.977520 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" containerName="revoke-keys" Jul 14 23:26:33.977595 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.977526 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" containerName="revoke-keys" Jul 14 23:26:33.977595 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.977599 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" containerName="revoke-keys" Jul 14 23:26:33.977877 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.977607 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" containerName="revoke-keys" Jul 14 23:26:33.988518 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.988466 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4" Jul 14 23:26:33.989318 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.989289 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4"] Jul 14 23:26:33.991684 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:33.991660 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jw626\"" Jul 14 23:26:34.049145 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:34.049105 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d969bcef-97f8-49fd-83c7-e4adf4e2f403-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-758a442d-znbh4\" (UID: \"d969bcef-97f8-49fd-83c7-e4adf4e2f403\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4" Jul 14 23:26:34.150409 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:34.150376 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d969bcef-97f8-49fd-83c7-e4adf4e2f403-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-758a442d-znbh4\" (UID: \"d969bcef-97f8-49fd-83c7-e4adf4e2f403\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4" Jul 14 23:26:34.151033 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:34.151014 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d969bcef-97f8-49fd-83c7-e4adf4e2f403-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-758a442d-znbh4\" (UID: \"d969bcef-97f8-49fd-83c7-e4adf4e2f403\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4" Jul 14 23:26:34.300309 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:34.300215 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4" Jul 14 23:26:34.644868 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:34.643922 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4"] Jul 14 23:26:34.647483 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:26:34.647445 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd969bcef_97f8_49fd_83c7_e4adf4e2f403.slice/crio-fb028b9bf1eaa29ac2cc113183e4bd58827bece5df20e700bae8f75015d7e826 WatchSource:0}: Error finding container fb028b9bf1eaa29ac2cc113183e4bd58827bece5df20e700bae8f75015d7e826: Status 404 returned error can't find the container with id fb028b9bf1eaa29ac2cc113183e4bd58827bece5df20e700bae8f75015d7e826 Jul 14 23:26:34.974974 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:34.974937 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4" event={"ID":"d969bcef-97f8-49fd-83c7-e4adf4e2f403","Type":"ContainerStarted","Data":"3ac2abfe1bed676dcee5c44c82156e250b8b54dcc12cd5c2b031c1f525493e73"} Jul 14 23:26:34.975161 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:34.975003 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4" event={"ID":"d969bcef-97f8-49fd-83c7-e4adf4e2f403","Type":"ContainerStarted","Data":"fb028b9bf1eaa29ac2cc113183e4bd58827bece5df20e700bae8f75015d7e826"} Jul 14 23:26:34.993936 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:34.993881 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4" podStartSLOduration=1.993864155 podStartE2EDuration="1.993864155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:26:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:26:34.992022952 +0000 UTC m=+1783.608684648" watchObservedRunningTime="2026-07-14 23:26:34.993864155 +0000 UTC m=+1783.610525848" Jul 14 23:26:35.981115 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:35.981079 2572 generic.go:356] "Generic (PLEG): container finished" podID="d969bcef-97f8-49fd-83c7-e4adf4e2f403" containerID="3ac2abfe1bed676dcee5c44c82156e250b8b54dcc12cd5c2b031c1f525493e73" exitCode=0 Jul 14 23:26:35.981306 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:35.981171 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4" event={"ID":"d969bcef-97f8-49fd-83c7-e4adf4e2f403","Type":"ContainerDied","Data":"3ac2abfe1bed676dcee5c44c82156e250b8b54dcc12cd5c2b031c1f525493e73"} Jul 14 23:26:37.123920 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:37.123895 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4" Jul 14 23:26:37.175039 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:37.175008 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d969bcef-97f8-49fd-83c7-e4adf4e2f403-maas-api-service-ca\") pod \"d969bcef-97f8-49fd-83c7-e4adf4e2f403\" (UID: \"d969bcef-97f8-49fd-83c7-e4adf4e2f403\") " Jul 14 23:26:37.175362 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:37.175341 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d969bcef-97f8-49fd-83c7-e4adf4e2f403-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d969bcef-97f8-49fd-83c7-e4adf4e2f403" (UID: "d969bcef-97f8-49fd-83c7-e4adf4e2f403"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:26:37.276020 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:37.275924 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d969bcef-97f8-49fd-83c7-e4adf4e2f403-maas-api-service-ca\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:26:37.993508 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:37.993479 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4" Jul 14 23:26:37.993704 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:37.993472 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-758a442d-znbh4" event={"ID":"d969bcef-97f8-49fd-83c7-e4adf4e2f403","Type":"ContainerDied","Data":"fb028b9bf1eaa29ac2cc113183e4bd58827bece5df20e700bae8f75015d7e826"} Jul 14 23:26:37.993704 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:37.993590 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb028b9bf1eaa29ac2cc113183e4bd58827bece5df20e700bae8f75015d7e826" Jul 14 23:26:44.558945 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:44.558861 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:26:49.067805 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:49.067760 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:26:52.009532 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:52.009505 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:26:52.013821 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:52.013798 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:26:52.013967 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:52.013870 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:26:52.018637 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:52.018618 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:26:55.219967 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:55.219918 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:26:56.457509 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:56.457475 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:26:59.284204 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:59.284169 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:26:59.854780 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:59.854739 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:26:59.952885 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:26:59.952846 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:00.053054 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:00.053021 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:01.495139 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:01.495104 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:05.604600 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:05.604563 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:07.168122 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:07.168084 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:07.229531 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:07.229491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:07.314653 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:07.314614 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:07.411471 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:07.411426 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:07.511168 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:07.511079 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:07.881035 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:07.880941 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:33.840638 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:33.840595 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:39.593182 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:39.593143 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:39.697271 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:39.697229 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:39.795017 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:39.794985 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:27:55.690661 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:27:55.690627 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:01.300279 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:01.300239 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:01.367453 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:01.367421 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:01.451117 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:01.451066 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:01.551353 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:01.551269 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:12.059254 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:12.059217 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:12.864783 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:12.864741 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:18.513864 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:18.513767 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:18.621282 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:18.621248 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:18.717024 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:18.716984 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:18.814461 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:18.814383 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:19.609227 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:19.609184 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:19.688264 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:19.688221 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:19.787818 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:19.787781 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:21.385968 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:21.385928 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:27.094719 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:27.094676 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:27.195298 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:27.195254 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:27.823393 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:27.823359 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:33.663728 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:33.663695 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:33.730715 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:33.730676 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:33.918451 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:33.918359 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:34.243953 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:34.243854 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:34.419431 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:34.419383 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:37.549341 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:37.549300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:37.640798 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:37.640743 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:37.717987 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:37.717935 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:38.009661 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:38.009622 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:38.231194 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:38.231142 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:38.332344 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:38.332238 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:42.046688 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:42.046646 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:42.691025 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:42.690981 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:42.788094 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:42.788056 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:43.134147 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:43.134047 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:49.036444 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:49.036408 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:49.103612 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:49.103578 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:28:59.943019 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:28:59.942982 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:04.476045 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:04.476007 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:10.177270 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:10.177236 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:10.244915 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:10.244877 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:15.196296 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:15.196257 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:15.436068 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:15.436022 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:15.567325 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:15.567233 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:15.664245 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:15.664204 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:15.785204 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:15.785154 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:21.435870 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:21.435830 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:21.542833 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:21.542797 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:21.635694 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:21.635662 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:21.783841 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:21.783745 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:27.481919 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:27.481884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:27.583265 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:27.583232 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:34.317115 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:34.317073 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:34.649637 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:34.649521 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:35.191126 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:35.191090 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:37.805645 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:37.805590 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:37.876224 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:37.876192 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:37.950721 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:37.950682 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:38.136273 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:38.136163 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:38.570614 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:38.570576 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:38.670836 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:38.670783 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:42.291165 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:42.291120 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:29:53.633606 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:29:53.633463 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:30:00.134025 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.133985 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734530-9l9f5"] Jul 14 23:30:00.134526 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.134346 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d969bcef-97f8-49fd-83c7-e4adf4e2f403" containerName="revoke-keys" Jul 14 23:30:00.134526 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.134357 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d969bcef-97f8-49fd-83c7-e4adf4e2f403" containerName="revoke-keys" Jul 14 23:30:00.134526 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.134428 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec0cd08-9777-4e18-8c8d-34bab48a7774" containerName="revoke-keys" Jul 14 23:30:00.134526 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.134438 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d969bcef-97f8-49fd-83c7-e4adf4e2f403" containerName="revoke-keys" Jul 14 23:30:00.137484 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.137463 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w"] Jul 14 23:30:00.137633 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.137607 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734530-9l9f5" Jul 14 23:30:00.140570 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.140514 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jw626\"" Jul 14 23:30:00.140889 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.140855 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w" Jul 14 23:30:00.144207 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.144182 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w"] Jul 14 23:30:00.147240 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.147217 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734530-9l9f5"] Jul 14 23:30:00.151050 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.151028 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734530-9l9f5" Jul 14 23:30:00.157795 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.157773 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w" Jul 14 23:30:00.307281 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.307204 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734530-9l9f5"] Jul 14 23:30:00.308077 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:30:00.308043 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda194475d_c841_4893_8e92_3fb23e2e890d.slice/crio-ea7af8a139f1a9439f0e4eac38880ec074d3a267ddf0384a1af5642f2a948fb7 WatchSource:0}: Error finding container ea7af8a139f1a9439f0e4eac38880ec074d3a267ddf0384a1af5642f2a948fb7: Status 404 returned error can't find the container with id ea7af8a139f1a9439f0e4eac38880ec074d3a267ddf0384a1af5642f2a948fb7 Jul 14 23:30:00.327058 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:00.327032 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w"] Jul 14 23:30:00.328076 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:30:00.328039 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc622e9b0_79dc_4055_94f3_5502714abe96.slice/crio-67308356e59205f05d1bc7205cbf144a60845adb21e781fc341016c91a18ed7d WatchSource:0}: Error finding container 67308356e59205f05d1bc7205cbf144a60845adb21e781fc341016c91a18ed7d: Status 404 returned error can't find the container with id 67308356e59205f05d1bc7205cbf144a60845adb21e781fc341016c91a18ed7d Jul 14 23:30:01.088876 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:01.088833 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734530-9l9f5" event={"ID":"a194475d-c841-4893-8e92-3fb23e2e890d","Type":"ContainerStarted","Data":"df67981aecfd093f5f17bf92b8977c5b266ff0f665bacaf0d29170aa269f3b33"} Jul 14 23:30:01.089086 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:01.088893 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734530-9l9f5" event={"ID":"a194475d-c841-4893-8e92-3fb23e2e890d","Type":"ContainerStarted","Data":"ea7af8a139f1a9439f0e4eac38880ec074d3a267ddf0384a1af5642f2a948fb7"} Jul 14 23:30:01.090432 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:01.090406 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w" event={"ID":"c622e9b0-79dc-4055-94f3-5502714abe96","Type":"ContainerStarted","Data":"7568702af8eb4f3c78c69bb2a69ee8e7c970dea17135c321b16d1348df44547f"} Jul 14 23:30:01.090558 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:01.090449 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w" event={"ID":"c622e9b0-79dc-4055-94f3-5502714abe96","Type":"ContainerStarted","Data":"67308356e59205f05d1bc7205cbf144a60845adb21e781fc341016c91a18ed7d"} Jul 14 23:30:01.104527 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:01.104466 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734530-9l9f5" podStartSLOduration=1.104444812 podStartE2EDuration="1.104444812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:30:01.10396209 +0000 UTC m=+1989.720623783" watchObservedRunningTime="2026-07-14 23:30:01.104444812 +0000 UTC m=+1989.721106507" Jul 14 23:30:01.120153 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:01.120100 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w" podStartSLOduration=1.120085204 podStartE2EDuration="1.120085204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:30:01.117848706 +0000 UTC m=+1989.734510395" watchObservedRunningTime="2026-07-14 23:30:01.120085204 +0000 UTC m=+1989.736746897" Jul 14 23:30:02.098684 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:02.098651 2572 generic.go:356] "Generic (PLEG): container finished" podID="a194475d-c841-4893-8e92-3fb23e2e890d" containerID="df67981aecfd093f5f17bf92b8977c5b266ff0f665bacaf0d29170aa269f3b33" exitCode=0 Jul 14 23:30:02.099126 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:02.098740 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734530-9l9f5" event={"ID":"a194475d-c841-4893-8e92-3fb23e2e890d","Type":"ContainerDied","Data":"df67981aecfd093f5f17bf92b8977c5b266ff0f665bacaf0d29170aa269f3b33"} Jul 14 23:30:02.100299 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:02.100275 2572 generic.go:356] "Generic (PLEG): container finished" podID="c622e9b0-79dc-4055-94f3-5502714abe96" containerID="7568702af8eb4f3c78c69bb2a69ee8e7c970dea17135c321b16d1348df44547f" exitCode=0 Jul 14 23:30:02.100421 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:02.100324 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w" event={"ID":"c622e9b0-79dc-4055-94f3-5502714abe96","Type":"ContainerDied","Data":"7568702af8eb4f3c78c69bb2a69ee8e7c970dea17135c321b16d1348df44547f"} Jul 14 23:30:03.259570 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:03.259527 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w" Jul 14 23:30:03.262520 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:03.262499 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734530-9l9f5" Jul 14 23:30:04.111900 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:04.111864 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734530-9l9f5" Jul 14 23:30:04.112084 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:04.111868 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734530-9l9f5" event={"ID":"a194475d-c841-4893-8e92-3fb23e2e890d","Type":"ContainerDied","Data":"ea7af8a139f1a9439f0e4eac38880ec074d3a267ddf0384a1af5642f2a948fb7"} Jul 14 23:30:04.112084 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:04.111987 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea7af8a139f1a9439f0e4eac38880ec074d3a267ddf0384a1af5642f2a948fb7" Jul 14 23:30:04.113169 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:04.113138 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w" Jul 14 23:30:04.113313 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:04.113143 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w" event={"ID":"c622e9b0-79dc-4055-94f3-5502714abe96","Type":"ContainerDied","Data":"67308356e59205f05d1bc7205cbf144a60845adb21e781fc341016c91a18ed7d"} Jul 14 23:30:04.113313 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:04.113261 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67308356e59205f05d1bc7205cbf144a60845adb21e781fc341016c91a18ed7d" Jul 14 23:30:15.506317 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.506279 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61774e12-v99dd"] Jul 14 23:30:15.506829 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.506812 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c622e9b0-79dc-4055-94f3-5502714abe96" containerName="cleanup" Jul 14 23:30:15.506882 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.506832 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c622e9b0-79dc-4055-94f3-5502714abe96" containerName="cleanup" Jul 14 23:30:15.506882 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.506857 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a194475d-c841-4893-8e92-3fb23e2e890d" containerName="cleanup" Jul 14 23:30:15.506882 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.506862 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a194475d-c841-4893-8e92-3fb23e2e890d" containerName="cleanup" Jul 14 23:30:15.506974 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.506915 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a194475d-c841-4893-8e92-3fb23e2e890d" containerName="cleanup" Jul 14 23:30:15.506974 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.506927 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c622e9b0-79dc-4055-94f3-5502714abe96" containerName="cleanup" Jul 14 23:30:15.509935 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.509918 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61774e12-v99dd" Jul 14 23:30:15.512764 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.512739 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jw626\"" Jul 14 23:30:15.517389 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.517360 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61774e12-v99dd"] Jul 14 23:30:15.622583 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.622518 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ae2b111-660e-4ad2-80fe-f783e9b8613b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-61774e12-v99dd\" (UID: \"6ae2b111-660e-4ad2-80fe-f783e9b8613b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61774e12-v99dd" Jul 14 23:30:15.723758 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.723720 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ae2b111-660e-4ad2-80fe-f783e9b8613b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-61774e12-v99dd\" (UID: \"6ae2b111-660e-4ad2-80fe-f783e9b8613b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61774e12-v99dd" Jul 14 23:30:15.724387 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.724360 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ae2b111-660e-4ad2-80fe-f783e9b8613b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-61774e12-v99dd\" (UID: \"6ae2b111-660e-4ad2-80fe-f783e9b8613b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61774e12-v99dd" Jul 14 23:30:15.822022 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.821939 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61774e12-v99dd" Jul 14 23:30:15.969239 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:15.969213 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61774e12-v99dd"] Jul 14 23:30:15.971060 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:30:15.971021 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae2b111_660e_4ad2_80fe_f783e9b8613b.slice/crio-310d13798b42ddfe0bf46f5e00775126f46ca9de419c2f7fb1c6a323a1113372 WatchSource:0}: Error finding container 310d13798b42ddfe0bf46f5e00775126f46ca9de419c2f7fb1c6a323a1113372: Status 404 returned error can't find the container with id 310d13798b42ddfe0bf46f5e00775126f46ca9de419c2f7fb1c6a323a1113372 Jul 14 23:30:16.180296 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:16.180261 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61774e12-v99dd" event={"ID":"6ae2b111-660e-4ad2-80fe-f783e9b8613b","Type":"ContainerStarted","Data":"310d13798b42ddfe0bf46f5e00775126f46ca9de419c2f7fb1c6a323a1113372"} Jul 14 23:30:17.187613 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:17.187577 2572 generic.go:356] "Generic (PLEG): container finished" podID="6ae2b111-660e-4ad2-80fe-f783e9b8613b" containerID="f3619da565b714a3bf94cefc97cfd4e8438678a8791cc9297ca2b0bd451279f7" exitCode=0 Jul 14 23:30:17.187990 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:17.187666 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61774e12-v99dd" event={"ID":"6ae2b111-660e-4ad2-80fe-f783e9b8613b","Type":"ContainerDied","Data":"f3619da565b714a3bf94cefc97cfd4e8438678a8791cc9297ca2b0bd451279f7"} Jul 14 23:30:18.325142 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:18.325116 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61774e12-v99dd" Jul 14 23:30:18.346526 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:18.346500 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ae2b111-660e-4ad2-80fe-f783e9b8613b-maas-api-service-ca\") pod \"6ae2b111-660e-4ad2-80fe-f783e9b8613b\" (UID: \"6ae2b111-660e-4ad2-80fe-f783e9b8613b\") " Jul 14 23:30:18.346854 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:18.346832 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ae2b111-660e-4ad2-80fe-f783e9b8613b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6ae2b111-660e-4ad2-80fe-f783e9b8613b" (UID: "6ae2b111-660e-4ad2-80fe-f783e9b8613b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:30:18.447581 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:18.447472 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ae2b111-660e-4ad2-80fe-f783e9b8613b-maas-api-service-ca\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:30:19.200302 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:19.200273 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61774e12-v99dd" Jul 14 23:30:19.200479 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:19.200272 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61774e12-v99dd" event={"ID":"6ae2b111-660e-4ad2-80fe-f783e9b8613b","Type":"ContainerDied","Data":"310d13798b42ddfe0bf46f5e00775126f46ca9de419c2f7fb1c6a323a1113372"} Jul 14 23:30:19.200479 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:19.200396 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="310d13798b42ddfe0bf46f5e00775126f46ca9de419c2f7fb1c6a323a1113372" Jul 14 23:30:26.016041 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:26.016009 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w"] Jul 14 23:30:26.019251 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:26.019220 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:30:26.019892 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:26.019871 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-61774e12-29734530-mm86w"] Jul 14 23:30:27.910497 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:27.910463 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c622e9b0-79dc-4055-94f3-5502714abe96" path="/var/lib/kubelet/pods/c622e9b0-79dc-4055-94f3-5502714abe96/volumes" Jul 14 23:30:30.597488 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:30.597449 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:30:35.680825 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:35.680782 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:30:42.488934 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:42.488894 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:30:42.590129 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:42.590079 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:30:52.098343 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:30:52.098307 2572 scope.go:117] "RemoveContainer" containerID="e588185bcad154753615b652eba9791bcf33a55bd947e65ac052024b2ad672a4" Jul 14 23:31:12.186309 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:12.186269 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:12.331223 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:12.331190 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:12.615091 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:12.614992 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:18.766279 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:18.766196 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:18.869078 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:18.869031 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:22.969126 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:22.969086 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:23.194859 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:23.194820 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:24.279424 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:24.279394 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:24.376716 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:24.376673 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:24.478499 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:24.478465 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:25.233191 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:25.233145 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:25.377005 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:25.376970 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:25.525263 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:25.525168 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:26.819328 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:26.819297 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:29.757815 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:29.757783 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:32.719922 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:32.719880 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:32.791017 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:32.790976 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:33.408593 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:33.408554 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:39.398154 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:39.398117 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:39.508248 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:39.508214 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:39.599145 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:39.599104 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:50.132415 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:50.132382 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:50.476712 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:50.476678 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:31:52.051862 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:52.051835 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:31:52.056652 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:52.056624 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:31:52.060748 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:52.060728 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:31:52.066001 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:31:52.065983 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:32:11.460238 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:11.460198 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:17.478534 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:17.478494 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:17.579551 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:17.579513 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:17.834783 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:17.834652 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:18.169765 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:18.169722 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:18.390846 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:18.390805 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:21.592741 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:21.592702 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:21.683514 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:21.683464 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:21.757461 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:21.757422 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:22.239394 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:22.239358 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:22.393485 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:22.393447 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:22.488646 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:22.488615 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:26.100985 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:26.100931 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:26.445352 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:26.445314 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:26.782049 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:26.781948 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:27.050170 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:27.050073 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:29.606463 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:29.606413 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:29.702392 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:29.702360 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:29.779361 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:29.779317 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:30.014357 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:30.014293 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:30.274091 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:30.274005 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:30.374526 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:30.374491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:34.124163 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:34.124116 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:43.176095 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:43.176054 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:43.276628 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:43.276593 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:47.117942 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:47.117905 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:51.044287 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:51.044253 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:51.152118 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:51.152085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:32:52.130081 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:32:52.130046 2572 scope.go:117] "RemoveContainer" containerID="0e3ff7e6116ca1a7ee934b87225f4b0ea74691e07bebdc2f8c110c8606891629" Jul 14 23:33:10.624235 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:10.624187 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:11.867805 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:11.867760 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:11.930383 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:11.930346 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:18.246658 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:18.246620 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:27.465560 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:27.465509 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:28.400013 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:28.399965 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:28.510902 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:28.510869 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr"] Jul 14 23:33:28.511283 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:28.511230 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ae2b111-660e-4ad2-80fe-f783e9b8613b" containerName="revoke-keys" Jul 14 23:33:28.511283 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:28.511241 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ae2b111-660e-4ad2-80fe-f783e9b8613b" containerName="revoke-keys" Jul 14 23:33:28.511357 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:28.511308 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ae2b111-660e-4ad2-80fe-f783e9b8613b" containerName="revoke-keys" Jul 14 23:33:28.514363 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:28.514343 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr" Jul 14 23:33:28.517231 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:28.517210 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jw626\"" Jul 14 23:33:28.523471 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:28.523446 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr"] Jul 14 23:33:28.613863 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:28.613831 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d275336-0844-4308-bde4-216b03b66dd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr\" (UID: \"3d275336-0844-4308-bde4-216b03b66dd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr" Jul 14 23:33:28.714408 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:28.714370 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d275336-0844-4308-bde4-216b03b66dd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr\" (UID: \"3d275336-0844-4308-bde4-216b03b66dd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr" Jul 14 23:33:28.715036 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:28.715014 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d275336-0844-4308-bde4-216b03b66dd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr\" (UID: \"3d275336-0844-4308-bde4-216b03b66dd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr" Jul 14 23:33:28.826873 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:28.826837 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr" Jul 14 23:33:28.964711 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:28.964664 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr"] Jul 14 23:33:28.966929 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:33:28.966894 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d275336_0844_4308_bde4_216b03b66dd3.slice/crio-bb675d74766953bb589ed8a55df679090f7f6705528febfeca180f55d48e68fb WatchSource:0}: Error finding container bb675d74766953bb589ed8a55df679090f7f6705528febfeca180f55d48e68fb: Status 404 returned error can't find the container with id bb675d74766953bb589ed8a55df679090f7f6705528febfeca180f55d48e68fb Jul 14 23:33:29.045057 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:29.045007 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:29.145118 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:29.145072 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:29.225855 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:29.225752 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr" event={"ID":"3d275336-0844-4308-bde4-216b03b66dd3","Type":"ContainerStarted","Data":"bb675d74766953bb589ed8a55df679090f7f6705528febfeca180f55d48e68fb"} Jul 14 23:33:30.232753 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:30.232722 2572 generic.go:356] "Generic (PLEG): container finished" podID="3d275336-0844-4308-bde4-216b03b66dd3" containerID="8a8086b09375b96d66853dab6183e0cb06114fcbe275387b2281514cfd136c01" exitCode=0 Jul 14 23:33:30.233270 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:30.232810 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr" event={"ID":"3d275336-0844-4308-bde4-216b03b66dd3","Type":"ContainerDied","Data":"8a8086b09375b96d66853dab6183e0cb06114fcbe275387b2281514cfd136c01"} Jul 14 23:33:31.369799 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:31.369773 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr" Jul 14 23:33:31.538514 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:31.538438 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d275336-0844-4308-bde4-216b03b66dd3-maas-api-service-ca\") pod \"3d275336-0844-4308-bde4-216b03b66dd3\" (UID: \"3d275336-0844-4308-bde4-216b03b66dd3\") " Jul 14 23:33:31.538849 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:31.538824 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d275336-0844-4308-bde4-216b03b66dd3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3d275336-0844-4308-bde4-216b03b66dd3" (UID: "3d275336-0844-4308-bde4-216b03b66dd3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:33:31.639421 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:31.639387 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d275336-0844-4308-bde4-216b03b66dd3-maas-api-service-ca\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:33:32.245191 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:32.245096 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr" Jul 14 23:33:32.245191 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:32.245094 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr" event={"ID":"3d275336-0844-4308-bde4-216b03b66dd3","Type":"ContainerDied","Data":"bb675d74766953bb589ed8a55df679090f7f6705528febfeca180f55d48e68fb"} Jul 14 23:33:32.245433 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:32.245222 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb675d74766953bb589ed8a55df679090f7f6705528febfeca180f55d48e68fb" Jul 14 23:33:39.122755 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:39.122720 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:43.798378 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:43.798345 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:49.416949 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:49.416906 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:49.517498 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:49.517462 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:54.320460 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:54.320430 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:54.557009 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:54.556972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:54.677644 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:54.677600 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759"] Jul 14 23:33:54.678085 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:54.678067 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d275336-0844-4308-bde4-216b03b66dd3" containerName="revoke-keys" Jul 14 23:33:54.678182 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:54.678088 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d275336-0844-4308-bde4-216b03b66dd3" containerName="revoke-keys" Jul 14 23:33:54.678248 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:54.678184 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d275336-0844-4308-bde4-216b03b66dd3" containerName="revoke-keys" Jul 14 23:33:54.681475 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:54.681452 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759" Jul 14 23:33:54.684478 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:54.684460 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jw626\"" Jul 14 23:33:54.689165 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:54.688835 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759"] Jul 14 23:33:54.738158 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:54.738123 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ac6771-5359-4430-b24f-17808ce66729-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759\" (UID: \"44ac6771-5359-4430-b24f-17808ce66729\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759" Jul 14 23:33:54.839472 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:54.839429 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ac6771-5359-4430-b24f-17808ce66729-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759\" (UID: \"44ac6771-5359-4430-b24f-17808ce66729\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759" Jul 14 23:33:54.840134 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:54.840105 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ac6771-5359-4430-b24f-17808ce66729-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759\" (UID: \"44ac6771-5359-4430-b24f-17808ce66729\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759" Jul 14 23:33:54.993260 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:54.993154 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759" Jul 14 23:33:55.132763 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:55.132736 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759"] Jul 14 23:33:55.134883 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:33:55.134852 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ac6771_5359_4430_b24f_17808ce66729.slice/crio-56b5eee788840eee83c376ae38c515891256712f8988529605cb9637ac5e9a35 WatchSource:0}: Error finding container 56b5eee788840eee83c376ae38c515891256712f8988529605cb9637ac5e9a35: Status 404 returned error can't find the container with id 56b5eee788840eee83c376ae38c515891256712f8988529605cb9637ac5e9a35 Jul 14 23:33:55.205017 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:55.204977 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:55.305241 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:55.305134 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:33:55.364870 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:55.364832 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759" event={"ID":"44ac6771-5359-4430-b24f-17808ce66729","Type":"ContainerStarted","Data":"56b5eee788840eee83c376ae38c515891256712f8988529605cb9637ac5e9a35"} Jul 14 23:33:56.371645 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:56.371616 2572 generic.go:356] "Generic (PLEG): container finished" podID="44ac6771-5359-4430-b24f-17808ce66729" containerID="86b48b8dee2a9c03c46c879dee6922fa3a63fbb8991a336f18477a6bb42a59cb" exitCode=0 Jul 14 23:33:56.372110 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:56.371689 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759" event={"ID":"44ac6771-5359-4430-b24f-17808ce66729","Type":"ContainerDied","Data":"86b48b8dee2a9c03c46c879dee6922fa3a63fbb8991a336f18477a6bb42a59cb"} Jul 14 23:33:57.514453 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:57.514430 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759" Jul 14 23:33:57.564559 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:57.564521 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ac6771-5359-4430-b24f-17808ce66729-maas-api-service-ca\") pod \"44ac6771-5359-4430-b24f-17808ce66729\" (UID: \"44ac6771-5359-4430-b24f-17808ce66729\") " Jul 14 23:33:57.564898 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:57.564875 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44ac6771-5359-4430-b24f-17808ce66729-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "44ac6771-5359-4430-b24f-17808ce66729" (UID: "44ac6771-5359-4430-b24f-17808ce66729"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:33:57.665972 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:57.665943 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ac6771-5359-4430-b24f-17808ce66729-maas-api-service-ca\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:33:58.384369 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:58.384285 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759" Jul 14 23:33:58.384369 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:58.384320 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759" event={"ID":"44ac6771-5359-4430-b24f-17808ce66729","Type":"ContainerDied","Data":"56b5eee788840eee83c376ae38c515891256712f8988529605cb9637ac5e9a35"} Jul 14 23:33:58.384577 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:33:58.384374 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56b5eee788840eee83c376ae38c515891256712f8988529605cb9637ac5e9a35" Jul 14 23:34:05.142318 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:05.142279 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:05.237474 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:05.237440 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:09.770572 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:09.770519 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:15.597084 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:15.596997 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:15.679894 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:15.679855 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:20.459396 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:20.459356 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:20.696327 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:20.696294 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:21.028706 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:21.028664 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:21.371497 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:21.371409 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:22.092326 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:22.092279 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:24.214782 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:24.214744 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:24.287460 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:24.287426 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:24.367902 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:24.367860 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:24.657433 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:24.657403 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:24.965974 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:24.965871 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:25.062218 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:25.062182 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:28.730155 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:28.730115 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:29.176915 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:29.176860 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:29.502893 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:29.502793 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:30.114887 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:30.114853 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:32.244771 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:32.244733 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:32.351154 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:32.351122 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:32.460201 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:32.460171 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:32.831491 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:32.831451 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:33.026068 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:33.026035 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:33.125926 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:33.125836 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:36.770049 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:36.770010 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:44.848256 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:44.848218 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e557a-76x6p"] Jul 14 23:34:44.848871 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:44.848852 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44ac6771-5359-4430-b24f-17808ce66729" containerName="revoke-keys" Jul 14 23:34:44.848922 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:44.848875 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="44ac6771-5359-4430-b24f-17808ce66729" containerName="revoke-keys" Jul 14 23:34:44.848980 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:44.848969 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="44ac6771-5359-4430-b24f-17808ce66729" containerName="revoke-keys" Jul 14 23:34:44.852509 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:44.852489 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e557a-76x6p" Jul 14 23:34:44.855432 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:44.855410 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jw626\"" Jul 14 23:34:44.859571 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:44.859528 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e557a-76x6p"] Jul 14 23:34:44.881457 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:44.881424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/489353f3-6070-4450-88a0-fd5b5568a4f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5e557a-76x6p\" (UID: \"489353f3-6070-4450-88a0-fd5b5568a4f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e557a-76x6p" Jul 14 23:34:44.982818 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:44.982780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/489353f3-6070-4450-88a0-fd5b5568a4f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5e557a-76x6p\" (UID: \"489353f3-6070-4450-88a0-fd5b5568a4f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e557a-76x6p" Jul 14 23:34:44.983432 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:44.983412 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/489353f3-6070-4450-88a0-fd5b5568a4f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5e557a-76x6p\" (UID: \"489353f3-6070-4450-88a0-fd5b5568a4f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e557a-76x6p" Jul 14 23:34:45.164940 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:45.164907 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e557a-76x6p" Jul 14 23:34:45.299241 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:45.299206 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e557a-76x6p"] Jul 14 23:34:45.299710 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:34:45.299679 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489353f3_6070_4450_88a0_fd5b5568a4f7.slice/crio-34b38c4294801c1dcad337b5c0b2564d640ab8cc9d8a40ed9859e82290992108 WatchSource:0}: Error finding container 34b38c4294801c1dcad337b5c0b2564d640ab8cc9d8a40ed9859e82290992108: Status 404 returned error can't find the container with id 34b38c4294801c1dcad337b5c0b2564d640ab8cc9d8a40ed9859e82290992108 Jul 14 23:34:45.616084 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:45.616048 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:45.641451 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:45.641415 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e557a-76x6p" event={"ID":"489353f3-6070-4450-88a0-fd5b5568a4f7","Type":"ContainerStarted","Data":"34b38c4294801c1dcad337b5c0b2564d640ab8cc9d8a40ed9859e82290992108"} Jul 14 23:34:45.716516 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:45.716465 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:46.648691 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:46.648657 2572 generic.go:356] "Generic (PLEG): container finished" podID="489353f3-6070-4450-88a0-fd5b5568a4f7" containerID="54fd3c84ae2ff2d5d7e09638be59b74604ed887ae348788e132f419e8f665748" exitCode=0 Jul 14 23:34:46.649142 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:46.648716 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e557a-76x6p" event={"ID":"489353f3-6070-4450-88a0-fd5b5568a4f7","Type":"ContainerDied","Data":"54fd3c84ae2ff2d5d7e09638be59b74604ed887ae348788e132f419e8f665748"} Jul 14 23:34:47.784890 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:47.784865 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e557a-76x6p" Jul 14 23:34:47.813062 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:47.813037 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/489353f3-6070-4450-88a0-fd5b5568a4f7-maas-api-service-ca\") pod \"489353f3-6070-4450-88a0-fd5b5568a4f7\" (UID: \"489353f3-6070-4450-88a0-fd5b5568a4f7\") " Jul 14 23:34:47.813391 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:47.813368 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/489353f3-6070-4450-88a0-fd5b5568a4f7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "489353f3-6070-4450-88a0-fd5b5568a4f7" (UID: "489353f3-6070-4450-88a0-fd5b5568a4f7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:34:47.915171 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:47.914492 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/489353f3-6070-4450-88a0-fd5b5568a4f7-maas-api-service-ca\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:34:48.664299 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:48.664264 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e557a-76x6p" Jul 14 23:34:48.664488 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:48.664262 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e557a-76x6p" event={"ID":"489353f3-6070-4450-88a0-fd5b5568a4f7","Type":"ContainerDied","Data":"34b38c4294801c1dcad337b5c0b2564d640ab8cc9d8a40ed9859e82290992108"} Jul 14 23:34:48.664488 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:48.664419 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34b38c4294801c1dcad337b5c0b2564d640ab8cc9d8a40ed9859e82290992108" Jul 14 23:34:55.051114 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:55.051080 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:55.151687 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:55.151649 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:55.319294 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:55.319194 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:34:59.932991 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:34:59.932955 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:05.936400 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:05.936363 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:06.002479 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:06.002438 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:10.636816 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:10.636767 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:10.862333 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:10.862291 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:10.975990 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:10.975955 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl"] Jul 14 23:35:10.976338 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:10.976325 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="489353f3-6070-4450-88a0-fd5b5568a4f7" containerName="revoke-keys" Jul 14 23:35:10.976397 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:10.976340 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="489353f3-6070-4450-88a0-fd5b5568a4f7" containerName="revoke-keys" Jul 14 23:35:10.976435 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:10.976398 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="489353f3-6070-4450-88a0-fd5b5568a4f7" containerName="revoke-keys" Jul 14 23:35:10.979527 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:10.979510 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl" Jul 14 23:35:10.982430 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:10.982411 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jw626\"" Jul 14 23:35:10.986178 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:10.986030 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl"] Jul 14 23:35:11.121827 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:11.121790 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40428904-d830-4b28-8fd8-364066a7e3b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl\" (UID: \"40428904-d830-4b28-8fd8-364066a7e3b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl" Jul 14 23:35:11.222980 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:11.222938 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40428904-d830-4b28-8fd8-364066a7e3b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl\" (UID: \"40428904-d830-4b28-8fd8-364066a7e3b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl" Jul 14 23:35:11.223642 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:11.223611 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40428904-d830-4b28-8fd8-364066a7e3b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl\" (UID: \"40428904-d830-4b28-8fd8-364066a7e3b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl" Jul 14 23:35:11.291622 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:11.291524 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl" Jul 14 23:35:11.454772 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:11.454740 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl"] Jul 14 23:35:11.456160 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:35:11.456131 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40428904_d830_4b28_8fd8_364066a7e3b3.slice/crio-017a8942dfff4130fc8fd7f1af9c1d3f124cc2382e56b8ab24eebb43ee754e7c WatchSource:0}: Error finding container 017a8942dfff4130fc8fd7f1af9c1d3f124cc2382e56b8ab24eebb43ee754e7c: Status 404 returned error can't find the container with id 017a8942dfff4130fc8fd7f1af9c1d3f124cc2382e56b8ab24eebb43ee754e7c Jul 14 23:35:11.793708 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:11.793663 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl" event={"ID":"40428904-d830-4b28-8fd8-364066a7e3b3","Type":"ContainerStarted","Data":"318bd2e63fda4c62393799d706c125e1f68bdd764e9c8fea0d16097bcb6c7fe6"} Jul 14 23:35:11.794164 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:11.793719 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl" event={"ID":"40428904-d830-4b28-8fd8-364066a7e3b3","Type":"ContainerStarted","Data":"017a8942dfff4130fc8fd7f1af9c1d3f124cc2382e56b8ab24eebb43ee754e7c"} Jul 14 23:35:11.810197 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:11.810138 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl" podStartSLOduration=1.810121455 podStartE2EDuration="1.810121455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:35:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:35:11.809241792 +0000 UTC m=+2300.425903489" watchObservedRunningTime="2026-07-14 23:35:11.810121455 +0000 UTC m=+2300.426783149" Jul 14 23:35:12.800185 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:12.800148 2572 generic.go:356] "Generic (PLEG): container finished" podID="40428904-d830-4b28-8fd8-364066a7e3b3" containerID="318bd2e63fda4c62393799d706c125e1f68bdd764e9c8fea0d16097bcb6c7fe6" exitCode=0 Jul 14 23:35:12.800600 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:12.800232 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl" event={"ID":"40428904-d830-4b28-8fd8-364066a7e3b3","Type":"ContainerDied","Data":"318bd2e63fda4c62393799d706c125e1f68bdd764e9c8fea0d16097bcb6c7fe6"} Jul 14 23:35:13.953515 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:13.953491 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl" Jul 14 23:35:14.048587 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:14.048554 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40428904-d830-4b28-8fd8-364066a7e3b3-maas-api-service-ca\") pod \"40428904-d830-4b28-8fd8-364066a7e3b3\" (UID: \"40428904-d830-4b28-8fd8-364066a7e3b3\") " Jul 14 23:35:14.048944 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:14.048917 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40428904-d830-4b28-8fd8-364066a7e3b3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "40428904-d830-4b28-8fd8-364066a7e3b3" (UID: "40428904-d830-4b28-8fd8-364066a7e3b3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:35:14.150115 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:14.150014 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40428904-d830-4b28-8fd8-364066a7e3b3-maas-api-service-ca\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:35:14.811031 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:14.811001 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl" Jul 14 23:35:14.811206 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:14.810997 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl" event={"ID":"40428904-d830-4b28-8fd8-364066a7e3b3","Type":"ContainerDied","Data":"017a8942dfff4130fc8fd7f1af9c1d3f124cc2382e56b8ab24eebb43ee754e7c"} Jul 14 23:35:14.811206 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:14.811156 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="017a8942dfff4130fc8fd7f1af9c1d3f124cc2382e56b8ab24eebb43ee754e7c" Jul 14 23:35:21.446594 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:21.446519 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:26.067602 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:26.067531 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:31.949652 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:31.949599 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:32.030401 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:32.030356 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:36.765254 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:36.765210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:36.877727 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:36.877685 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:36.929338 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:36.929307 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:37.008486 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:37.008443 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:37.374269 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:37.374232 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:37.692890 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:37.692856 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:38.419205 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:38.419155 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:40.629713 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:40.629529 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:40.732876 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:40.732846 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:40.804333 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:40.804299 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:40.960275 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:40.960240 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:41.303666 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:41.303565 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:41.400877 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:41.400843 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:43.475741 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:43.475708 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:43.574337 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:43.574298 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:45.117501 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:45.117458 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:45.488431 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:45.488400 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:45.806470 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:45.806375 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:46.249736 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:46.249705 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:48.678772 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:48.678739 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:48.767977 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:48.767940 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:48.923607 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:48.923576 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:49.153856 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:49.153825 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:49.484066 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:49.483974 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:49.584376 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:49.584343 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:35:53.169970 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:35:53.169932 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:36:03.041154 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:36:03.041116 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:36:03.204832 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:36:03.204790 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:36:03.306384 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:36:03.306292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:36:10.435147 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:36:10.435096 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:36:10.535035 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:36:10.534993 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:36:19.730103 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:36:19.730053 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:36:32.356809 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:36:32.356769 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:36:52.100630 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:36:52.100604 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:36:52.105348 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:36:52.105326 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:36:52.107122 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:36:52.107104 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:36:52.111408 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:36:52.111389 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:36:52.178344 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:36:52.178309 2572 scope.go:117] "RemoveContainer" containerID="7568702af8eb4f3c78c69bb2a69ee8e7c970dea17135c321b16d1348df44547f" Jul 14 23:38:17.865080 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:38:17.865042 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:38:18.980935 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:38:18.980900 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:38:28.807996 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:38:28.807956 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:38:29.695872 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:38:29.695830 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:38:40.901005 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:38:40.900970 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:38:45.628514 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:38:45.628430 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:39:32.695911 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:39:32.695878 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:39:33.532005 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:39:33.531975 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:39:34.589225 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:39:34.589195 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:39:41.412314 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:39:41.412281 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:39:51.474078 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:39:51.474041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:39:51.574471 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:39:51.574435 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:40:14.621189 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:40:14.621102 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:40:14.722300 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:40:14.722265 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:40:26.823212 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:40:26.823179 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:40:44.250435 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:40:44.250401 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:40:44.350828 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:40:44.350791 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:04.180208 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:04.180166 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:04.277189 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:04.277146 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:10.499607 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:10.499570 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:11.194320 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:11.194282 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:11.284323 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:11.284285 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:11.348045 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:11.347999 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:15.689969 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:15.689931 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7800-140280926443952"] Jul 14 23:41:15.690383 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:15.690321 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40428904-d830-4b28-8fd8-364066a7e3b3" containerName="revoke-keys" Jul 14 23:41:15.690383 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:15.690335 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="40428904-d830-4b28-8fd8-364066a7e3b3" containerName="revoke-keys" Jul 14 23:41:15.690462 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:15.690409 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="40428904-d830-4b28-8fd8-364066a7e3b3" containerName="revoke-keys" Jul 14 23:41:15.693413 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:15.693396 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-140280926443952" Jul 14 23:41:15.696556 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:15.696523 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n6p75\"" Jul 14 23:41:15.700080 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:15.700057 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7800-140280926443952"] Jul 14 23:41:15.735074 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:15.735027 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt9pg\" (UniqueName: \"kubernetes.io/projected/df93f2cc-826e-42e5-9d35-909f724ba5ae-kube-api-access-mt9pg\") pod \"test-curl-7800-140280926443952\" (UID: \"df93f2cc-826e-42e5-9d35-909f724ba5ae\") " pod="opendatahub/test-curl-7800-140280926443952" Jul 14 23:41:15.836463 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:15.836423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt9pg\" (UniqueName: \"kubernetes.io/projected/df93f2cc-826e-42e5-9d35-909f724ba5ae-kube-api-access-mt9pg\") pod \"test-curl-7800-140280926443952\" (UID: \"df93f2cc-826e-42e5-9d35-909f724ba5ae\") " pod="opendatahub/test-curl-7800-140280926443952" Jul 14 23:41:15.844904 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:15.844872 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt9pg\" (UniqueName: \"kubernetes.io/projected/df93f2cc-826e-42e5-9d35-909f724ba5ae-kube-api-access-mt9pg\") pod \"test-curl-7800-140280926443952\" (UID: \"df93f2cc-826e-42e5-9d35-909f724ba5ae\") " pod="opendatahub/test-curl-7800-140280926443952" Jul 14 23:41:16.003646 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:16.003531 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-140280926443952" Jul 14 23:41:16.142193 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:16.142167 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7800-140280926443952"] Jul 14 23:41:16.143504 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:41:16.143480 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf93f2cc_826e_42e5_9d35_909f724ba5ae.slice/crio-8ae9d306a6bda83f419a5362aa05b7c7e1c2a693cde70a7cf70a72ffa1e4bcf1 WatchSource:0}: Error finding container 8ae9d306a6bda83f419a5362aa05b7c7e1c2a693cde70a7cf70a72ffa1e4bcf1: Status 404 returned error can't find the container with id 8ae9d306a6bda83f419a5362aa05b7c7e1c2a693cde70a7cf70a72ffa1e4bcf1 Jul 14 23:41:16.144872 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:16.144850 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 23:41:16.801353 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:16.801318 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7800-140280926443952" event={"ID":"df93f2cc-826e-42e5-9d35-909f724ba5ae","Type":"ContainerStarted","Data":"8ae9d306a6bda83f419a5362aa05b7c7e1c2a693cde70a7cf70a72ffa1e4bcf1"} Jul 14 23:41:17.808964 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:17.808926 2572 generic.go:356] "Generic (PLEG): container finished" podID="df93f2cc-826e-42e5-9d35-909f724ba5ae" containerID="6530ae9070c6d46c15bf697aa42d3a8e91915c91f381ee8d8e0b6192f8866507" exitCode=0 Jul 14 23:41:17.809365 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:17.808990 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7800-140280926443952" event={"ID":"df93f2cc-826e-42e5-9d35-909f724ba5ae","Type":"ContainerDied","Data":"6530ae9070c6d46c15bf697aa42d3a8e91915c91f381ee8d8e0b6192f8866507"} Jul 14 23:41:18.948333 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:18.948304 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-140280926443952" Jul 14 23:41:18.961401 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:18.961379 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt9pg\" (UniqueName: \"kubernetes.io/projected/df93f2cc-826e-42e5-9d35-909f724ba5ae-kube-api-access-mt9pg\") pod \"df93f2cc-826e-42e5-9d35-909f724ba5ae\" (UID: \"df93f2cc-826e-42e5-9d35-909f724ba5ae\") " Jul 14 23:41:18.963627 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:18.963581 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df93f2cc-826e-42e5-9d35-909f724ba5ae-kube-api-access-mt9pg" (OuterVolumeSpecName: "kube-api-access-mt9pg") pod "df93f2cc-826e-42e5-9d35-909f724ba5ae" (UID: "df93f2cc-826e-42e5-9d35-909f724ba5ae"). InnerVolumeSpecName "kube-api-access-mt9pg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:41:18.969355 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:18.969331 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7800-140280926443952_df93f2cc-826e-42e5-9d35-909f724ba5ae/test-curl-7800-140280926443952/0.log" Jul 14 23:41:18.992906 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:18.992866 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7800-140280926443952"] Jul 14 23:41:18.996212 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:18.996184 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7800-140280926443952"] Jul 14 23:41:19.062169 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.062134 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt9pg\" (UniqueName: \"kubernetes.io/projected/df93f2cc-826e-42e5-9d35-909f724ba5ae-kube-api-access-mt9pg\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:41:19.157193 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.157159 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7800-140280926457904"] Jul 14 23:41:19.157627 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.157609 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df93f2cc-826e-42e5-9d35-909f724ba5ae" containerName="test-curl-7800-140280926443952" Jul 14 23:41:19.157745 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.157629 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="df93f2cc-826e-42e5-9d35-909f724ba5ae" containerName="test-curl-7800-140280926443952" Jul 14 23:41:19.157805 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.157754 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="df93f2cc-826e-42e5-9d35-909f724ba5ae" containerName="test-curl-7800-140280926443952" Jul 14 23:41:19.160866 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.160846 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-140280926457904" Jul 14 23:41:19.165624 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.165600 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7800-140280926457904"] Jul 14 23:41:19.263210 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.263173 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcln6\" (UniqueName: \"kubernetes.io/projected/375aa4f6-e5ca-44e5-8438-f05b2bb0449a-kube-api-access-jcln6\") pod \"test-curl-7800-140280926457904\" (UID: \"375aa4f6-e5ca-44e5-8438-f05b2bb0449a\") " pod="opendatahub/test-curl-7800-140280926457904" Jul 14 23:41:19.363828 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.363791 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcln6\" (UniqueName: \"kubernetes.io/projected/375aa4f6-e5ca-44e5-8438-f05b2bb0449a-kube-api-access-jcln6\") pod \"test-curl-7800-140280926457904\" (UID: \"375aa4f6-e5ca-44e5-8438-f05b2bb0449a\") " pod="opendatahub/test-curl-7800-140280926457904" Jul 14 23:41:19.372883 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.372859 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcln6\" (UniqueName: \"kubernetes.io/projected/375aa4f6-e5ca-44e5-8438-f05b2bb0449a-kube-api-access-jcln6\") pod \"test-curl-7800-140280926457904\" (UID: \"375aa4f6-e5ca-44e5-8438-f05b2bb0449a\") " pod="opendatahub/test-curl-7800-140280926457904" Jul 14 23:41:19.472110 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.472024 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-140280926457904" Jul 14 23:41:19.601576 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.601534 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7800-140280926457904"] Jul 14 23:41:19.602974 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:41:19.602944 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod375aa4f6_e5ca_44e5_8438_f05b2bb0449a.slice/crio-1d35fe3f2fd3c2ffb11b1d222ea7dcb5f80241f9c7e9e6ac6ba4b8c24c6aa9eb WatchSource:0}: Error finding container 1d35fe3f2fd3c2ffb11b1d222ea7dcb5f80241f9c7e9e6ac6ba4b8c24c6aa9eb: Status 404 returned error can't find the container with id 1d35fe3f2fd3c2ffb11b1d222ea7dcb5f80241f9c7e9e6ac6ba4b8c24c6aa9eb Jul 14 23:41:19.823129 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.823050 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-140280926443952" Jul 14 23:41:19.823279 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.823055 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ae9d306a6bda83f419a5362aa05b7c7e1c2a693cde70a7cf70a72ffa1e4bcf1" Jul 14 23:41:19.824329 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.824295 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7800-140280926457904" event={"ID":"375aa4f6-e5ca-44e5-8438-f05b2bb0449a","Type":"ContainerStarted","Data":"1d35fe3f2fd3c2ffb11b1d222ea7dcb5f80241f9c7e9e6ac6ba4b8c24c6aa9eb"} Jul 14 23:41:19.838595 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:41:19.838567 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7800-140280926443952\" is forbidden: User \"system:node:ip-10-0-130-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-2.ec2.internal' and this object" podUID="df93f2cc-826e-42e5-9d35-909f724ba5ae" pod="opendatahub/test-curl-7800-140280926443952" Jul 14 23:41:19.910657 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:19.910629 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df93f2cc-826e-42e5-9d35-909f724ba5ae" path="/var/lib/kubelet/pods/df93f2cc-826e-42e5-9d35-909f724ba5ae/volumes" Jul 14 23:41:20.831599 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:20.831568 2572 generic.go:356] "Generic (PLEG): container finished" podID="375aa4f6-e5ca-44e5-8438-f05b2bb0449a" containerID="def1b0a28de8f3ce141dffecc17c113996c0be333b6895b84723e916e6000244" exitCode=0 Jul 14 23:41:20.832003 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:20.831651 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7800-140280926457904" event={"ID":"375aa4f6-e5ca-44e5-8438-f05b2bb0449a","Type":"ContainerDied","Data":"def1b0a28de8f3ce141dffecc17c113996c0be333b6895b84723e916e6000244"} Jul 14 23:41:21.974631 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:21.974605 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-140280926457904" Jul 14 23:41:21.995944 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:21.995904 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7800-140280926457904_375aa4f6-e5ca-44e5-8438-f05b2bb0449a/test-curl-7800-140280926457904/0.log" Jul 14 23:41:22.024474 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:22.024438 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7800-140280926457904"] Jul 14 23:41:22.028332 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:22.028306 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7800-140280926457904"] Jul 14 23:41:22.088194 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:22.088107 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcln6\" (UniqueName: \"kubernetes.io/projected/375aa4f6-e5ca-44e5-8438-f05b2bb0449a-kube-api-access-jcln6\") pod \"375aa4f6-e5ca-44e5-8438-f05b2bb0449a\" (UID: \"375aa4f6-e5ca-44e5-8438-f05b2bb0449a\") " Jul 14 23:41:22.090303 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:22.090278 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/375aa4f6-e5ca-44e5-8438-f05b2bb0449a-kube-api-access-jcln6" (OuterVolumeSpecName: "kube-api-access-jcln6") pod "375aa4f6-e5ca-44e5-8438-f05b2bb0449a" (UID: "375aa4f6-e5ca-44e5-8438-f05b2bb0449a"). InnerVolumeSpecName "kube-api-access-jcln6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 23:41:22.189193 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:22.189161 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcln6\" (UniqueName: \"kubernetes.io/projected/375aa4f6-e5ca-44e5-8438-f05b2bb0449a-kube-api-access-jcln6\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:41:22.844178 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:22.844146 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d35fe3f2fd3c2ffb11b1d222ea7dcb5f80241f9c7e9e6ac6ba4b8c24c6aa9eb" Jul 14 23:41:22.844330 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:22.844190 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7800-140280926457904" Jul 14 23:41:22.854647 ip-10-0-130-2 kubenswrapper[2572]: E0714 23:41:22.854615 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7800-140280926457904\" is forbidden: User \"system:node:ip-10-0-130-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-2.ec2.internal' and this object" podUID="375aa4f6-e5ca-44e5-8438-f05b2bb0449a" pod="opendatahub/test-curl-7800-140280926457904" Jul 14 23:41:23.909977 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:23.909941 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="375aa4f6-e5ca-44e5-8438-f05b2bb0449a" path="/var/lib/kubelet/pods/375aa4f6-e5ca-44e5-8438-f05b2bb0449a/volumes" Jul 14 23:41:30.822932 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:30.822896 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz"] Jul 14 23:41:30.823473 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:30.823454 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="375aa4f6-e5ca-44e5-8438-f05b2bb0449a" containerName="test-curl-7800-140280926457904" Jul 14 23:41:30.823515 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:30.823477 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="375aa4f6-e5ca-44e5-8438-f05b2bb0449a" containerName="test-curl-7800-140280926457904" Jul 14 23:41:30.823624 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:30.823610 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="375aa4f6-e5ca-44e5-8438-f05b2bb0449a" containerName="test-curl-7800-140280926457904" Jul 14 23:41:30.827041 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:30.827023 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz" Jul 14 23:41:30.829678 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:30.829646 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jw626\"" Jul 14 23:41:30.831627 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:30.831604 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz"] Jul 14 23:41:30.868406 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:30.868361 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54badbd0-7d67-4eb7-9796-f43a515cd690-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d62786-x76hz\" (UID: \"54badbd0-7d67-4eb7-9796-f43a515cd690\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz" Jul 14 23:41:30.969034 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:30.968995 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54badbd0-7d67-4eb7-9796-f43a515cd690-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d62786-x76hz\" (UID: \"54badbd0-7d67-4eb7-9796-f43a515cd690\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz" Jul 14 23:41:30.969683 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:30.969662 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54badbd0-7d67-4eb7-9796-f43a515cd690-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d62786-x76hz\" (UID: \"54badbd0-7d67-4eb7-9796-f43a515cd690\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz" Jul 14 23:41:31.139427 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:31.139334 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz" Jul 14 23:41:31.332997 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:31.332959 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:31.434040 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:31.434008 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:31.484983 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:31.484958 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz"] Jul 14 23:41:31.487276 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:41:31.487246 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54badbd0_7d67_4eb7_9796_f43a515cd690.slice/crio-71b446b4067cf3947d67ff9618f218f4970454ac8d6a8f201222cf71465e47f8 WatchSource:0}: Error finding container 71b446b4067cf3947d67ff9618f218f4970454ac8d6a8f201222cf71465e47f8: Status 404 returned error can't find the container with id 71b446b4067cf3947d67ff9618f218f4970454ac8d6a8f201222cf71465e47f8 Jul 14 23:41:31.895169 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:31.895126 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz" event={"ID":"54badbd0-7d67-4eb7-9796-f43a515cd690","Type":"ContainerStarted","Data":"cc68affe9b30449ca95e01e97985b9d54664c6417f69384d15df544821224e66"} Jul 14 23:41:31.895598 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:31.895190 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz" event={"ID":"54badbd0-7d67-4eb7-9796-f43a515cd690","Type":"ContainerStarted","Data":"71b446b4067cf3947d67ff9618f218f4970454ac8d6a8f201222cf71465e47f8"} Jul 14 23:41:31.915486 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:31.915438 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz" podStartSLOduration=1.9154224050000002 podStartE2EDuration="1.915422405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:41:31.911730284 +0000 UTC m=+2680.528391978" watchObservedRunningTime="2026-07-14 23:41:31.915422405 +0000 UTC m=+2680.532084099" Jul 14 23:41:32.902705 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:32.902672 2572 generic.go:356] "Generic (PLEG): container finished" podID="54badbd0-7d67-4eb7-9796-f43a515cd690" containerID="cc68affe9b30449ca95e01e97985b9d54664c6417f69384d15df544821224e66" exitCode=0 Jul 14 23:41:32.903112 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:32.902765 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz" event={"ID":"54badbd0-7d67-4eb7-9796-f43a515cd690","Type":"ContainerDied","Data":"cc68affe9b30449ca95e01e97985b9d54664c6417f69384d15df544821224e66"} Jul 14 23:41:34.048086 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:34.048061 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz" Jul 14 23:41:34.100917 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:34.100880 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54badbd0-7d67-4eb7-9796-f43a515cd690-maas-api-service-ca\") pod \"54badbd0-7d67-4eb7-9796-f43a515cd690\" (UID: \"54badbd0-7d67-4eb7-9796-f43a515cd690\") " Jul 14 23:41:34.101247 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:34.101224 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54badbd0-7d67-4eb7-9796-f43a515cd690-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "54badbd0-7d67-4eb7-9796-f43a515cd690" (UID: "54badbd0-7d67-4eb7-9796-f43a515cd690"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:41:34.201867 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:34.201776 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54badbd0-7d67-4eb7-9796-f43a515cd690-maas-api-service-ca\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:41:34.915917 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:34.915888 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz" Jul 14 23:41:34.915917 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:34.915895 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d62786-x76hz" event={"ID":"54badbd0-7d67-4eb7-9796-f43a515cd690","Type":"ContainerDied","Data":"71b446b4067cf3947d67ff9618f218f4970454ac8d6a8f201222cf71465e47f8"} Jul 14 23:41:34.916191 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:34.915945 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71b446b4067cf3947d67ff9618f218f4970454ac8d6a8f201222cf71465e47f8" Jul 14 23:41:41.270071 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:41.270029 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:45.917449 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:45.917364 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:51.996960 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:51.996925 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:52.055487 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:52.055447 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:52.138751 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:52.138721 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:41:52.143443 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:52.143418 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:41:52.147133 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:52.147099 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:41:52.151535 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:52.151519 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-98b67_7559daa9-b3da-4594-8163-12e31455b252/ovn-acl-logging/0.log" Jul 14 23:41:56.620854 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:56.620822 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:56.856974 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:56.856945 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:56.976400 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:56.976365 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd"] Jul 14 23:41:56.976747 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:56.976734 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54badbd0-7d67-4eb7-9796-f43a515cd690" containerName="revoke-keys" Jul 14 23:41:56.976796 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:56.976748 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="54badbd0-7d67-4eb7-9796-f43a515cd690" containerName="revoke-keys" Jul 14 23:41:56.976842 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:56.976833 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="54badbd0-7d67-4eb7-9796-f43a515cd690" containerName="revoke-keys" Jul 14 23:41:56.981491 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:56.981466 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd" Jul 14 23:41:56.984905 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:56.984710 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jw626\"" Jul 14 23:41:56.987183 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:56.987157 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd"] Jul 14 23:41:57.107055 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:57.107022 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d95a8c-e920-4866-b8e3-073e0bcc2282-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd\" (UID: \"06d95a8c-e920-4866-b8e3-073e0bcc2282\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd" Jul 14 23:41:57.207935 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:57.207903 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d95a8c-e920-4866-b8e3-073e0bcc2282-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd\" (UID: \"06d95a8c-e920-4866-b8e3-073e0bcc2282\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd" Jul 14 23:41:57.208608 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:57.208588 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d95a8c-e920-4866-b8e3-073e0bcc2282-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd\" (UID: \"06d95a8c-e920-4866-b8e3-073e0bcc2282\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd" Jul 14 23:41:57.294290 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:57.294202 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd" Jul 14 23:41:57.433580 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:57.433522 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd"] Jul 14 23:41:57.434927 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:41:57.434870 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d95a8c_e920_4866_b8e3_073e0bcc2282.slice/crio-27b6d722ac5595ee9720f514ae6cbcfdf578502fd584b606efd6c20d4a1de7b2 WatchSource:0}: Error finding container 27b6d722ac5595ee9720f514ae6cbcfdf578502fd584b606efd6c20d4a1de7b2: Status 404 returned error can't find the container with id 27b6d722ac5595ee9720f514ae6cbcfdf578502fd584b606efd6c20d4a1de7b2 Jul 14 23:41:57.486000 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:57.485969 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:57.875075 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:57.875041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:41:58.049174 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:58.049069 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd" event={"ID":"06d95a8c-e920-4866-b8e3-073e0bcc2282","Type":"ContainerStarted","Data":"aa4deb173943066bd1fc2a48347419c9c926ec633cd665343d4426e78d9de22f"} Jul 14 23:41:58.049174 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:58.049142 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd" event={"ID":"06d95a8c-e920-4866-b8e3-073e0bcc2282","Type":"ContainerStarted","Data":"27b6d722ac5595ee9720f514ae6cbcfdf578502fd584b606efd6c20d4a1de7b2"} Jul 14 23:41:58.072489 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:58.072443 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd" podStartSLOduration=2.072429057 podStartE2EDuration="2.072429057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 23:41:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:41:58.069525932 +0000 UTC m=+2706.686187624" watchObservedRunningTime="2026-07-14 23:41:58.072429057 +0000 UTC m=+2706.689090751" Jul 14 23:41:59.055676 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:59.055641 2572 generic.go:356] "Generic (PLEG): container finished" podID="06d95a8c-e920-4866-b8e3-073e0bcc2282" containerID="aa4deb173943066bd1fc2a48347419c9c926ec633cd665343d4426e78d9de22f" exitCode=0 Jul 14 23:41:59.056129 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:41:59.055715 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd" event={"ID":"06d95a8c-e920-4866-b8e3-073e0bcc2282","Type":"ContainerDied","Data":"aa4deb173943066bd1fc2a48347419c9c926ec633cd665343d4426e78d9de22f"} Jul 14 23:42:00.192374 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:00.192348 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd" Jul 14 23:42:00.337257 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:00.337165 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d95a8c-e920-4866-b8e3-073e0bcc2282-maas-api-service-ca\") pod \"06d95a8c-e920-4866-b8e3-073e0bcc2282\" (UID: \"06d95a8c-e920-4866-b8e3-073e0bcc2282\") " Jul 14 23:42:00.337599 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:00.337570 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06d95a8c-e920-4866-b8e3-073e0bcc2282-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "06d95a8c-e920-4866-b8e3-073e0bcc2282" (UID: "06d95a8c-e920-4866-b8e3-073e0bcc2282"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 23:42:00.437855 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:00.437817 2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d95a8c-e920-4866-b8e3-073e0bcc2282-maas-api-service-ca\") on node \"ip-10-0-130-2.ec2.internal\" DevicePath \"\"" Jul 14 23:42:01.068902 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:01.068872 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd" Jul 14 23:42:01.069083 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:01.068907 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd" event={"ID":"06d95a8c-e920-4866-b8e3-073e0bcc2282","Type":"ContainerDied","Data":"27b6d722ac5595ee9720f514ae6cbcfdf578502fd584b606efd6c20d4a1de7b2"} Jul 14 23:42:01.069083 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:01.068955 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27b6d722ac5595ee9720f514ae6cbcfdf578502fd584b606efd6c20d4a1de7b2" Jul 14 23:42:07.419700 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:07.419666 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:42:12.062152 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:12.062110 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:42:18.188197 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:18.188164 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:42:18.254365 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:18.254332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:42:22.774020 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:22.773989 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:42:22.989220 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:22.989184 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:42:29.062727 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:29.062692 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56c469fc88-tk78j_16cbc206-0c9a-409e-bc90-6094205263c8/manager/0.log" Jul 14 23:42:29.536338 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:29.536307 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756c8cff-x8rh5_7dedffb6-9829-425f-ad6f-1589dbc249e6/copy-manifests/0.log" Jul 14 23:42:29.549355 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:29.549325 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756c8cff-x8rh5_7dedffb6-9829-425f-ad6f-1589dbc249e6/manager/0.log" Jul 14 23:42:30.279006 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:30.278977 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29734530-9l9f5_a194475d-c841-4893-8e92-3fb23e2e890d/cleanup/0.log" Jul 14 23:42:30.633650 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:30.633569 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-5e557a-76x6p_489353f3-6070-4450-88a0-fd5b5568a4f7/revoke-keys/0.log" Jul 14 23:42:30.746983 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:30.746954 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-a8299a-2dpfl_40428904-d830-4b28-8fd8-364066a7e3b3/revoke-keys/0.log" Jul 14 23:42:30.861901 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:30.861873 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-758a442d-znbh4_d969bcef-97f8-49fd-83c7-e4adf4e2f403/revoke-keys/0.log" Jul 14 23:42:30.974215 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:30.974181 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-d130d1-qszbr_3d275336-0844-4308-bde4-216b03b66dd3/revoke-keys/0.log" Jul 14 23:42:31.090779 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:31.090752 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-4b47a7-z7759_44ac6771-5359-4430-b24f-17808ce66729/revoke-keys/0.log" Jul 14 23:42:31.205370 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:31.205345 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-1731167b-wbgrx_2c001700-1694-4992-ac28-f15e52a6d3a8/revoke-keys/1.log" Jul 14 23:42:31.319177 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:31.319096 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-61774e12-v99dd_6ae2b111-660e-4ad2-80fe-f783e9b8613b/revoke-keys/0.log" Jul 14 23:42:31.533495 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:31.533465 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-d62786-x76hz_54badbd0-7d67-4eb7-9796-f43a515cd690/revoke-keys/0.log" Jul 14 23:42:31.653686 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:31.653655 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-638b58-dwjhd_06d95a8c-e920-4866-b8e3-073e0bcc2282/revoke-keys/0.log" Jul 14 23:42:31.775579 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:31.769167 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-w6rd6_4c42b17c-14d7-45b1-9825-89312b8048eb/postgres/0.log" Jul 14 23:42:32.587922 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:32.587895 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj_f297ed68-a5f5-4ccf-9056-f4a621073217/util/0.log" Jul 14 23:42:32.594876 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:32.594854 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj_f297ed68-a5f5-4ccf-9056-f4a621073217/pull/0.log" Jul 14 23:42:32.601972 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:32.601954 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj_f297ed68-a5f5-4ccf-9056-f4a621073217/extract/0.log" Jul 14 23:42:32.715983 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:32.715951 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd_71a2cc6e-239a-42e9-94a0-a6644273f00a/pull/0.log" Jul 14 23:42:32.721727 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:32.721705 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd_71a2cc6e-239a-42e9-94a0-a6644273f00a/extract/0.log" Jul 14 23:42:32.727161 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:32.727143 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd_71a2cc6e-239a-42e9-94a0-a6644273f00a/util/0.log" Jul 14 23:42:32.842759 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:32.842686 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh_35de32f5-9a09-4f96-95e6-424431085613/util/0.log" Jul 14 23:42:32.849764 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:32.849737 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh_35de32f5-9a09-4f96-95e6-424431085613/pull/0.log" Jul 14 23:42:32.859988 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:32.859964 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh_35de32f5-9a09-4f96-95e6-424431085613/extract/0.log" Jul 14 23:42:32.978282 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:32.978256 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j_ee9ae486-e927-4435-ac41-c21d4d123b45/util/0.log" Jul 14 23:42:32.985270 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:32.985245 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j_ee9ae486-e927-4435-ac41-c21d4d123b45/pull/0.log" Jul 14 23:42:32.991838 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:32.991817 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j_ee9ae486-e927-4435-ac41-c21d4d123b45/extract/0.log" Jul 14 23:42:33.245031 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:33.245002 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pvz8x_85b0383f-94ed-4b72-8200-e7df31866bec/manager/0.log" Jul 14 23:42:33.586391 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:33.586298 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t85k9_9b0f5760-99e2-41aa-be61-64e43a1f1f04/registry-server/0.log" Jul 14 23:42:33.708695 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:33.708663 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-r6gwz_dd2e2656-e3c5-4d8d-87ff-64e89abeb415/manager/0.log" Jul 14 23:42:34.435222 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:34.435192 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cp9gr_dce2752a-f053-4567-9f24-9f1431d550ac/discovery/0.log" Jul 14 23:42:34.665936 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:34.665905 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-946bb8597-twdrr_b80f7a5f-cc91-4055-9d3e-f2e8f40c3414/kube-auth-proxy/0.log" Jul 14 23:42:35.020945 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:35.020914 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-rsr96_9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7/payload-processing/0.log" Jul 14 23:42:35.128387 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:35.128356 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cbc88d98d-86h58_dbf0442c-13e6-4e76-909f-280c9bc111ed/router/0.log" Jul 14 23:42:35.467641 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:35.467616 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-d9zkj_935a3387-19dd-4c42-b573-a78935023785/main/0.log" Jul 14 23:42:35.699008 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:35.698981 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-z2wtg_8fede9d1-ee4e-4020-9576-059c9771eb92/main/0.log" Jul 14 23:42:42.132986 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:42.132954 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:42:42.226736 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:42.226703 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" limit=1024 Jul 14 23:42:45.513430 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:45.513399 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pn6sh_c1024b4d-03b0-4d83-928e-d04a0fe55861/global-pull-secret-syncer/0.log" Jul 14 23:42:45.601231 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:45.601200 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4z959_38438969-9483-4e29-8c82-414077938b43/konnectivity-agent/0.log" Jul 14 23:42:45.700629 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:45.700603 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-2.ec2.internal_a5fc01eedff708540538bb5f52d24e9e/haproxy/0.log" Jul 14 23:42:50.606751 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:50.606719 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj_f297ed68-a5f5-4ccf-9056-f4a621073217/extract/0.log" Jul 14 23:42:50.631765 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:50.631739 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj_f297ed68-a5f5-4ccf-9056-f4a621073217/util/0.log" Jul 14 23:42:50.653609 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:50.653586 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vzrvj_f297ed68-a5f5-4ccf-9056-f4a621073217/pull/0.log" Jul 14 23:42:50.682158 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:50.682132 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd_71a2cc6e-239a-42e9-94a0-a6644273f00a/extract/0.log" Jul 14 23:42:50.703513 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:50.703485 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd_71a2cc6e-239a-42e9-94a0-a6644273f00a/util/0.log" Jul 14 23:42:50.729764 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:50.729737 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e069qxd_71a2cc6e-239a-42e9-94a0-a6644273f00a/pull/0.log" Jul 14 23:42:50.756616 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:50.756591 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh_35de32f5-9a09-4f96-95e6-424431085613/extract/0.log" Jul 14 23:42:50.783484 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:50.783457 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh_35de32f5-9a09-4f96-95e6-424431085613/util/0.log" Jul 14 23:42:50.811331 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:50.811305 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smjmh_35de32f5-9a09-4f96-95e6-424431085613/pull/0.log" Jul 14 23:42:50.855158 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:50.855132 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j_ee9ae486-e927-4435-ac41-c21d4d123b45/extract/0.log" Jul 14 23:42:50.879383 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:50.879304 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j_ee9ae486-e927-4435-ac41-c21d4d123b45/util/0.log" Jul 14 23:42:50.905973 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:50.905947 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1btq5j_ee9ae486-e927-4435-ac41-c21d4d123b45/pull/0.log" Jul 14 23:42:51.336279 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:51.336250 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pvz8x_85b0383f-94ed-4b72-8200-e7df31866bec/manager/0.log" Jul 14 23:42:51.450343 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:51.450307 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t85k9_9b0f5760-99e2-41aa-be61-64e43a1f1f04/registry-server/0.log" Jul 14 23:42:51.549510 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:51.549474 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-r6gwz_dd2e2656-e3c5-4d8d-87ff-64e89abeb415/manager/0.log" Jul 14 23:42:53.556237 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:53.556198 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-4znxt_13340f57-01a1-462f-b7c2-13985ec3ef72/cluster-monitoring-operator/0.log" Jul 14 23:42:53.873445 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:53.873366 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tk6cc_e16c04ff-0931-4a27-9fa8-a531c7cd03bf/node-exporter/0.log" Jul 14 23:42:53.895607 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:53.895576 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tk6cc_e16c04ff-0931-4a27-9fa8-a531c7cd03bf/kube-rbac-proxy/0.log" Jul 14 23:42:53.921220 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:53.921195 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tk6cc_e16c04ff-0931-4a27-9fa8-a531c7cd03bf/init-textfile/0.log" Jul 14 23:42:54.279300 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:54.279270 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85d5f68f69-5pqw2_b462844b-a8b0-4bcf-9ade-0256400df826/telemeter-client/0.log" Jul 14 23:42:54.315026 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:54.314999 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85d5f68f69-5pqw2_b462844b-a8b0-4bcf-9ade-0256400df826/reload/0.log" Jul 14 23:42:54.337333 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:54.337309 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85d5f68f69-5pqw2_b462844b-a8b0-4bcf-9ade-0256400df826/kube-rbac-proxy/0.log" Jul 14 23:42:55.340251 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.340215 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64"] Jul 14 23:42:55.340674 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.340598 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d95a8c-e920-4866-b8e3-073e0bcc2282" containerName="revoke-keys" Jul 14 23:42:55.340674 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.340612 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d95a8c-e920-4866-b8e3-073e0bcc2282" containerName="revoke-keys" Jul 14 23:42:55.340764 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.340680 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="06d95a8c-e920-4866-b8e3-073e0bcc2282" containerName="revoke-keys" Jul 14 23:42:55.344000 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.343979 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.346804 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.346779 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hkhmk\"/\"openshift-service-ca.crt\"" Jul 14 23:42:55.348113 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.348094 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hkhmk\"/\"kube-root-ca.crt\"" Jul 14 23:42:55.348228 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.348193 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hkhmk\"/\"default-dockercfg-jtt7v\"" Jul 14 23:42:55.353507 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.353481 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64"] Jul 14 23:42:55.512322 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.512287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zd6m\" (UniqueName: \"kubernetes.io/projected/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-kube-api-access-5zd6m\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.512322 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.512322 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-lib-modules\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.512565 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.512399 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-proc\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.512565 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.512435 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-podres\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.512565 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.512452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-sys\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.613574 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.613471 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zd6m\" (UniqueName: \"kubernetes.io/projected/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-kube-api-access-5zd6m\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.613574 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.613505 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-lib-modules\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.613772 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.613587 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-proc\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.613772 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.613634 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-podres\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.613772 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.613662 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-sys\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.613772 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.613700 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-proc\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.613772 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.613749 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-sys\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.613772 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.613750 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-lib-modules\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.613978 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.613824 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-podres\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.621637 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.621615 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zd6m\" (UniqueName: \"kubernetes.io/projected/a430b3b7-71bf-4779-9b0c-f7c1aefd0317-kube-api-access-5zd6m\") pod \"perf-node-gather-daemonset-khf64\" (UID: \"a430b3b7-71bf-4779-9b0c-f7c1aefd0317\") " pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.655705 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.655677 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:55.801111 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:55.801059 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64"] Jul 14 23:42:55.802475 ip-10-0-130-2 kubenswrapper[2572]: W0714 23:42:55.802447 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda430b3b7_71bf_4779_9b0c_f7c1aefd0317.slice/crio-e57ee77a315f88ff7cfeb03860dc09c353262979eb485b1faefa863df73a4980 WatchSource:0}: Error finding container e57ee77a315f88ff7cfeb03860dc09c353262979eb485b1faefa863df73a4980: Status 404 returned error can't find the container with id e57ee77a315f88ff7cfeb03860dc09c353262979eb485b1faefa863df73a4980 Jul 14 23:42:56.288909 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:56.288811 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/1.log" Jul 14 23:42:56.293094 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:56.293074 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-ppmpg_75599b0f-5f71-4919-8723-67aaa6ebe201/console-operator/2.log" Jul 14 23:42:56.374923 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:56.374880 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" event={"ID":"a430b3b7-71bf-4779-9b0c-f7c1aefd0317","Type":"ContainerStarted","Data":"41f5f7b8b4aeec5e46bd337485c608574d3b01d4b02a493fe4a6f45a9146e515"} Jul 14 23:42:56.375368 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:56.374937 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" event={"ID":"a430b3b7-71bf-4779-9b0c-f7c1aefd0317","Type":"ContainerStarted","Data":"e57ee77a315f88ff7cfeb03860dc09c353262979eb485b1faefa863df73a4980"} Jul 14 23:42:56.375368 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:56.374965 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:42:56.391557 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:56.391500 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" podStartSLOduration=1.391484754 podStartE2EDuration="1.391484754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 23:42:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 23:42:56.389816759 +0000 UTC m=+2765.006478464" watchObservedRunningTime="2026-07-14 23:42:56.391484754 +0000 UTC m=+2765.008146447" Jul 14 23:42:57.366050 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:57.366018 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-x9cqr_1c15dde8-c2b7-4afd-a922-0bf324bb54c1/volume-data-source-validator/0.log" Jul 14 23:42:58.548976 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:58.548931 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tmglv_3cdd0825-5bd6-47e8-86c1-f008e96a9f8b/dns/0.log" Jul 14 23:42:58.575191 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:58.575166 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tmglv_3cdd0825-5bd6-47e8-86c1-f008e96a9f8b/kube-rbac-proxy/0.log" Jul 14 23:42:58.648493 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:58.648458 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5k7g_5f4b191b-6d7c-4bd7-8e6b-7f9cd49ae0cd/dns-node-resolver/0.log" Jul 14 23:42:59.255622 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:42:59.255586 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xnjpp_657fd608-a02e-4549-8ddb-fc3804266929/node-ca/0.log" Jul 14 23:43:00.263982 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:00.263947 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cp9gr_dce2752a-f053-4567-9f24-9f1431d550ac/discovery/0.log" Jul 14 23:43:00.306167 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:00.306144 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-946bb8597-twdrr_b80f7a5f-cc91-4055-9d3e-f2e8f40c3414/kube-auth-proxy/0.log" Jul 14 23:43:00.458301 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:00.458255 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-rsr96_9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7/payload-processing/0.log" Jul 14 23:43:00.478587 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:00.478562 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cbc88d98d-86h58_dbf0442c-13e6-4e76-909f-280c9bc111ed/router/0.log" Jul 14 23:43:01.130761 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:01.130732 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gjgwf_f37c190b-70d5-41ae-ad87-96b058495645/serve-healthcheck-canary/0.log" Jul 14 23:43:01.628183 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:01.628154 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-nhddc_df375676-ba25-481c-babc-5c81539e7726/insights-operator/0.log" Jul 14 23:43:01.628669 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:01.628585 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-nhddc_df375676-ba25-481c-babc-5c81539e7726/insights-operator/1.log" Jul 14 23:43:01.785832 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:01.785796 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nrqc5_b494dbd0-9ebe-4937-a03b-a42e62f0d20f/kube-rbac-proxy/0.log" Jul 14 23:43:01.806654 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:01.806632 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nrqc5_b494dbd0-9ebe-4937-a03b-a42e62f0d20f/exporter/0.log" Jul 14 23:43:01.827557 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:01.827514 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nrqc5_b494dbd0-9ebe-4937-a03b-a42e62f0d20f/extractor/0.log" Jul 14 23:43:02.390710 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:02.390675 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hkhmk/perf-node-gather-daemonset-khf64" Jul 14 23:43:04.400715 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:04.400683 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56c469fc88-tk78j_16cbc206-0c9a-409e-bc90-6094205263c8/manager/0.log" Jul 14 23:43:04.644571 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:04.644445 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756c8cff-x8rh5_7dedffb6-9829-425f-ad6f-1589dbc249e6/manager/0.log" Jul 14 23:43:04.663283 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:04.663254 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756c8cff-x8rh5_7dedffb6-9829-425f-ad6f-1589dbc249e6/copy-manifests/0.log" Jul 14 23:43:06.135742 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:06.135711 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cp9gr_dce2752a-f053-4567-9f24-9f1431d550ac/discovery/0.log" Jul 14 23:43:06.166064 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:06.166034 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-946bb8597-twdrr_b80f7a5f-cc91-4055-9d3e-f2e8f40c3414/kube-auth-proxy/0.log" Jul 14 23:43:06.288786 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:06.288750 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-rsr96_9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7/payload-processing/0.log" Jul 14 23:43:06.304503 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:06.304479 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cbc88d98d-86h58_dbf0442c-13e6-4e76-909f-280c9bc111ed/router/0.log" Jul 14 23:43:07.662404 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:07.662373 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-cp9gr_dce2752a-f053-4567-9f24-9f1431d550ac/discovery/0.log" Jul 14 23:43:07.690521 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:07.690494 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-946bb8597-twdrr_b80f7a5f-cc91-4055-9d3e-f2e8f40c3414/kube-auth-proxy/0.log" Jul 14 23:43:07.822715 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:07.822690 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-rsr96_9035ad73-0d4f-4a69-9bb1-d3bcfd8118d7/payload-processing/0.log" Jul 14 23:43:07.837266 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:07.837242 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cbc88d98d-86h58_dbf0442c-13e6-4e76-909f-280c9bc111ed/router/0.log" Jul 14 23:43:11.098559 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:11.098513 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-w4djw_6a59d30e-3ddf-48a7-9de3-387c2e92f951/kube-storage-version-migrator-operator/1.log" Jul 14 23:43:11.099340 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:11.099321 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-w4djw_6a59d30e-3ddf-48a7-9de3-387c2e92f951/kube-storage-version-migrator-operator/0.log" Jul 14 23:43:12.285142 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:12.285106 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4b8q_511a080e-cdd5-4403-bc46-b986daa2fa40/kube-multus-additional-cni-plugins/0.log" Jul 14 23:43:12.304423 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:12.304395 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4b8q_511a080e-cdd5-4403-bc46-b986daa2fa40/egress-router-binary-copy/0.log" Jul 14 23:43:12.323572 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:12.323522 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4b8q_511a080e-cdd5-4403-bc46-b986daa2fa40/cni-plugins/0.log" Jul 14 23:43:12.345872 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:12.345848 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4b8q_511a080e-cdd5-4403-bc46-b986daa2fa40/bond-cni-plugin/0.log" Jul 14 23:43:12.365061 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:12.365036 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4b8q_511a080e-cdd5-4403-bc46-b986daa2fa40/routeoverride-cni/0.log" Jul 14 23:43:12.385660 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:12.385639 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4b8q_511a080e-cdd5-4403-bc46-b986daa2fa40/whereabouts-cni-bincopy/0.log" Jul 14 23:43:12.408508 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:12.408480 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4b8q_511a080e-cdd5-4403-bc46-b986daa2fa40/whereabouts-cni/0.log" Jul 14 23:43:12.606744 ip-10-0-130-2 kubenswrapper[2572]: I0714 23:43:12.606670 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q257d_021925ca-6e34-4e06-b282-2081f65724f0/kube-multus/0.log"