Jul 09 01:36:11.612458 ip-10-0-130-184 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 01:36:11.612470 ip-10-0-130-184 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 01:36:11.612476 ip-10-0-130-184 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 01:36:11.612687 ip-10-0-130-184 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 01:36:21.836676 ip-10-0-130-184 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 01:36:21.836692 ip-10-0-130-184 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 513dbbcbda1a46a78a54e2beca97bc71 -- Jul 09 01:37:57.689547 ip-10-0-130-184 systemd[1]: Starting Kubernetes Kubelet... Jul 09 01:37:58.121721 ip-10-0-130-184 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 01:37:58.121721 ip-10-0-130-184 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 01:37:58.121721 ip-10-0-130-184 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 01:37:58.121721 ip-10-0-130-184 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 01:37:58.121721 ip-10-0-130-184 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 01:37:58.122816 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.122678 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 01:37:58.129371 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129355 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 01:37:58.129371 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129370 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129374 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129377 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129380 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129383 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129388 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129392 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129395 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129397 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129400 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129403 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129406 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129409 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129412 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129415 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129425 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129428 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129431 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129435 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 01:37:58.129435 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129439 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129442 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129445 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129448 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129452 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129455 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129457 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129460 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129463 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129465 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129467 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129470 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129472 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129475 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129477 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129480 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129483 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129485 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129488 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129491 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 01:37:58.129879 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129494 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129496 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129499 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129501 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129504 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129506 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129508 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129511 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129513 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129516 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129518 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129520 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129523 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129525 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129529 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129532 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129534 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129537 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129539 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129542 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 01:37:58.130369 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129545 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129548 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129551 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129554 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129557 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129561 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129564 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129567 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129569 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129572 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129574 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129577 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129580 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129582 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129585 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129587 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129589 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129592 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129595 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129597 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 01:37:58.130892 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129600 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129602 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129605 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129608 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129610 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129612 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129615 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129618 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129621 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129623 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129626 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129628 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129631 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129633 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129636 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129639 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129641 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129644 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.129646 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 01:37:58.131388 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130354 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130361 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130364 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130366 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130369 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130372 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130375 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130378 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130380 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130383 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130386 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130389 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130392 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130394 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130397 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130400 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130402 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130404 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130407 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130411 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 01:37:58.131856 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130414 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130416 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130419 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130422 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130424 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130427 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130429 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130432 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130435 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130438 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130443 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130445 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130448 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130451 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130453 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130456 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130458 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130461 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130464 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130467 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 01:37:58.132462 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130470 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130472 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130475 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130477 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130480 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130482 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130485 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130487 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130489 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130492 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130494 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130497 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130500 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130503 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130505 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130508 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130510 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130513 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130515 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 01:37:58.132951 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130517 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130522 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130526 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130529 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130532 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130535 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130538 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130541 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130544 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130547 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130549 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130552 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130555 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130558 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130561 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130563 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130567 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130569 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130573 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 01:37:58.133447 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130576 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130580 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130582 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130585 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130588 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130591 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130594 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130597 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130600 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130602 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130605 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130608 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130610 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130613 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130615 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130618 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130620 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130623 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130625 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130627 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 01:37:58.133912 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.130630 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131031 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131036 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131039 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131041 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131045 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131047 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131050 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131053 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131055 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131058 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131060 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131063 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131065 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131068 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131070 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131073 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131076 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131079 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131081 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 01:37:58.134420 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131084 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131087 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131090 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131092 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131095 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131097 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131100 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131102 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131105 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131107 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131110 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131112 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131115 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131118 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131120 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131123 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131125 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131127 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131131 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 01:37:58.134899 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131135 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131139 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131141 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131144 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131147 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131150 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131152 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131155 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131158 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131161 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131164 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131166 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131169 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131172 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131174 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131177 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131179 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131182 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131185 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131187 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 01:37:58.135374 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131190 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131192 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131196 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131199 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131201 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131205 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131207 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131210 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131212 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131215 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131217 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131234 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131237 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131240 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131243 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131247 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131250 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131253 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131256 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 01:37:58.135894 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131259 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131264 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131267 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131271 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131274 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131277 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131279 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131282 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131284 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131287 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131290 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131292 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131295 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131297 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131300 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131302 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131305 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131308 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131310 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131313 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 01:37:58.136368 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131315 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131318 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131386 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131393 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131400 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131404 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131409 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131413 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131417 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131421 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131425 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131428 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131431 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131436 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131440 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131444 2565 flags.go:64] FLAG: --cgroup-root="" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131447 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131450 2565 flags.go:64] FLAG: --client-ca-file="" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131453 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131456 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131460 2565 flags.go:64] FLAG: --cluster-domain="" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131462 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131466 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131469 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 01:37:58.136848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131472 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131476 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131479 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131482 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131485 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131489 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131492 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131494 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131498 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131501 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131504 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131508 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131510 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131513 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131516 2565 flags.go:64] FLAG: --enable-server="true" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131519 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131525 2565 flags.go:64] FLAG: --event-burst="100" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131529 2565 flags.go:64] FLAG: --event-qps="50" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131531 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131534 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131537 2565 flags.go:64] FLAG: --eviction-hard="" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131543 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131545 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131553 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131556 2565 flags.go:64] FLAG: --eviction-soft="" Jul 09 01:37:58.137450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131559 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131562 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131565 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131568 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131571 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131574 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131577 2565 flags.go:64] FLAG: --feature-gates="" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131580 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131583 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131586 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131590 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131593 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131596 2565 flags.go:64] FLAG: --help="false" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131599 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131602 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131605 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131607 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131611 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131614 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131617 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131619 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131622 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131625 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 01:37:58.138275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131628 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131631 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131634 2565 flags.go:64] FLAG: --kube-reserved="" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131637 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131639 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131644 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131647 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131651 2565 flags.go:64] FLAG: --lock-file="" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131654 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131657 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131660 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131665 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131668 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131671 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131674 2565 flags.go:64] FLAG: --logging-format="text" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131677 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131680 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131683 2565 flags.go:64] FLAG: --manifest-url="" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131686 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131690 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131693 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131696 2565 flags.go:64] FLAG: --max-pods="110" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131699 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131702 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131705 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 01:37:58.139296 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131708 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131710 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131713 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131716 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131723 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131726 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131729 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131732 2565 flags.go:64] FLAG: --pod-cidr="" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131735 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131740 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131743 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131746 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131749 2565 flags.go:64] FLAG: --port="10250" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131753 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131757 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b9e25ce39de0807c" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131760 2565 flags.go:64] FLAG: --qos-reserved="" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131763 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131766 2565 flags.go:64] FLAG: --register-node="true" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131769 2565 flags.go:64] FLAG: --register-with-taints="" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131773 2565 flags.go:64] FLAG: --registry-burst="10" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131776 2565 flags.go:64] FLAG: --registry-qps="5" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131778 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131781 2565 flags.go:64] FLAG: --reserved-memory="" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131785 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131788 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 01:37:58.140427 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131791 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131794 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131796 2565 flags.go:64] FLAG: --runonce="false" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131799 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131802 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131805 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131808 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131810 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131813 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131816 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131819 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131823 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131825 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131829 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131832 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131835 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131838 2565 flags.go:64] FLAG: --system-cgroups="" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131841 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131846 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131849 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131853 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131858 2565 flags.go:64] FLAG: --tls-min-version="" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131862 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131864 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131867 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 01:37:58.141532 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131870 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131873 2565 flags.go:64] FLAG: --v="2" Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131877 2565 flags.go:64] FLAG: --version="false" Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131881 2565 flags.go:64] FLAG: --vmodule="" Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131885 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.131888 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.131999 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132003 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132007 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132010 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132012 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132015 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132017 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132020 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132023 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132025 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132029 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132032 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132035 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132038 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132040 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 01:37:58.142172 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132043 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132045 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132048 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132051 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132053 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132056 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132060 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132065 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132069 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132072 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132075 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132078 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132081 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132084 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132086 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132089 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132092 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132094 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132097 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132099 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 01:37:58.143041 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132102 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132105 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132107 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132110 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132112 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132115 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132117 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132120 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132122 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132125 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132127 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132129 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132132 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132135 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132137 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132140 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132142 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132145 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132149 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 01:37:58.143827 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132153 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132155 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132158 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132160 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132163 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132166 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132168 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132171 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132175 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132178 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132181 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132183 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132186 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132189 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132192 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132195 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132197 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132200 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132203 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132205 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 01:37:58.144483 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132208 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132211 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132213 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132216 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132231 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132234 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132237 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132240 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132243 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132245 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132255 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132260 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132265 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132267 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132270 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132273 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132275 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132278 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132281 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132283 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 01:37:58.145078 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132286 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132289 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132291 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132294 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.132296 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.132302 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.139972 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.139993 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.140016 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.140025 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140110 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140119 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140125 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140131 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140138 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 01:37:58.145648 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140143 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140147 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140151 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140156 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140160 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140165 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140169 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140173 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140178 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140182 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140187 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140191 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140196 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140200 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140205 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140209 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140213 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140218 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140240 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140245 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 01:37:58.146024 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140249 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140254 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140258 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140262 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140269 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140273 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140277 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140281 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140286 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140290 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140294 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140298 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140302 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140306 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140310 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140315 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140319 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140323 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140328 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140332 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 01:37:58.146578 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140336 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140340 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140345 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140349 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140353 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140358 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140362 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140367 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140372 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140376 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140380 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140385 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140389 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140393 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140397 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140402 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140407 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140412 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140419 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 01:37:58.147065 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140425 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140429 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140433 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140439 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140443 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140448 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140452 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140456 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140461 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140466 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140471 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140475 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140479 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140483 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140488 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140492 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140496 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140500 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140504 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 01:37:58.147604 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140508 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140513 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140519 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140524 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140529 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140535 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140539 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140543 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140547 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140552 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140557 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140561 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140566 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140570 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140575 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 01:37:58.148062 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140579 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.140588 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140792 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140801 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140806 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140811 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140815 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140819 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140823 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140828 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140832 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140836 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140841 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140845 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140849 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 01:37:58.148585 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140854 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140858 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140862 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140866 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140870 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140875 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140879 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140886 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140891 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140896 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140903 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140909 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140914 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140919 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140923 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140929 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140933 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140938 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140942 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 01:37:58.148982 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140946 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140950 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140954 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140958 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140963 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140967 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140971 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140976 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140980 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140984 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140988 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140992 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.140996 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141000 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141004 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141011 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141016 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141021 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141025 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141029 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 01:37:58.149663 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141033 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141037 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141041 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141045 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141050 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141054 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141058 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141062 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141067 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141072 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141076 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141080 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141084 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141088 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141092 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141096 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141100 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141104 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141108 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141113 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 01:37:58.150208 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141117 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141121 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141125 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141129 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141133 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141137 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141141 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141146 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141150 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141154 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141165 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141170 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141174 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141178 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141182 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141186 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141190 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141194 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141199 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141203 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 01:37:58.150789 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141207 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 01:37:58.151321 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141211 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 01:37:58.151321 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141216 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 01:37:58.151321 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141240 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 01:37:58.151321 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141244 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 01:37:58.151321 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141247 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 01:37:58.151321 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:58.141251 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 01:37:58.151321 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.141258 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 01:37:58.151321 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.141413 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 01:37:58.151321 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.144522 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 01:37:58.151321 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.146237 2565 server.go:1019] "Starting client certificate rotation" Jul 09 01:37:58.151321 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.146344 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 01:37:58.151321 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.146386 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 01:37:58.152144 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.152127 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 01:37:58.155123 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.155108 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 01:37:58.167968 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.167949 2565 log.go:25] "Validated CRI v1 runtime API" Jul 09 01:37:58.170140 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.170125 2565 log.go:25] "Validated CRI v1 image API" Jul 09 01:37:58.172632 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.172615 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 01:37:58.175088 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.175070 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ab711581-5fe2-4e8f-ba35-bf1f6a44eb5e:/dev/nvme0n1p3 efb26f68-21ba-45e7-9da1-af672ccd0060:/dev/nvme0n1p4] Jul 09 01:37:58.175143 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.175088 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 01:37:58.175808 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.175783 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 01:37:58.181171 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.181051 2565 manager.go:216] Machine: {Timestamp:2026-07-09 01:37:58.179649419 +0000 UTC m=+0.379038170 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099794 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d8a708a687d1d671c2fef2873c325 SystemUUID:ec2d8a70-8a68-7d1d-671c-2fef2873c325 BootID:513dbbcb-da1a-46a7-8a54-e2beca97bc71 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5b:aa:30:62:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5b:aa:30:62:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:8e:6d:4b:73:47 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 01:37:58.181171 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.181155 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 01:37:58.181322 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.181265 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 01:37:58.184704 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.184676 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 01:37:58.184843 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.184707 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-184.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 01:37:58.185537 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.185527 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 01:37:58.185576 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.185539 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 01:37:58.185576 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.185547 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 01:37:58.186341 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.186330 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 01:37:58.188068 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.188059 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 01:37:58.191537 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.191526 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 09 01:37:58.191652 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.191643 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 01:37:58.191689 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.191675 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 09 01:37:58.192369 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.192357 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 01:37:58.192414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.192382 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 01:37:58.192414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.192394 2565 kubelet.go:398] "Adding apiserver pod source" Jul 09 01:37:58.192414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.192409 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 01:37:58.192750 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.192739 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 01:37:58.192785 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.192756 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 01:37:58.195185 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.195169 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 01:37:58.198578 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.198561 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 01:37:58.198652 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.198593 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 01:37:58.200056 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.200044 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 01:37:58.200099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.200061 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 01:37:58.200099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.200067 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 01:37:58.200099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.200073 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 01:37:58.200099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.200086 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 01:37:58.200099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.200092 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 01:37:58.200099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.200101 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 01:37:58.200270 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.200107 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 01:37:58.200270 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.200114 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 01:37:58.200270 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.200120 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 01:37:58.200270 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.200129 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 01:37:58.200270 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.200135 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 01:37:58.201037 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.201026 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 01:37:58.201069 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.201038 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 01:37:58.201291 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.201274 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2xq4v" Jul 09 01:37:58.202729 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.202702 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 01:37:58.202729 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.202706 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 01:37:58.204347 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.204335 2565 server.go:1268] "Started kubelet" Jul 09 01:37:58.204432 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.204405 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 01:37:58.204587 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.204406 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 01:37:58.204681 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.204617 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 01:37:58.205150 ip-10-0-130-184 systemd[1]: Started Kubernetes Kubelet. Jul 09 01:37:58.206215 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.206199 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 09 01:37:58.208719 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.208687 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 01:37:58.209182 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.209169 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 01:37:58.209367 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.209353 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2xq4v" Jul 09 01:37:58.213480 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.213458 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-184.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 01:37:58.214534 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.213474 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-184.ec2.internal.18c07b59d594900e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-184.ec2.internal,UID:ip-10-0-130-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-184.ec2.internal,},FirstTimestamp:2026-07-09 01:37:58.204305422 +0000 UTC m=+0.403694232,LastTimestamp:2026-07-09 01:37:58.204305422 +0000 UTC m=+0.403694232,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-184.ec2.internal,}" Jul 09 01:37:58.217167 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.217138 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 01:37:58.217167 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.217153 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 01:37:58.217320 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.217291 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-184.ec2.internal\" not found" Jul 09 01:37:58.217984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.217962 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 01:37:58.217984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.217985 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 01:37:58.218114 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.218048 2565 factory.go:55] Registering systemd factory Jul 09 01:37:58.218114 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.217967 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 01:37:58.218114 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.218063 2565 factory.go:223] Registration of the systemd container factory successfully Jul 09 01:37:58.218259 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.218129 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 09 01:37:58.218259 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.218137 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 09 01:37:58.218342 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.218336 2565 factory.go:153] Registering CRI-O factory Jul 09 01:37:58.218395 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.218350 2565 factory.go:223] Registration of the crio container factory successfully Jul 09 01:37:58.218435 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.218401 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 01:37:58.218435 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.218425 2565 factory.go:103] Registering Raw factory Jul 09 01:37:58.218529 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.218439 2565 manager.go:1196] Started watching for new ooms in manager Jul 09 01:37:58.219468 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.219439 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 01:37:58.219562 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.219471 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 01:37:58.219757 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.219742 2565 manager.go:349] Starting recovery of all containers Jul 09 01:37:58.231179 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.231019 2565 manager.go:354] Recovery completed Jul 09 01:37:58.235770 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.235755 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:58.237701 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.237683 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:58.237788 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.237713 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:58.237788 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.237723 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:58.238286 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.238270 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 01:37:58.238286 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.238286 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 01:37:58.238391 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.238290 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:58.238391 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.238303 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 09 01:37:58.239506 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.239495 2565 policy_none.go:49] "None policy: Start" Jul 09 01:37:58.239549 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.239512 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 01:37:58.239549 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.239529 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 01:37:58.240445 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.240436 2565 policy_none.go:47] "Start" Jul 09 01:37:58.246269 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.246251 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:58.246336 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.246288 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:58.246336 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.246305 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:58.276802 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.276784 2565 manager.go:337] "Starting Device Plugin manager" Jul 09 01:37:58.276919 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.276821 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 01:37:58.276919 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.276833 2565 server.go:87] "Starting device plugin registration server" Jul 09 01:37:58.277089 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.277076 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 01:37:58.277156 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.277091 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 01:37:58.277218 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.277183 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 01:37:58.277334 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.277270 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 01:37:58.277334 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.277278 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 01:37:58.278875 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.278853 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 01:37:58.278958 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.278910 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-184.ec2.internal\" not found" Jul 09 01:37:58.330091 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.330052 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 01:37:58.332142 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.331212 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 01:37:58.332142 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.331254 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 01:37:58.332142 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.331281 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 01:37:58.332142 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.331313 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 01:37:58.334400 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.334383 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 01:37:58.377906 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.377841 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:58.378888 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.378871 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:58.378991 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.378900 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:58.378991 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.378911 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:58.378991 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.378934 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.386892 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.386876 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.386989 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.386902 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-184.ec2.internal\": node \"ip-10-0-130-184.ec2.internal\" not found" Jul 09 01:37:58.411966 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.411943 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-184.ec2.internal\" not found" Jul 09 01:37:58.432087 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.432063 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-184.ec2.internal"] Jul 09 01:37:58.432190 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.432125 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:58.432963 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.432949 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:58.433020 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.432978 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:58.433020 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.432987 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:58.435170 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.435157 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:58.435304 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.435288 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.435359 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.435325 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:58.435905 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.435890 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:58.435963 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.435917 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:58.435963 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.435928 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:58.436025 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.435894 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:58.436025 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.435980 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:58.436025 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.435990 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:58.438121 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.438104 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.438209 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.438128 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:58.438729 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.438715 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:58.438782 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.438746 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:58.438782 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.438761 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:58.473021 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.472999 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-184.ec2.internal\" not found" node="ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.477487 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.477467 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-184.ec2.internal\" not found" node="ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.512314 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.512294 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-184.ec2.internal\" not found" Jul 09 01:37:58.519563 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.519544 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa270ef1e2da30182fb1ce8e87a3f7c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal\" (UID: \"fa270ef1e2da30182fb1ce8e87a3f7c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.519623 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.519575 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa270ef1e2da30182fb1ce8e87a3f7c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal\" (UID: \"fa270ef1e2da30182fb1ce8e87a3f7c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.519623 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.519594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/81d8756a43625938ca8b36e75b20e52a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-184.ec2.internal\" (UID: \"81d8756a43625938ca8b36e75b20e52a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.613413 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.613379 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-184.ec2.internal\" not found" Jul 09 01:37:58.619718 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.619699 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa270ef1e2da30182fb1ce8e87a3f7c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal\" (UID: \"fa270ef1e2da30182fb1ce8e87a3f7c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.619796 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.619727 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa270ef1e2da30182fb1ce8e87a3f7c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal\" (UID: \"fa270ef1e2da30182fb1ce8e87a3f7c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.619796 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.619746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/81d8756a43625938ca8b36e75b20e52a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-184.ec2.internal\" (UID: \"81d8756a43625938ca8b36e75b20e52a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.619796 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.619791 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/81d8756a43625938ca8b36e75b20e52a-config\") pod \"kube-apiserver-proxy-ip-10-0-130-184.ec2.internal\" (UID: \"81d8756a43625938ca8b36e75b20e52a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.619936 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.619797 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa270ef1e2da30182fb1ce8e87a3f7c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal\" (UID: \"fa270ef1e2da30182fb1ce8e87a3f7c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.619936 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.619909 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa270ef1e2da30182fb1ce8e87a3f7c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal\" (UID: \"fa270ef1e2da30182fb1ce8e87a3f7c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.714215 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.714137 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-184.ec2.internal\" not found" Jul 09 01:37:58.776620 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.776593 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.780977 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:58.780941 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-184.ec2.internal" Jul 09 01:37:58.814729 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.814692 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-184.ec2.internal\" not found" Jul 09 01:37:58.915315 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:58.915269 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-184.ec2.internal\" not found" Jul 09 01:37:59.015818 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:59.015744 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-184.ec2.internal\" not found" Jul 09 01:37:59.074748 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.074718 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 01:37:59.117341 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.117309 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" Jul 09 01:37:59.129596 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.129576 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 01:37:59.131457 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.131441 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-184.ec2.internal" Jul 09 01:37:59.140763 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.140741 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 01:37:59.145864 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.145850 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 01:37:59.145968 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.145953 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 01:37:59.146027 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.146002 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 01:37:59.193182 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.193148 2565 apiserver.go:52] "Watching apiserver" Jul 09 01:37:59.211070 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.211048 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 01:37:59.214037 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.212912 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-f5dkk","openshift-network-diagnostics/network-check-target-9pjtm","openshift-network-operator/iptables-alerter-8lnhk","openshift-ovn-kubernetes/ovnkube-node-w4rwf","kube-system/global-pull-secret-syncer-nd79x","kube-system/konnectivity-agent-9d2pm","kube-system/kube-apiserver-proxy-ip-10-0-130-184.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj","openshift-image-registry/node-ca-zktpv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal","openshift-multus/multus-d6hhc","openshift-multus/network-metrics-daemon-s7zrq","openshift-cluster-node-tuning-operator/tuned-s7rqw","openshift-dns/node-resolver-lvjrf"] Jul 09 01:37:59.215878 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.215809 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 01:32:59 +0000 UTC" deadline="2028-03-21 10:11:50.530661896 +0000 UTC" Jul 09 01:37:59.215878 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.215864 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14912h33m51.314800636s" Jul 09 01:37:59.216030 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.216010 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.217413 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.217392 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 01:37:59.218785 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.218767 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:37:59.218878 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:59.218847 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:37:59.219495 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.219479 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 01:37:59.219818 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.219803 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 01:37:59.219892 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.219879 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pmjng\"" Jul 09 01:37:59.221429 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.221411 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8lnhk" Jul 09 01:37:59.222936 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.222918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-run\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223048 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.222944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-var-lib-kubelet\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223048 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.222961 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbrfl\" (UniqueName: \"kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl\") pod \"network-check-target-9pjtm\" (UID: \"53c92713-90e9-4d9d-b5c6-f0f15a33fc82\") " pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:37:59.223048 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.222977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-host\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223048 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223015 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-tuned\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223189 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-sysconfig\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223189 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223089 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-kubernetes\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223189 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223110 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-sysctl-d\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223189 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-sysctl-conf\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223189 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223153 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-lib-modules\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223189 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223169 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-tmp\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223189 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223189 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-modprobe-d\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223204 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-systemd\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223218 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-sys\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2bs4\" (UniqueName: \"kubernetes.io/projected/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-kube-api-access-b2bs4\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.223893 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223874 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 01:37:59.223893 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223887 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 01:37:59.223987 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223892 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mm556\"" Jul 09 01:37:59.223987 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.223900 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 01:37:59.224136 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.224124 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.226251 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.226235 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 01:37:59.226643 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.226626 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w8xxz\"" Jul 09 01:37:59.226739 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.226727 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:37:59.226794 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:59.226783 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:37:59.227112 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.227099 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 01:37:59.227112 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.227108 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 01:37:59.227211 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.227149 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 01:37:59.228079 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.228063 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 01:37:59.228172 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.228066 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 01:37:59.229297 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.229280 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9d2pm" Jul 09 01:37:59.231074 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.231056 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 01:37:59.231898 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.231869 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vkltz\"" Jul 09 01:37:59.231987 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.231967 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 01:37:59.232051 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.231970 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 01:37:59.232168 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.232057 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.233976 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.233962 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8j8tp\"" Jul 09 01:37:59.234304 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.234290 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 01:37:59.234352 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.234304 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 01:37:59.234400 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.234308 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 01:37:59.234400 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.234378 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 01:37:59.234491 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.234478 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 01:37:59.234738 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.234724 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.236566 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.236544 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 01:37:59.236691 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.236626 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 01:37:59.236691 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.236633 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-thfbn\"" Jul 09 01:37:59.236798 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.236752 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 01:37:59.237660 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.237645 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zktpv" Jul 09 01:37:59.239571 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.239556 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 01:37:59.239748 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.239723 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fnnvt\"" Jul 09 01:37:59.239748 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.239737 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 01:37:59.239866 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.239738 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 01:37:59.240502 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.240488 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lvjrf" Jul 09 01:37:59.242484 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.242465 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 01:37:59.242581 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.242531 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.242645 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.242617 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 01:37:59.242694 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.242670 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5jj8h\"" Jul 09 01:37:59.244835 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.244821 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mrg8z\"" Jul 09 01:37:59.244933 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.244920 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:37:59.245010 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:59.244984 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:37:59.245010 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.245000 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 01:37:59.255567 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.255546 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qt6zd" Jul 09 01:37:59.263198 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.263178 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qt6zd" Jul 09 01:37:59.286826 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.286806 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 01:37:59.318873 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.318852 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 01:37:59.324301 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-kubelet\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.324414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f756d1de-5c46-4697-afb8-126ef3e9569e-agent-certs\") pod \"konnectivity-agent-9d2pm\" (UID: \"f756d1de-5c46-4697-afb8-126ef3e9569e\") " pod="kube-system/konnectivity-agent-9d2pm" Jul 09 01:37:59.324414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324324 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/703c3024-5208-43d1-829e-bc840655bf9c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.324414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324342 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-multus-daemon-config\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.324414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-var-lib-openvswitch\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.324414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324397 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-node-log\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.324655 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324430 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-log-socket\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.324655 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f756d1de-5c46-4697-afb8-126ef3e9569e-konnectivity-ca\") pod \"konnectivity-agent-9d2pm\" (UID: \"f756d1de-5c46-4697-afb8-126ef3e9569e\") " pod="kube-system/konnectivity-agent-9d2pm" Jul 09 01:37:59.324655 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324485 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq2pt\" (UniqueName: \"kubernetes.io/projected/c975edec-2157-4f50-85fc-102b756da42b-kube-api-access-hq2pt\") pod \"network-metrics-daemon-s7zrq\" (UID: \"c975edec-2157-4f50-85fc-102b756da42b\") " pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:37:59.324655 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324511 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-run-ovn-kubernetes\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.324655 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324536 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd4dd34d-7366-480d-9861-b222d7d68539-env-overrides\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.324655 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-sys\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.324655 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324633 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/703c3024-5208-43d1-829e-bc840655bf9c-system-cni-dir\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.324655 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-registration-dir\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324633 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-sys\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-hostroot\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324691 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-multus-conf-dir\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-run\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324726 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbrfl\" (UniqueName: \"kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl\") pod \"network-check-target-9pjtm\" (UID: \"53c92713-90e9-4d9d-b5c6-f0f15a33fc82\") " pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324739 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/703c3024-5208-43d1-829e-bc840655bf9c-cnibin\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324779 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-run\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/703c3024-5208-43d1-829e-bc840655bf9c-cni-binary-copy\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324841 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-os-release\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324869 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-cnibin\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-host\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324925 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzvh4\" (UniqueName: \"kubernetes.io/projected/1b41e12d-c223-4f99-ab36-8bde264d2828-kube-api-access-bzvh4\") pod \"iptables-alerter-8lnhk\" (UID: \"1b41e12d-c223-4f99-ab36-8bde264d2828\") " pod="openshift-network-operator/iptables-alerter-8lnhk" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324954 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-host\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324951 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wf26\" (UniqueName: \"kubernetes.io/projected/703c3024-5208-43d1-829e-bc840655bf9c-kube-api-access-8wf26\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324980 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-sys-fs\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.325003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.324999 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn6lw\" (UniqueName: \"kubernetes.io/projected/a4b12f0c-9647-466d-9823-a5273d80b153-kube-api-access-cn6lw\") pod \"node-resolver-lvjrf\" (UID: \"a4b12f0c-9647-466d-9823-a5273d80b153\") " pod="openshift-dns/node-resolver-lvjrf" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325028 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-multus-cni-dir\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-systemd-units\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325065 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-run-multus-certs\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325085 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-kubernetes\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325100 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-sysctl-d\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325115 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-lib-modules\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325136 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4b12f0c-9647-466d-9823-a5273d80b153-tmp-dir\") pod \"node-resolver-lvjrf\" (UID: \"a4b12f0c-9647-466d-9823-a5273d80b153\") " pod="openshift-dns/node-resolver-lvjrf" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325185 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-kubernetes\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325241 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-run-k8s-cni-cncf-io\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325255 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-lib-modules\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325287 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-run-netns\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325295 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-sysctl-d\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325307 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5982d2fd-d322-47cf-a233-c41afb3ff1fd-dbus\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325328 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-var-lib-cni-multus\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-modprobe-d\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325376 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-systemd\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.325772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325406 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd4dd34d-7366-480d-9861-b222d7d68539-ovn-node-metrics-cert\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325430 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/703c3024-5208-43d1-829e-bc840655bf9c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-etc-kubernetes\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325469 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-systemd\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325472 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-etc-openvswitch\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325490 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-modprobe-d\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325540 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325568 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd4dd34d-7366-480d-9861-b222d7d68539-ovnkube-script-lib\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325592 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66008bdf-c7e5-43e0-a569-61692022b688-host\") pod \"node-ca-zktpv\" (UID: \"66008bdf-c7e5-43e0-a569-61692022b688\") " pod="openshift-image-registry/node-ca-zktpv" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325625 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-tuned\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325663 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/703c3024-5208-43d1-829e-bc840655bf9c-os-release\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325693 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-socket-dir\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325708 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-etc-selinux\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325724 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf89w\" (UniqueName: \"kubernetes.io/projected/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-kube-api-access-kf89w\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325759 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-run-openvswitch\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325793 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-sysctl-conf\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.326470 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325818 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b41e12d-c223-4f99-ab36-8bde264d2828-iptables-alerter-script\") pod \"iptables-alerter-8lnhk\" (UID: \"1b41e12d-c223-4f99-ab36-8bde264d2828\") " pod="openshift-network-operator/iptables-alerter-8lnhk" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/703c3024-5208-43d1-829e-bc840655bf9c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325856 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-system-cni-dir\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-var-lib-kubelet\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-run-netns\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325921 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-run-systemd\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325907 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325876 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-sysctl-conf\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325939 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd4dd34d-7366-480d-9861-b222d7d68539-ovnkube-config\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsbcx\" (UniqueName: \"kubernetes.io/projected/dd4dd34d-7366-480d-9861-b222d7d68539-kube-api-access-gsbcx\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.325987 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-var-lib-cni-bin\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326017 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-var-lib-kubelet\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326035 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-device-dir\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5982d2fd-d322-47cf-a233-c41afb3ff1fd-kubelet-config\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs\") pod \"network-metrics-daemon-s7zrq\" (UID: \"c975edec-2157-4f50-85fc-102b756da42b\") " pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326085 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4kls\" (UniqueName: \"kubernetes.io/projected/41380c2b-d120-439a-a1ba-0b814e1ba199-kube-api-access-j4kls\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326105 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-cni-bin\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.327240 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326142 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-var-lib-kubelet\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66008bdf-c7e5-43e0-a569-61692022b688-serviceca\") pod \"node-ca-zktpv\" (UID: \"66008bdf-c7e5-43e0-a569-61692022b688\") " pod="openshift-image-registry/node-ca-zktpv" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-sysconfig\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326200 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-tmp\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326214 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b41e12d-c223-4f99-ab36-8bde264d2828-host-slash\") pod \"iptables-alerter-8lnhk\" (UID: \"1b41e12d-c223-4f99-ab36-8bde264d2828\") " pod="openshift-network-operator/iptables-alerter-8lnhk" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4b12f0c-9647-466d-9823-a5273d80b153-hosts-file\") pod \"node-resolver-lvjrf\" (UID: \"a4b12f0c-9647-466d-9823-a5273d80b153\") " pod="openshift-dns/node-resolver-lvjrf" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326305 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-sysconfig\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-cni-binary-copy\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326335 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-multus-socket-dir-parent\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-slash\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-run-ovn\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2bs4\" (UniqueName: \"kubernetes.io/projected/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-kube-api-access-b2bs4\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326480 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-cni-netd\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326523 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:37:59.328105 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.326541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzq7w\" (UniqueName: \"kubernetes.io/projected/66008bdf-c7e5-43e0-a569-61692022b688-kube-api-access-gzq7w\") pod \"node-ca-zktpv\" (UID: \"66008bdf-c7e5-43e0-a569-61692022b688\") " pod="openshift-image-registry/node-ca-zktpv" Jul 09 01:37:59.328784 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.328758 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-etc-tuned\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.328886 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.328821 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-tmp\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.333574 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:59.333552 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:37:59.333574 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:59.333576 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:37:59.333713 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:59.333587 2565 projected.go:196] Error preparing data for projected volume kube-api-access-hbrfl for pod openshift-network-diagnostics/network-check-target-9pjtm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:37:59.333713 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:59.333675 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl podName:53c92713-90e9-4d9d-b5c6-f0f15a33fc82 nodeName:}" failed. No retries permitted until 2026-07-09 01:37:59.833655839 +0000 UTC m=+2.033044581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hbrfl" (UniqueName: "kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl") pod "network-check-target-9pjtm" (UID: "53c92713-90e9-4d9d-b5c6-f0f15a33fc82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:37:59.335803 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.335779 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2bs4\" (UniqueName: \"kubernetes.io/projected/1a436513-d78c-4b4d-b7c3-6da9bb1be63a-kube-api-access-b2bs4\") pod \"tuned-s7rqw\" (UID: \"1a436513-d78c-4b4d-b7c3-6da9bb1be63a\") " pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.371822 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:59.371773 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d8756a43625938ca8b36e75b20e52a.slice/crio-f8ebc09fa34ed9df8368562f89f7877e9a65555539abca154fe1a312f002e903 WatchSource:0}: Error finding container f8ebc09fa34ed9df8368562f89f7877e9a65555539abca154fe1a312f002e903: Status 404 returned error can't find the container with id f8ebc09fa34ed9df8368562f89f7877e9a65555539abca154fe1a312f002e903 Jul 09 01:37:59.376772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.376753 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 01:37:59.383012 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:59.382992 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa270ef1e2da30182fb1ce8e87a3f7c2.slice/crio-f5e7d100422564b15e6d1c771ceef0f48c43e026d92d69ead08fcef80cae1b54 WatchSource:0}: Error finding container f5e7d100422564b15e6d1c771ceef0f48c43e026d92d69ead08fcef80cae1b54: Status 404 returned error can't find the container with id f5e7d100422564b15e6d1c771ceef0f48c43e026d92d69ead08fcef80cae1b54 Jul 09 01:37:59.427138 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427111 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzq7w\" (UniqueName: \"kubernetes.io/projected/66008bdf-c7e5-43e0-a569-61692022b688-kube-api-access-gzq7w\") pod \"node-ca-zktpv\" (UID: \"66008bdf-c7e5-43e0-a569-61692022b688\") " pod="openshift-image-registry/node-ca-zktpv" Jul 09 01:37:59.427138 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-kubelet\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.427337 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427155 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f756d1de-5c46-4697-afb8-126ef3e9569e-agent-certs\") pod \"konnectivity-agent-9d2pm\" (UID: \"f756d1de-5c46-4697-afb8-126ef3e9569e\") " pod="kube-system/konnectivity-agent-9d2pm" Jul 09 01:37:59.427337 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/703c3024-5208-43d1-829e-bc840655bf9c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.427337 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-multus-daemon-config\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.427337 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427235 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-kubelet\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.427337 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427274 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-var-lib-openvswitch\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.427337 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427316 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-node-log\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.427616 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427340 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-log-socket\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.427616 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427363 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f756d1de-5c46-4697-afb8-126ef3e9569e-konnectivity-ca\") pod \"konnectivity-agent-9d2pm\" (UID: \"f756d1de-5c46-4697-afb8-126ef3e9569e\") " pod="kube-system/konnectivity-agent-9d2pm" Jul 09 01:37:59.427616 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427362 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-var-lib-openvswitch\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.427616 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427362 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/703c3024-5208-43d1-829e-bc840655bf9c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.427616 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427404 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-node-log\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.427616 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427404 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-log-socket\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.427616 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427459 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq2pt\" (UniqueName: \"kubernetes.io/projected/c975edec-2157-4f50-85fc-102b756da42b-kube-api-access-hq2pt\") pod \"network-metrics-daemon-s7zrq\" (UID: \"c975edec-2157-4f50-85fc-102b756da42b\") " pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:37:59.427616 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427478 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-run-ovn-kubernetes\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.427616 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427514 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd4dd34d-7366-480d-9861-b222d7d68539-env-overrides\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.427616 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427543 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/703c3024-5208-43d1-829e-bc840655bf9c-system-cni-dir\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.427616 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427518 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-run-ovn-kubernetes\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.427616 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427578 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-registration-dir\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.427616 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-hostroot\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427626 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-multus-conf-dir\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/703c3024-5208-43d1-829e-bc840655bf9c-cnibin\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427670 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-registration-dir\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/703c3024-5208-43d1-829e-bc840655bf9c-cni-binary-copy\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427718 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/703c3024-5208-43d1-829e-bc840655bf9c-system-cni-dir\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427735 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-multus-daemon-config\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427770 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-multus-conf-dir\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-os-release\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427805 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-cnibin\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427808 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-hostroot\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427832 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvh4\" (UniqueName: \"kubernetes.io/projected/1b41e12d-c223-4f99-ab36-8bde264d2828-kube-api-access-bzvh4\") pod \"iptables-alerter-8lnhk\" (UID: \"1b41e12d-c223-4f99-ab36-8bde264d2828\") " pod="openshift-network-operator/iptables-alerter-8lnhk" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427851 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/703c3024-5208-43d1-829e-bc840655bf9c-cnibin\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wf26\" (UniqueName: \"kubernetes.io/projected/703c3024-5208-43d1-829e-bc840655bf9c-kube-api-access-8wf26\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427883 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-sys-fs\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427913 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn6lw\" (UniqueName: \"kubernetes.io/projected/a4b12f0c-9647-466d-9823-a5273d80b153-kube-api-access-cn6lw\") pod \"node-resolver-lvjrf\" (UID: \"a4b12f0c-9647-466d-9823-a5273d80b153\") " pod="openshift-dns/node-resolver-lvjrf" Jul 09 01:37:59.428294 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427937 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-multus-cni-dir\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427947 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f756d1de-5c46-4697-afb8-126ef3e9569e-konnectivity-ca\") pod \"konnectivity-agent-9d2pm\" (UID: \"f756d1de-5c46-4697-afb8-126ef3e9569e\") " pod="kube-system/konnectivity-agent-9d2pm" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-systemd-units\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427953 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-run-multus-certs\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427997 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-sys-fs\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428000 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd4dd34d-7366-480d-9861-b222d7d68539-env-overrides\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428050 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-run-multus-certs\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428099 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-cnibin\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4b12f0c-9647-466d-9823-a5273d80b153-tmp-dir\") pod \"node-resolver-lvjrf\" (UID: \"a4b12f0c-9647-466d-9823-a5273d80b153\") " pod="openshift-dns/node-resolver-lvjrf" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.427913 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-os-release\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428138 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-systemd-units\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428148 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-run-k8s-cni-cncf-io\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428138 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-multus-cni-dir\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428174 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-run-netns\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428178 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/703c3024-5208-43d1-829e-bc840655bf9c-cni-binary-copy\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428182 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-run-k8s-cni-cncf-io\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428200 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5982d2fd-d322-47cf-a233-c41afb3ff1fd-dbus\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:37:59.429086 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428241 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-run-netns\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-var-lib-cni-multus\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428281 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd4dd34d-7366-480d-9861-b222d7d68539-ovn-node-metrics-cert\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428284 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-var-lib-cni-multus\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428298 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/703c3024-5208-43d1-829e-bc840655bf9c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428329 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5982d2fd-d322-47cf-a233-c41afb3ff1fd-dbus\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428412 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-etc-kubernetes\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428439 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-etc-openvswitch\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428467 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428469 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4b12f0c-9647-466d-9823-a5273d80b153-tmp-dir\") pod \"node-resolver-lvjrf\" (UID: \"a4b12f0c-9647-466d-9823-a5273d80b153\") " pod="openshift-dns/node-resolver-lvjrf" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd4dd34d-7366-480d-9861-b222d7d68539-ovnkube-script-lib\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428517 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428535 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66008bdf-c7e5-43e0-a569-61692022b688-host\") pod \"node-ca-zktpv\" (UID: \"66008bdf-c7e5-43e0-a569-61692022b688\") " pod="openshift-image-registry/node-ca-zktpv" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428527 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-etc-kubernetes\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/703c3024-5208-43d1-829e-bc840655bf9c-os-release\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428585 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66008bdf-c7e5-43e0-a569-61692022b688-host\") pod \"node-ca-zktpv\" (UID: \"66008bdf-c7e5-43e0-a569-61692022b688\") " pod="openshift-image-registry/node-ca-zktpv" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428585 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-socket-dir\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.429984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428611 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/703c3024-5208-43d1-829e-bc840655bf9c-os-release\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428585 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-etc-openvswitch\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428627 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-etc-selinux\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf89w\" (UniqueName: \"kubernetes.io/projected/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-kube-api-access-kf89w\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428678 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-socket-dir\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-run-openvswitch\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428708 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-etc-selinux\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428712 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/703c3024-5208-43d1-829e-bc840655bf9c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b41e12d-c223-4f99-ab36-8bde264d2828-iptables-alerter-script\") pod \"iptables-alerter-8lnhk\" (UID: \"1b41e12d-c223-4f99-ab36-8bde264d2828\") " pod="openshift-network-operator/iptables-alerter-8lnhk" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428763 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/703c3024-5208-43d1-829e-bc840655bf9c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428717 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-run-openvswitch\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-system-cni-dir\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428822 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-var-lib-kubelet\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428832 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-system-cni-dir\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-run-netns\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428871 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-run-systemd\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428894 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd4dd34d-7366-480d-9861-b222d7d68539-ovnkube-config\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.430715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428917 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsbcx\" (UniqueName: \"kubernetes.io/projected/dd4dd34d-7366-480d-9861-b222d7d68539-kube-api-access-gsbcx\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428942 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-var-lib-cni-bin\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-device-dir\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.428991 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5982d2fd-d322-47cf-a233-c41afb3ff1fd-kubelet-config\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs\") pod \"network-metrics-daemon-s7zrq\" (UID: \"c975edec-2157-4f50-85fc-102b756da42b\") " pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4kls\" (UniqueName: \"kubernetes.io/projected/41380c2b-d120-439a-a1ba-0b814e1ba199-kube-api-access-j4kls\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-cni-bin\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66008bdf-c7e5-43e0-a569-61692022b688-serviceca\") pod \"node-ca-zktpv\" (UID: \"66008bdf-c7e5-43e0-a569-61692022b688\") " pod="openshift-image-registry/node-ca-zktpv" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b41e12d-c223-4f99-ab36-8bde264d2828-host-slash\") pod \"iptables-alerter-8lnhk\" (UID: \"1b41e12d-c223-4f99-ab36-8bde264d2828\") " pod="openshift-network-operator/iptables-alerter-8lnhk" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429125 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd4dd34d-7366-480d-9861-b222d7d68539-ovnkube-script-lib\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429136 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4b12f0c-9647-466d-9823-a5273d80b153-hosts-file\") pod \"node-resolver-lvjrf\" (UID: \"a4b12f0c-9647-466d-9823-a5273d80b153\") " pod="openshift-dns/node-resolver-lvjrf" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429168 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-cni-binary-copy\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429193 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-multus-socket-dir-parent\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429218 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-slash\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429246 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-var-lib-kubelet\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-run-ovn\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429272 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/703c3024-5208-43d1-829e-bc840655bf9c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.431206 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429277 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b41e12d-c223-4f99-ab36-8bde264d2828-iptables-alerter-script\") pod \"iptables-alerter-8lnhk\" (UID: \"1b41e12d-c223-4f99-ab36-8bde264d2828\") " pod="openshift-network-operator/iptables-alerter-8lnhk" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-cni-netd\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429295 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-cni-bin\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429192 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-run-netns\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429362 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-cni-netd\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429368 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b41e12d-c223-4f99-ab36-8bde264d2828-host-slash\") pod \"iptables-alerter-8lnhk\" (UID: \"1b41e12d-c223-4f99-ab36-8bde264d2828\") " pod="openshift-network-operator/iptables-alerter-8lnhk" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429379 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5982d2fd-d322-47cf-a233-c41afb3ff1fd-kubelet-config\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429397 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-run-systemd\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429409 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4b12f0c-9647-466d-9823-a5273d80b153-hosts-file\") pod \"node-resolver-lvjrf\" (UID: \"a4b12f0c-9647-466d-9823-a5273d80b153\") " pod="openshift-dns/node-resolver-lvjrf" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429432 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-host-var-lib-cni-bin\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429488 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd4dd34d-7366-480d-9861-b222d7d68539-ovnkube-config\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:59.429585 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429613 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-run-ovn\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429582 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-multus-socket-dir-parent\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429632 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd4dd34d-7366-480d-9861-b222d7d68539-host-slash\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:59.429642 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret podName:5982d2fd-d322-47cf-a233-c41afb3ff1fd nodeName:}" failed. No retries permitted until 2026-07-09 01:37:59.929625148 +0000 UTC m=+2.129013901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret") pod "global-pull-secret-syncer-nd79x" (UID: "5982d2fd-d322-47cf-a233-c41afb3ff1fd") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429685 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41380c2b-d120-439a-a1ba-0b814e1ba199-device-dir\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.431683 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:59.429728 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:37:59.432202 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429787 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66008bdf-c7e5-43e0-a569-61692022b688-serviceca\") pod \"node-ca-zktpv\" (UID: \"66008bdf-c7e5-43e0-a569-61692022b688\") " pod="openshift-image-registry/node-ca-zktpv" Jul 09 01:37:59.432202 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.429808 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-cni-binary-copy\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.432202 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:37:59.429829 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs podName:c975edec-2157-4f50-85fc-102b756da42b nodeName:}" failed. No retries permitted until 2026-07-09 01:37:59.929812673 +0000 UTC m=+2.129201411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs") pod "network-metrics-daemon-s7zrq" (UID: "c975edec-2157-4f50-85fc-102b756da42b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:37:59.432202 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.430620 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f756d1de-5c46-4697-afb8-126ef3e9569e-agent-certs\") pod \"konnectivity-agent-9d2pm\" (UID: \"f756d1de-5c46-4697-afb8-126ef3e9569e\") " pod="kube-system/konnectivity-agent-9d2pm" Jul 09 01:37:59.432202 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.430735 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd4dd34d-7366-480d-9861-b222d7d68539-ovn-node-metrics-cert\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.442236 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.442181 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wf26\" (UniqueName: \"kubernetes.io/projected/703c3024-5208-43d1-829e-bc840655bf9c-kube-api-access-8wf26\") pod \"multus-additional-cni-plugins-f5dkk\" (UID: \"703c3024-5208-43d1-829e-bc840655bf9c\") " pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.442333 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.442306 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn6lw\" (UniqueName: \"kubernetes.io/projected/a4b12f0c-9647-466d-9823-a5273d80b153-kube-api-access-cn6lw\") pod \"node-resolver-lvjrf\" (UID: \"a4b12f0c-9647-466d-9823-a5273d80b153\") " pod="openshift-dns/node-resolver-lvjrf" Jul 09 01:37:59.442632 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.442611 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq2pt\" (UniqueName: \"kubernetes.io/projected/c975edec-2157-4f50-85fc-102b756da42b-kube-api-access-hq2pt\") pod \"network-metrics-daemon-s7zrq\" (UID: \"c975edec-2157-4f50-85fc-102b756da42b\") " pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:37:59.444156 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.444136 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf89w\" (UniqueName: \"kubernetes.io/projected/5a01e5f3-7f8f-41cc-803b-ed84c815bae3-kube-api-access-kf89w\") pod \"multus-d6hhc\" (UID: \"5a01e5f3-7f8f-41cc-803b-ed84c815bae3\") " pod="openshift-multus/multus-d6hhc" Jul 09 01:37:59.444342 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.444271 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsbcx\" (UniqueName: \"kubernetes.io/projected/dd4dd34d-7366-480d-9861-b222d7d68539-kube-api-access-gsbcx\") pod \"ovnkube-node-w4rwf\" (UID: \"dd4dd34d-7366-480d-9861-b222d7d68539\") " pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.444613 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.444594 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzvh4\" (UniqueName: \"kubernetes.io/projected/1b41e12d-c223-4f99-ab36-8bde264d2828-kube-api-access-bzvh4\") pod \"iptables-alerter-8lnhk\" (UID: \"1b41e12d-c223-4f99-ab36-8bde264d2828\") " pod="openshift-network-operator/iptables-alerter-8lnhk" Jul 09 01:37:59.445432 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.445413 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4kls\" (UniqueName: \"kubernetes.io/projected/41380c2b-d120-439a-a1ba-0b814e1ba199-kube-api-access-j4kls\") pod \"aws-ebs-csi-driver-node-dmhwj\" (UID: \"41380c2b-d120-439a-a1ba-0b814e1ba199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.446100 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.446080 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzq7w\" (UniqueName: \"kubernetes.io/projected/66008bdf-c7e5-43e0-a569-61692022b688-kube-api-access-gzq7w\") pod \"node-ca-zktpv\" (UID: \"66008bdf-c7e5-43e0-a569-61692022b688\") " pod="openshift-image-registry/node-ca-zktpv" Jul 09 01:37:59.546414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.546337 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" Jul 09 01:37:59.555654 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.555635 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8lnhk" Jul 09 01:37:59.555950 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:59.555928 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a436513_d78c_4b4d_b7c3_6da9bb1be63a.slice/crio-523e5d48bae8d33b612c2cc4c1598a355ac2830142fde9206fccd77eda1dabbc WatchSource:0}: Error finding container 523e5d48bae8d33b612c2cc4c1598a355ac2830142fde9206fccd77eda1dabbc: Status 404 returned error can't find the container with id 523e5d48bae8d33b612c2cc4c1598a355ac2830142fde9206fccd77eda1dabbc Jul 09 01:37:59.564133 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:59.564110 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b41e12d_c223_4f99_ab36_8bde264d2828.slice/crio-7323e0ca68a79095f2f8940cf375e034851d52533c6a21662b9afc9959c1bbd7 WatchSource:0}: Error finding container 7323e0ca68a79095f2f8940cf375e034851d52533c6a21662b9afc9959c1bbd7: Status 404 returned error can't find the container with id 7323e0ca68a79095f2f8940cf375e034851d52533c6a21662b9afc9959c1bbd7 Jul 09 01:37:59.579094 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.579071 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:37:59.587427 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:59.587382 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd4dd34d_7366_480d_9861_b222d7d68539.slice/crio-492c29fdc6869963a45ff5e210bca6b01045d30d65ea67cf1c401c86739b244a WatchSource:0}: Error finding container 492c29fdc6869963a45ff5e210bca6b01045d30d65ea67cf1c401c86739b244a: Status 404 returned error can't find the container with id 492c29fdc6869963a45ff5e210bca6b01045d30d65ea67cf1c401c86739b244a Jul 09 01:37:59.595265 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.595248 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9d2pm" Jul 09 01:37:59.601110 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.601091 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f5dkk" Jul 09 01:37:59.604601 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:59.604578 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf756d1de_5c46_4697_afb8_126ef3e9569e.slice/crio-75f54666860aba3378e34362eca9feeac161300d2413b01ea11c4f11b312d9f4 WatchSource:0}: Error finding container 75f54666860aba3378e34362eca9feeac161300d2413b01ea11c4f11b312d9f4: Status 404 returned error can't find the container with id 75f54666860aba3378e34362eca9feeac161300d2413b01ea11c4f11b312d9f4 Jul 09 01:37:59.609025 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:59.609004 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod703c3024_5208_43d1_829e_bc840655bf9c.slice/crio-24e3c7c1101116e8389e3e1d71b79c6d135c610dea1f15fdf06a3db96b5b5d27 WatchSource:0}: Error finding container 24e3c7c1101116e8389e3e1d71b79c6d135c610dea1f15fdf06a3db96b5b5d27: Status 404 returned error can't find the container with id 24e3c7c1101116e8389e3e1d71b79c6d135c610dea1f15fdf06a3db96b5b5d27 Jul 09 01:37:59.612036 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.612021 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" Jul 09 01:37:59.617873 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.617855 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 01:37:59.620382 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:37:59.620362 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41380c2b_d120_439a_a1ba_0b814e1ba199.slice/crio-6f6edc05cc89a7bdb8d5579e1ce8715d0cd041b9f57fed1eab75537c722bd9e1 WatchSource:0}: Error finding container 6f6edc05cc89a7bdb8d5579e1ce8715d0cd041b9f57fed1eab75537c722bd9e1: Status 404 returned error can't find the container with id 6f6edc05cc89a7bdb8d5579e1ce8715d0cd041b9f57fed1eab75537c722bd9e1 Jul 09 01:37:59.633703 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:37:59.633679 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zktpv" Jul 09 01:38:00.867297 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:38:00.867277 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66008bdf_c7e5_43e0_a569_61692022b688.slice/crio-af732614c768cfab30d4dc19ddd2580a422ba018d45117e433790d1afb79f375 WatchSource:0}: Error finding container af732614c768cfab30d4dc19ddd2580a422ba018d45117e433790d1afb79f375: Status 404 returned error can't find the container with id af732614c768cfab30d4dc19ddd2580a422ba018d45117e433790d1afb79f375 Jul 09 01:38:00.879537 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:00.879520 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lvjrf" Jul 09 01:38:00.884186 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:00.884171 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d6hhc" Jul 09 01:38:00.886946 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:38:00.886923 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b12f0c_9647_466d_9823_a5273d80b153.slice/crio-e85d18c4fff0a447ba8d00536769a06754a41ad8621cd10bfc5d438d9cc4e9e0 WatchSource:0}: Error finding container e85d18c4fff0a447ba8d00536769a06754a41ad8621cd10bfc5d438d9cc4e9e0: Status 404 returned error can't find the container with id e85d18c4fff0a447ba8d00536769a06754a41ad8621cd10bfc5d438d9cc4e9e0 Jul 09 01:38:00.892126 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:38:00.892104 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a01e5f3_7f8f_41cc_803b_ed84c815bae3.slice/crio-cdee2da78202f2571e0d011d3ffdaf8a7098a0ffac859ed47ad73fb4f325fef6 WatchSource:0}: Error finding container cdee2da78202f2571e0d011d3ffdaf8a7098a0ffac859ed47ad73fb4f325fef6: Status 404 returned error can't find the container with id cdee2da78202f2571e0d011d3ffdaf8a7098a0ffac859ed47ad73fb4f325fef6 Jul 09 01:38:01.158944 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.158865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs\") pod \"network-metrics-daemon-s7zrq\" (UID: \"c975edec-2157-4f50-85fc-102b756da42b\") " pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:01.158944 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.158919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:01.159201 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.158958 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbrfl\" (UniqueName: \"kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl\") pod \"network-check-target-9pjtm\" (UID: \"53c92713-90e9-4d9d-b5c6-f0f15a33fc82\") " pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:01.159201 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:01.159099 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:38:01.159201 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:01.159116 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:38:01.159201 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:01.159130 2565 projected.go:196] Error preparing data for projected volume kube-api-access-hbrfl for pod openshift-network-diagnostics/network-check-target-9pjtm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:01.159408 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:01.159204 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl podName:53c92713-90e9-4d9d-b5c6-f0f15a33fc82 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:02.159185938 +0000 UTC m=+3.132658551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hbrfl" (UniqueName: "kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl") pod "network-check-target-9pjtm" (UID: "53c92713-90e9-4d9d-b5c6-f0f15a33fc82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:01.159408 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:01.159285 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:01.159408 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:01.159287 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:01.159408 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:01.159333 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs podName:c975edec-2157-4f50-85fc-102b756da42b nodeName:}" failed. No retries permitted until 2026-07-09 01:38:02.159321109 +0000 UTC m=+3.132793721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs") pod "network-metrics-daemon-s7zrq" (UID: "c975edec-2157-4f50-85fc-102b756da42b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:01.159408 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:01.159351 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret podName:5982d2fd-d322-47cf-a233-c41afb3ff1fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:02.159341882 +0000 UTC m=+3.132814482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret") pod "global-pull-secret-syncer-nd79x" (UID: "5982d2fd-d322-47cf-a233-c41afb3ff1fd") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:01.492675 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.492587 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 01:33:00 +0000 UTC" deadline="2028-04-16 05:05:56.62345052 +0000 UTC" Jul 09 01:38:01.492675 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.492630 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15531h27m55.130825496s" Jul 09 01:38:01.577789 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.577734 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lvjrf" event={"ID":"a4b12f0c-9647-466d-9823-a5273d80b153","Type":"ContainerStarted","Data":"e85d18c4fff0a447ba8d00536769a06754a41ad8621cd10bfc5d438d9cc4e9e0"} Jul 09 01:38:01.602981 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.600127 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zktpv" event={"ID":"66008bdf-c7e5-43e0-a569-61692022b688","Type":"ContainerStarted","Data":"af732614c768cfab30d4dc19ddd2580a422ba018d45117e433790d1afb79f375"} Jul 09 01:38:01.608334 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.608293 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" event={"ID":"41380c2b-d120-439a-a1ba-0b814e1ba199","Type":"ContainerStarted","Data":"6f6edc05cc89a7bdb8d5579e1ce8715d0cd041b9f57fed1eab75537c722bd9e1"} Jul 09 01:38:01.625851 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.625808 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9d2pm" event={"ID":"f756d1de-5c46-4697-afb8-126ef3e9569e","Type":"ContainerStarted","Data":"75f54666860aba3378e34362eca9feeac161300d2413b01ea11c4f11b312d9f4"} Jul 09 01:38:01.634436 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.634346 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8lnhk" event={"ID":"1b41e12d-c223-4f99-ab36-8bde264d2828","Type":"ContainerStarted","Data":"7323e0ca68a79095f2f8940cf375e034851d52533c6a21662b9afc9959c1bbd7"} Jul 09 01:38:01.636426 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.636358 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" event={"ID":"1a436513-d78c-4b4d-b7c3-6da9bb1be63a","Type":"ContainerStarted","Data":"523e5d48bae8d33b612c2cc4c1598a355ac2830142fde9206fccd77eda1dabbc"} Jul 09 01:38:01.643319 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.643290 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" event={"ID":"fa270ef1e2da30182fb1ce8e87a3f7c2","Type":"ContainerStarted","Data":"f5e7d100422564b15e6d1c771ceef0f48c43e026d92d69ead08fcef80cae1b54"} Jul 09 01:38:01.649820 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.649788 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-184.ec2.internal" event={"ID":"81d8756a43625938ca8b36e75b20e52a","Type":"ContainerStarted","Data":"f8ebc09fa34ed9df8368562f89f7877e9a65555539abca154fe1a312f002e903"} Jul 09 01:38:01.656813 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.656780 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d6hhc" event={"ID":"5a01e5f3-7f8f-41cc-803b-ed84c815bae3","Type":"ContainerStarted","Data":"cdee2da78202f2571e0d011d3ffdaf8a7098a0ffac859ed47ad73fb4f325fef6"} Jul 09 01:38:01.663983 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.663906 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5dkk" event={"ID":"703c3024-5208-43d1-829e-bc840655bf9c","Type":"ContainerStarted","Data":"24e3c7c1101116e8389e3e1d71b79c6d135c610dea1f15fdf06a3db96b5b5d27"} Jul 09 01:38:01.668426 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.668398 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" event={"ID":"dd4dd34d-7366-480d-9861-b222d7d68539","Type":"ContainerStarted","Data":"492c29fdc6869963a45ff5e210bca6b01045d30d65ea67cf1c401c86739b244a"} Jul 09 01:38:01.746322 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:01.746244 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 01:38:02.168795 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:02.168710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs\") pod \"network-metrics-daemon-s7zrq\" (UID: \"c975edec-2157-4f50-85fc-102b756da42b\") " pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:02.168795 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:02.168773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:02.169019 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:02.168817 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbrfl\" (UniqueName: \"kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl\") pod \"network-check-target-9pjtm\" (UID: \"53c92713-90e9-4d9d-b5c6-f0f15a33fc82\") " pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:02.169019 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:02.168980 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:38:02.169019 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:02.168999 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:38:02.169019 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:02.169012 2565 projected.go:196] Error preparing data for projected volume kube-api-access-hbrfl for pod openshift-network-diagnostics/network-check-target-9pjtm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:02.169352 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:02.169071 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl podName:53c92713-90e9-4d9d-b5c6-f0f15a33fc82 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:04.169052738 +0000 UTC m=+5.142525340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hbrfl" (UniqueName: "kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl") pod "network-check-target-9pjtm" (UID: "53c92713-90e9-4d9d-b5c6-f0f15a33fc82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:02.169519 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:02.169500 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:02.169588 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:02.169555 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs podName:c975edec-2157-4f50-85fc-102b756da42b nodeName:}" failed. No retries permitted until 2026-07-09 01:38:04.16953969 +0000 UTC m=+5.143012293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs") pod "network-metrics-daemon-s7zrq" (UID: "c975edec-2157-4f50-85fc-102b756da42b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:02.169649 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:02.169605 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:02.169649 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:02.169638 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret podName:5982d2fd-d322-47cf-a233-c41afb3ff1fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:04.16962741 +0000 UTC m=+5.143100012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret") pod "global-pull-secret-syncer-nd79x" (UID: "5982d2fd-d322-47cf-a233-c41afb3ff1fd") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:02.493892 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:02.493776 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 01:33:00 +0000 UTC" deadline="2028-04-11 16:39:55.237139282 +0000 UTC" Jul 09 01:38:02.493892 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:02.493837 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15423h1m52.743306915s" Jul 09 01:38:02.558019 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:02.557983 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:02.558219 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:02.558119 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:02.558405 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:02.558387 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:02.558512 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:02.558494 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:02.558590 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:02.558576 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:02.558668 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:02.558646 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:03.180373 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:03.180100 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 01:38:04.184861 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:04.184498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs\") pod \"network-metrics-daemon-s7zrq\" (UID: \"c975edec-2157-4f50-85fc-102b756da42b\") " pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:04.184861 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:04.184555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:04.184861 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:04.184593 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbrfl\" (UniqueName: \"kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl\") pod \"network-check-target-9pjtm\" (UID: \"53c92713-90e9-4d9d-b5c6-f0f15a33fc82\") " pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:04.184861 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:04.184665 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:04.184861 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:04.184731 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs podName:c975edec-2157-4f50-85fc-102b756da42b nodeName:}" failed. No retries permitted until 2026-07-09 01:38:08.184711882 +0000 UTC m=+9.158184495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs") pod "network-metrics-daemon-s7zrq" (UID: "c975edec-2157-4f50-85fc-102b756da42b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:04.184861 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:04.184736 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:38:04.184861 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:04.184752 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:38:04.184861 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:04.184765 2565 projected.go:196] Error preparing data for projected volume kube-api-access-hbrfl for pod openshift-network-diagnostics/network-check-target-9pjtm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:04.184861 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:04.184800 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl podName:53c92713-90e9-4d9d-b5c6-f0f15a33fc82 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:08.184788889 +0000 UTC m=+9.158261491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hbrfl" (UniqueName: "kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl") pod "network-check-target-9pjtm" (UID: "53c92713-90e9-4d9d-b5c6-f0f15a33fc82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:04.184861 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:04.184729 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:04.184861 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:04.184840 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret podName:5982d2fd-d322-47cf-a233-c41afb3ff1fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:08.184830324 +0000 UTC m=+9.158302929 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret") pod "global-pull-secret-syncer-nd79x" (UID: "5982d2fd-d322-47cf-a233-c41afb3ff1fd") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:04.558412 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:04.558286 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:04.558412 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:04.558348 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:04.558631 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:04.558474 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:04.558869 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:04.558825 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:04.558869 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:04.558831 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:04.559065 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:04.558953 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:06.558222 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:06.558187 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:06.558222 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:06.558215 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:06.558742 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:06.558327 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:06.558742 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:06.558389 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:06.558742 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:06.558445 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:06.558742 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:06.558526 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:08.218426 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:08.218394 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs\") pod \"network-metrics-daemon-s7zrq\" (UID: \"c975edec-2157-4f50-85fc-102b756da42b\") " pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:08.218822 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:08.218452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:08.218822 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:08.218494 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbrfl\" (UniqueName: \"kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl\") pod \"network-check-target-9pjtm\" (UID: \"53c92713-90e9-4d9d-b5c6-f0f15a33fc82\") " pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:08.218822 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:08.218559 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:08.218822 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:08.218587 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:08.218822 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:08.218633 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:38:08.218822 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:08.218644 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs podName:c975edec-2157-4f50-85fc-102b756da42b nodeName:}" failed. No retries permitted until 2026-07-09 01:38:16.218623558 +0000 UTC m=+17.192096174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs") pod "network-metrics-daemon-s7zrq" (UID: "c975edec-2157-4f50-85fc-102b756da42b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:08.218822 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:08.218656 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:38:08.218822 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:08.218664 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret podName:5982d2fd-d322-47cf-a233-c41afb3ff1fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:16.218655544 +0000 UTC m=+17.192128143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret") pod "global-pull-secret-syncer-nd79x" (UID: "5982d2fd-d322-47cf-a233-c41afb3ff1fd") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:08.218822 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:08.218667 2565 projected.go:196] Error preparing data for projected volume kube-api-access-hbrfl for pod openshift-network-diagnostics/network-check-target-9pjtm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:08.218822 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:08.218709 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl podName:53c92713-90e9-4d9d-b5c6-f0f15a33fc82 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:16.218693433 +0000 UTC m=+17.192166036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hbrfl" (UniqueName: "kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl") pod "network-check-target-9pjtm" (UID: "53c92713-90e9-4d9d-b5c6-f0f15a33fc82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:08.557949 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:08.557876 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:08.557949 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:08.557876 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:08.558163 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:08.557990 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:08.558163 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:08.557990 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:08.558163 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:08.558089 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:08.558329 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:08.558220 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:10.558501 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:10.558269 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:10.558501 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:10.558320 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:10.558501 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:10.558408 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:10.558501 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:10.558461 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:10.558501 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:10.558505 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:10.559255 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:10.558571 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:12.558424 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:12.558386 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:12.558857 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:12.558494 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:12.558857 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:12.558387 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:12.558857 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:12.558387 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:12.558857 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:12.558599 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:12.558857 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:12.558695 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:14.557489 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:14.557455 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:14.557489 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:14.557484 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:14.557985 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:14.557500 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:14.557985 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:14.557586 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:14.557985 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:14.557685 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:14.557985 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:14.557792 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:16.277617 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:16.277580 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbrfl\" (UniqueName: \"kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl\") pod \"network-check-target-9pjtm\" (UID: \"53c92713-90e9-4d9d-b5c6-f0f15a33fc82\") " pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:16.278120 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:16.277637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs\") pod \"network-metrics-daemon-s7zrq\" (UID: \"c975edec-2157-4f50-85fc-102b756da42b\") " pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:16.278120 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:16.277662 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:16.278120 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:16.277761 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:16.278120 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:16.277788 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:16.278120 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:16.277761 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:38:16.278120 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:16.277836 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret podName:5982d2fd-d322-47cf-a233-c41afb3ff1fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:32.277814894 +0000 UTC m=+33.251287508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret") pod "global-pull-secret-syncer-nd79x" (UID: "5982d2fd-d322-47cf-a233-c41afb3ff1fd") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:16.278120 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:16.277844 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:38:16.278120 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:16.277852 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs podName:c975edec-2157-4f50-85fc-102b756da42b nodeName:}" failed. No retries permitted until 2026-07-09 01:38:32.277844604 +0000 UTC m=+33.251317202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs") pod "network-metrics-daemon-s7zrq" (UID: "c975edec-2157-4f50-85fc-102b756da42b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:16.278120 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:16.277858 2565 projected.go:196] Error preparing data for projected volume kube-api-access-hbrfl for pod openshift-network-diagnostics/network-check-target-9pjtm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:16.278120 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:16.277895 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl podName:53c92713-90e9-4d9d-b5c6-f0f15a33fc82 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:32.277881388 +0000 UTC m=+33.251353986 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hbrfl" (UniqueName: "kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl") pod "network-check-target-9pjtm" (UID: "53c92713-90e9-4d9d-b5c6-f0f15a33fc82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:16.557900 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:16.557825 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:16.558084 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:16.557937 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:16.558084 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:16.557942 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:16.558084 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:16.557973 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:16.558084 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:16.558072 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:16.558304 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:16.558187 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:18.557479 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:18.557444 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:18.558004 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:18.557444 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:18.558004 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:18.557569 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:18.558004 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:18.557446 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:18.558004 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:18.557642 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:18.558004 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:18.557718 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:20.558384 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.558179 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:20.559289 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.558280 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:20.559289 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:20.558484 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:20.559289 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.558324 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:20.559289 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:20.558634 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:20.559289 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:20.558524 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:20.709301 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.709014 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5dkk" event={"ID":"703c3024-5208-43d1-829e-bc840655bf9c","Type":"ContainerStarted","Data":"01308d9b6550fb280c3e434cd775d0f837e450414d12f3a9bb89efb4660354a6"} Jul 09 01:38:20.712013 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.711991 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 01:38:20.712678 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.712392 2565 generic.go:356] "Generic (PLEG): container finished" podID="dd4dd34d-7366-480d-9861-b222d7d68539" containerID="a9fc23fd7f3843331c78325986b8108feb1afd6edade65d02c4dfb1368756b46" exitCode=1 Jul 09 01:38:20.712678 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.712459 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" event={"ID":"dd4dd34d-7366-480d-9861-b222d7d68539","Type":"ContainerStarted","Data":"4992a852efbc03236b5df23d752d7c6fbfd767b47ba92c56c365ce9d74a9c678"} Jul 09 01:38:20.712678 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.712524 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" event={"ID":"dd4dd34d-7366-480d-9861-b222d7d68539","Type":"ContainerStarted","Data":"a97cd8d7236e707939a1a2564903e86f8e5e08536d2e8bf6a513daef0bb09646"} Jul 09 01:38:20.712678 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.712559 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" event={"ID":"dd4dd34d-7366-480d-9861-b222d7d68539","Type":"ContainerStarted","Data":"5dc22f52bef5e188f79571bd87a0d10c6f9e1286b109a24cf4bd307f56f50b64"} Jul 09 01:38:20.712678 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.712593 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" event={"ID":"dd4dd34d-7366-480d-9861-b222d7d68539","Type":"ContainerStarted","Data":"dbe64ba2e943688b4c90589067ba963c453a94ea9ceb91b06c0ecbc880a27f0d"} Jul 09 01:38:20.712678 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.712633 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" event={"ID":"dd4dd34d-7366-480d-9861-b222d7d68539","Type":"ContainerDied","Data":"a9fc23fd7f3843331c78325986b8108feb1afd6edade65d02c4dfb1368756b46"} Jul 09 01:38:20.712678 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.712663 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" event={"ID":"dd4dd34d-7366-480d-9861-b222d7d68539","Type":"ContainerStarted","Data":"e101599bf48416dcbebff5ce6dd890f80f70fe4752a6e493854930f92d38827e"} Jul 09 01:38:20.714369 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.714345 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lvjrf" event={"ID":"a4b12f0c-9647-466d-9823-a5273d80b153","Type":"ContainerStarted","Data":"53a92fff801e8cb5e61cae7b135ffd271ef0cf1b415758cc9bdf4e5c1144c330"} Jul 09 01:38:20.716109 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.716085 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zktpv" event={"ID":"66008bdf-c7e5-43e0-a569-61692022b688","Type":"ContainerStarted","Data":"c7a926add07e1ffd3ac3bd5b11bdc7a8fbb79237b2797c9f210d32a53c031756"} Jul 09 01:38:20.717582 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.717558 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" event={"ID":"41380c2b-d120-439a-a1ba-0b814e1ba199","Type":"ContainerStarted","Data":"45b64edf4da8d666cae8f9ea17bc4aadb565ec2e5c86353b18bb48787f02288e"} Jul 09 01:38:20.719036 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.719010 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9d2pm" event={"ID":"f756d1de-5c46-4697-afb8-126ef3e9569e","Type":"ContainerStarted","Data":"5551b9449f1c93efb537df028e3c7adec90b1bb05a1332204ad2a6bca764eddb"} Jul 09 01:38:20.720645 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.720593 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" event={"ID":"1a436513-d78c-4b4d-b7c3-6da9bb1be63a","Type":"ContainerStarted","Data":"f71e70ec1df65ab99a8acf88621260c0132206ec2e42f9514ab381323171ea88"} Jul 09 01:38:20.722180 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.722098 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" event={"ID":"fa270ef1e2da30182fb1ce8e87a3f7c2","Type":"ContainerStarted","Data":"3237c002a63ed66ab2b5d5c878ee84dc3a833de20d6e962cd42f6de640539bce"} Jul 09 01:38:20.723641 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.723620 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-184.ec2.internal" event={"ID":"81d8756a43625938ca8b36e75b20e52a","Type":"ContainerStarted","Data":"ddae5a6574694650039378090064097150c4e49ee09ac4e473adc7dbc0fceba2"} Jul 09 01:38:20.725004 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.724981 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d6hhc" event={"ID":"5a01e5f3-7f8f-41cc-803b-ed84c815bae3","Type":"ContainerStarted","Data":"395094af0f45a2e583b3215c4aa0c610e1619e81b73e1db9cc7390ee557caf62"} Jul 09 01:38:20.753848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.753809 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9d2pm" podStartSLOduration=11.84258202 podStartE2EDuration="21.753793767s" totalImagesPullingTime="9.911211747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:20.740739558 +0000 UTC m=+21.714212180" watchObservedRunningTime="2026-07-09 01:38:20.753793767 +0000 UTC m=+21.727266388" Jul 09 01:38:20.753981 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.753959 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zktpv" podStartSLOduration=3.100949766 podStartE2EDuration="21.753953667s" totalImagesPullingTime="18.653003901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:20.753393212 +0000 UTC m=+21.726865834" watchObservedRunningTime="2026-07-09 01:38:20.753953667 +0000 UTC m=+21.727426287" Jul 09 01:38:20.772337 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.772291 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d6hhc" podStartSLOduration=2.517553248 podStartE2EDuration="21.772277221s" totalImagesPullingTime="19.254723973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:20.771409833 +0000 UTC m=+21.744882454" watchObservedRunningTime="2026-07-09 01:38:20.772277221 +0000 UTC m=+21.745749841" Jul 09 01:38:20.818077 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.817980 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-184.ec2.internal" podStartSLOduration=20.817964414 podStartE2EDuration="20.817964414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:20.80146077 +0000 UTC m=+21.774933392" watchObservedRunningTime="2026-07-09 01:38:20.817964414 +0000 UTC m=+21.791437034" Jul 09 01:38:20.818260 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.818240 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s7rqw" podStartSLOduration=2.781441047 podStartE2EDuration="21.8182343s" totalImagesPullingTime="19.036793253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:20.817892205 +0000 UTC m=+21.791364838" watchObservedRunningTime="2026-07-09 01:38:20.8182343 +0000 UTC m=+21.791706921" Jul 09 01:38:20.831970 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:20.831930 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lvjrf" podStartSLOduration=3.199583244 podStartE2EDuration="21.831916298s" totalImagesPullingTime="18.632333054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:20.831429912 +0000 UTC m=+21.804902535" watchObservedRunningTime="2026-07-09 01:38:20.831916298 +0000 UTC m=+21.805388918" Jul 09 01:38:21.729106 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:21.729046 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8lnhk" event={"ID":"1b41e12d-c223-4f99-ab36-8bde264d2828","Type":"ContainerStarted","Data":"c2694383e683f383f031ce1f96cf9cd82f558b234341becb61c95d1954c777ac"} Jul 09 01:38:21.730882 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:21.730846 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa270ef1e2da30182fb1ce8e87a3f7c2" containerID="3237c002a63ed66ab2b5d5c878ee84dc3a833de20d6e962cd42f6de640539bce" exitCode=0 Jul 09 01:38:21.731022 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:21.730962 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" event={"ID":"fa270ef1e2da30182fb1ce8e87a3f7c2","Type":"ContainerDied","Data":"3237c002a63ed66ab2b5d5c878ee84dc3a833de20d6e962cd42f6de640539bce"} Jul 09 01:38:21.732832 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:21.732809 2565 generic.go:356] "Generic (PLEG): container finished" podID="703c3024-5208-43d1-829e-bc840655bf9c" containerID="01308d9b6550fb280c3e434cd775d0f837e450414d12f3a9bb89efb4660354a6" exitCode=0 Jul 09 01:38:21.732948 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:21.732912 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5dkk" event={"ID":"703c3024-5208-43d1-829e-bc840655bf9c","Type":"ContainerDied","Data":"01308d9b6550fb280c3e434cd775d0f837e450414d12f3a9bb89efb4660354a6"} Jul 09 01:38:21.744179 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:21.744124 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8lnhk" podStartSLOduration=8.221131509 podStartE2EDuration="22.744108703s" totalImagesPullingTime="14.522977194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:21.743777718 +0000 UTC m=+22.717250339" watchObservedRunningTime="2026-07-09 01:38:21.744108703 +0000 UTC m=+22.717581326" Jul 09 01:38:22.112760 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.112730 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 01:38:22.517028 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.516944 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T01:38:22.112759054Z","UUID":"a0c7b40b-2558-4750-84d9-be7b88dea735","Handler":null,"Name":"","Endpoint":""} Jul 09 01:38:22.518338 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.518313 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 01:38:22.518446 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.518349 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 01:38:22.558295 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.558275 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:22.558295 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.558287 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:22.558431 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.558361 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:22.558431 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:22.558384 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:22.558493 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:22.558445 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:22.558525 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:22.558495 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:22.737904 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.737863 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" event={"ID":"41380c2b-d120-439a-a1ba-0b814e1ba199","Type":"ContainerStarted","Data":"12b799ddf7a7266ebc2a8e7d0806b1d5c02a8b084219dff3d83db224a75a44f5"} Jul 09 01:38:22.740316 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.740286 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" event={"ID":"fa270ef1e2da30182fb1ce8e87a3f7c2","Type":"ContainerStarted","Data":"8176814fc750ae1ab2cab7b97437b1e442531bf5e409090973b2654abe0bbfa0"} Jul 09 01:38:22.744312 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.744289 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 01:38:22.745075 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.744982 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" event={"ID":"dd4dd34d-7366-480d-9861-b222d7d68539","Type":"ContainerStarted","Data":"2f0af30ade04e273609160be9a6763da3953a9fef50336b6bd55a43ba4ff864b"} Jul 09 01:38:22.752666 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.752429 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9d2pm" Jul 09 01:38:22.753216 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.753115 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9d2pm" Jul 09 01:38:22.754944 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:22.754899 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-184.ec2.internal" podStartSLOduration=22.754881397 podStartE2EDuration="22.754881397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:22.754703975 +0000 UTC m=+23.728176596" watchObservedRunningTime="2026-07-09 01:38:22.754881397 +0000 UTC m=+23.728354018" Jul 09 01:38:23.749354 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:23.749273 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" event={"ID":"41380c2b-d120-439a-a1ba-0b814e1ba199","Type":"ContainerStarted","Data":"c694192ad28078bb4ab226dc3f10192fa5ac6f1db01d0d3dc883097000df9322"} Jul 09 01:38:23.749696 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:23.749662 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9d2pm" Jul 09 01:38:23.750097 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:23.750074 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9d2pm" Jul 09 01:38:23.765731 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:23.765688 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dmhwj" podStartSLOduration=3.244775284 podStartE2EDuration="24.765673952s" totalImagesPullingTime="21.520898668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:23.765653194 +0000 UTC m=+24.739125815" watchObservedRunningTime="2026-07-09 01:38:23.765673952 +0000 UTC m=+24.739146550" Jul 09 01:38:23.872846 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:23.872808 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:23.959695 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:23.959640 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:24.558587 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:24.558366 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:24.558786 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:24.558423 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:24.558786 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:24.558690 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:24.558786 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:24.558431 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:24.558929 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:24.558778 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:24.558929 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:24.558822 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:25.023226 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:25.023191 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:25.120828 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:25.120748 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:25.226214 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:25.226182 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:25.302291 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:25.302261 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:25.370609 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:25.370582 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:25.437351 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:25.437284 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:25.756795 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:25.756763 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 01:38:25.757216 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:25.757186 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" event={"ID":"dd4dd34d-7366-480d-9861-b222d7d68539","Type":"ContainerStarted","Data":"d7900aa86269fa22695d3f645daa986dbc3edcc384e236306792b30e6c7050f9"} Jul 09 01:38:25.757523 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:25.757495 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:38:25.757666 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:25.757651 2565 scope.go:117] "RemoveContainer" containerID="a9fc23fd7f3843331c78325986b8108feb1afd6edade65d02c4dfb1368756b46" Jul 09 01:38:25.773837 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:25.773814 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:38:26.136494 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.136417 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:26.191613 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.191585 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:26.522274 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.522220 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:26.558264 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.558233 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:26.558419 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.558243 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:26.558419 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:26.558360 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:26.558419 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.558243 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:26.558553 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:26.558441 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:26.558553 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:26.558537 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:26.621970 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.621809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:26.723035 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.723003 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nd79x"] Jul 09 01:38:26.726353 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.726220 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9pjtm"] Jul 09 01:38:26.726969 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.726934 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s7zrq"] Jul 09 01:38:26.745978 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.745953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:26.760095 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.759709 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:26.760095 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.759730 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:26.760095 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:26.759838 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:26.760095 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:26.759935 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:26.760095 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.759720 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:26.760095 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:26.760041 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:26.805388 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:26.805360 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:27.587769 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:27.587741 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:27.674854 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:27.674776 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:27.763484 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:27.763452 2565 generic.go:356] "Generic (PLEG): container finished" podID="703c3024-5208-43d1-829e-bc840655bf9c" containerID="d48ffac55d0396942146db06ca2b546fab674cc2570f578cd18322e02bb44246" exitCode=0 Jul 09 01:38:27.763626 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:27.763534 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5dkk" event={"ID":"703c3024-5208-43d1-829e-bc840655bf9c","Type":"ContainerDied","Data":"d48ffac55d0396942146db06ca2b546fab674cc2570f578cd18322e02bb44246"} Jul 09 01:38:27.767312 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:27.767294 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 01:38:27.767666 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:27.767646 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" event={"ID":"dd4dd34d-7366-480d-9861-b222d7d68539","Type":"ContainerStarted","Data":"25e4366135aa242c4152e4c09a191507753e51dc7d0b0dc45498ceff2e9c8590"} Jul 09 01:38:27.767927 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:27.767910 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:38:27.768029 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:27.767966 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:38:27.783770 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:27.783750 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:38:28.557511 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:28.557484 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:28.557511 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:28.557507 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:28.557646 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:28.557510 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:28.557646 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:28.557610 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:28.557752 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:28.557696 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:28.557808 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:28.557789 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:28.772163 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:28.772067 2565 generic.go:356] "Generic (PLEG): container finished" podID="703c3024-5208-43d1-829e-bc840655bf9c" containerID="b212486bd8c691d355d0a81fe4e3ddd90a263abed56bacee95245c83ed47c958" exitCode=0 Jul 09 01:38:28.772483 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:28.772165 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5dkk" event={"ID":"703c3024-5208-43d1-829e-bc840655bf9c","Type":"ContainerDied","Data":"b212486bd8c691d355d0a81fe4e3ddd90a263abed56bacee95245c83ed47c958"} Jul 09 01:38:28.799260 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:28.799214 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" podStartSLOduration=10.729700689 podStartE2EDuration="29.799199048s" totalImagesPullingTime="19.069498359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:27.8317277 +0000 UTC m=+28.805200322" watchObservedRunningTime="2026-07-09 01:38:28.799199048 +0000 UTC m=+29.772671680" Jul 09 01:38:29.776257 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:29.776006 2565 generic.go:356] "Generic (PLEG): container finished" podID="703c3024-5208-43d1-829e-bc840655bf9c" containerID="440a10de2355e4f05e325d36fa4175e2731d39b19fdcbd706011cd34877d89a8" exitCode=0 Jul 09 01:38:29.776614 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:29.776049 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5dkk" event={"ID":"703c3024-5208-43d1-829e-bc840655bf9c","Type":"ContainerDied","Data":"440a10de2355e4f05e325d36fa4175e2731d39b19fdcbd706011cd34877d89a8"} Jul 09 01:38:29.787857 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:29.787821 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" podUID="dd4dd34d-7366-480d-9861-b222d7d68539" containerName="ovnkube-controller" probeResult="failure" output="" Jul 09 01:38:30.557928 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:30.557892 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:30.558080 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:30.557985 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:30.558080 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:30.557993 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:30.558080 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:30.557998 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:30.558080 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:30.558073 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:30.558285 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:30.558163 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:32.302014 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.301979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbrfl\" (UniqueName: \"kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl\") pod \"network-check-target-9pjtm\" (UID: \"53c92713-90e9-4d9d-b5c6-f0f15a33fc82\") " pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:32.302478 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.302043 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs\") pod \"network-metrics-daemon-s7zrq\" (UID: \"c975edec-2157-4f50-85fc-102b756da42b\") " pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:32.302478 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.302072 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:32.302478 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:32.302175 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:38:32.302478 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:32.302190 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:32.302478 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:32.302196 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:32.302478 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:32.302201 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:38:32.302478 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:32.302249 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs podName:c975edec-2157-4f50-85fc-102b756da42b nodeName:}" failed. No retries permitted until 2026-07-09 01:39:04.302234893 +0000 UTC m=+65.275707493 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs") pod "network-metrics-daemon-s7zrq" (UID: "c975edec-2157-4f50-85fc-102b756da42b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:32.302478 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:32.302251 2565 projected.go:196] Error preparing data for projected volume kube-api-access-hbrfl for pod openshift-network-diagnostics/network-check-target-9pjtm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:32.302478 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:32.302264 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret podName:5982d2fd-d322-47cf-a233-c41afb3ff1fd nodeName:}" failed. No retries permitted until 2026-07-09 01:39:04.302257921 +0000 UTC m=+65.275730520 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret") pod "global-pull-secret-syncer-nd79x" (UID: "5982d2fd-d322-47cf-a233-c41afb3ff1fd") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:32.302478 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:32.302296 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl podName:53c92713-90e9-4d9d-b5c6-f0f15a33fc82 nodeName:}" failed. No retries permitted until 2026-07-09 01:39:04.302279282 +0000 UTC m=+65.275751896 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hbrfl" (UniqueName: "kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl") pod "network-check-target-9pjtm" (UID: "53c92713-90e9-4d9d-b5c6-f0f15a33fc82") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:32.558058 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.557991 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:32.558223 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.558012 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:32.558223 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.558102 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:32.558223 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:32.558105 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9pjtm" podUID="53c92713-90e9-4d9d-b5c6-f0f15a33fc82" Jul 09 01:38:32.558223 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:32.558204 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nd79x" podUID="5982d2fd-d322-47cf-a233-c41afb3ff1fd" Jul 09 01:38:32.558351 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:32.558288 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s7zrq" podUID="c975edec-2157-4f50-85fc-102b756da42b" Jul 09 01:38:32.847281 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.847198 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-184.ec2.internal" event="NodeReady" Jul 09 01:38:32.847434 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.847332 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 01:38:32.880779 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.880743 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f675c8796-bnx5s"] Jul 09 01:38:32.883338 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.883312 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:32.885507 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.885485 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 01:38:32.885786 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.885766 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wqnbs\"" Jul 09 01:38:32.885881 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.885831 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 01:38:32.886586 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.886547 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 01:38:32.891739 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.891656 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wgknd"] Jul 09 01:38:32.893415 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.893392 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 01:38:32.894934 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.894914 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:32.897198 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.897178 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 01:38:32.897288 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.897240 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 01:38:32.897288 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.897241 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s9n5n\"" Jul 09 01:38:32.899978 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.899953 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gx9tv"] Jul 09 01:38:32.903032 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.902987 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f675c8796-bnx5s"] Jul 09 01:38:32.903032 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.903022 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wgknd"] Jul 09 01:38:32.903217 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.903118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gx9tv" Jul 09 01:38:32.905552 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.905462 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 01:38:32.905646 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.905467 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 01:38:32.905646 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.905626 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n8xpm\"" Jul 09 01:38:32.905855 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.905840 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 01:38:32.911712 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:32.911690 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gx9tv"] Jul 09 01:38:33.008200 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6201c81f-af43-46f5-8136-f4900c38f899-cert\") pod \"ingress-canary-gx9tv\" (UID: \"6201c81f-af43-46f5-8136-f4900c38f899\") " pod="openshift-ingress-canary/ingress-canary-gx9tv" Jul 09 01:38:33.008374 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008233 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4ca68c46-c396-43fa-8692-74a84e9ea975-config-volume\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:33.008374 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:33.008374 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008309 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.008374 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008340 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szcc9\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-kube-api-access-szcc9\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.008374 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008374 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-certificates\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.008561 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-installation-pull-secrets\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.008561 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-ca-trust-extracted\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.008561 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008449 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-bound-sa-token\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.008561 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ca68c46-c396-43fa-8692-74a84e9ea975-tmp-dir\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:33.008561 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wq7q\" (UniqueName: \"kubernetes.io/projected/4ca68c46-c396-43fa-8692-74a84e9ea975-kube-api-access-7wq7q\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:33.008561 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008547 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qnsv\" (UniqueName: \"kubernetes.io/projected/6201c81f-af43-46f5-8136-f4900c38f899-kube-api-access-4qnsv\") pod \"ingress-canary-gx9tv\" (UID: \"6201c81f-af43-46f5-8136-f4900c38f899\") " pod="openshift-ingress-canary/ingress-canary-gx9tv" Jul 09 01:38:33.008746 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-image-registry-private-configuration\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.008746 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.008612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-trusted-ca\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.109362 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-image-registry-private-configuration\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.109362 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-trusted-ca\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.109362 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109338 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6201c81f-af43-46f5-8136-f4900c38f899-cert\") pod \"ingress-canary-gx9tv\" (UID: \"6201c81f-af43-46f5-8136-f4900c38f899\") " pod="openshift-ingress-canary/ingress-canary-gx9tv" Jul 09 01:38:33.109608 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109383 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4ca68c46-c396-43fa-8692-74a84e9ea975-config-volume\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:33.109608 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109399 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:33.109608 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109415 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.109608 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109441 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szcc9\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-kube-api-access-szcc9\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.109608 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:33.109554 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 01:38:33.109608 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:33.109577 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f675c8796-bnx5s: secret "image-registry-tls" not found Jul 09 01:38:33.109889 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:33.109560 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 01:38:33.109889 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:33.109651 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls podName:78fbeff9-0a44-4007-85e3-c7912d8e1b9b nodeName:}" failed. No retries permitted until 2026-07-09 01:38:33.609628876 +0000 UTC m=+34.583101478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls") pod "image-registry-5f675c8796-bnx5s" (UID: "78fbeff9-0a44-4007-85e3-c7912d8e1b9b") : secret "image-registry-tls" not found Jul 09 01:38:33.109889 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109719 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-certificates\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.109889 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109757 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-installation-pull-secrets\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.109889 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-ca-trust-extracted\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.109889 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:33.109818 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls podName:4ca68c46-c396-43fa-8692-74a84e9ea975 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:33.609802686 +0000 UTC m=+34.583275294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls") pod "dns-default-wgknd" (UID: "4ca68c46-c396-43fa-8692-74a84e9ea975") : secret "dns-default-metrics-tls" not found Jul 09 01:38:33.109889 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109843 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-bound-sa-token\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.109889 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109874 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ca68c46-c396-43fa-8692-74a84e9ea975-tmp-dir\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:33.110316 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109898 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wq7q\" (UniqueName: \"kubernetes.io/projected/4ca68c46-c396-43fa-8692-74a84e9ea975-kube-api-access-7wq7q\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:33.110316 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.109923 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qnsv\" (UniqueName: \"kubernetes.io/projected/6201c81f-af43-46f5-8136-f4900c38f899-kube-api-access-4qnsv\") pod \"ingress-canary-gx9tv\" (UID: \"6201c81f-af43-46f5-8136-f4900c38f899\") " pod="openshift-ingress-canary/ingress-canary-gx9tv" Jul 09 01:38:33.110316 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.110039 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4ca68c46-c396-43fa-8692-74a84e9ea975-config-volume\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:33.110316 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.110114 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-ca-trust-extracted\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.110316 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.110244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-certificates\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.110316 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.110247 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ca68c46-c396-43fa-8692-74a84e9ea975-tmp-dir\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:33.110541 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.110397 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-trusted-ca\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.113708 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.113685 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-installation-pull-secrets\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.113708 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.113700 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6201c81f-af43-46f5-8136-f4900c38f899-cert\") pod \"ingress-canary-gx9tv\" (UID: \"6201c81f-af43-46f5-8136-f4900c38f899\") " pod="openshift-ingress-canary/ingress-canary-gx9tv" Jul 09 01:38:33.113842 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.113715 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-image-registry-private-configuration\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.120471 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.120451 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wq7q\" (UniqueName: \"kubernetes.io/projected/4ca68c46-c396-43fa-8692-74a84e9ea975-kube-api-access-7wq7q\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:33.121003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.120977 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szcc9\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-kube-api-access-szcc9\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.121831 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.121813 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-bound-sa-token\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.121928 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.121894 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qnsv\" (UniqueName: \"kubernetes.io/projected/6201c81f-af43-46f5-8136-f4900c38f899-kube-api-access-4qnsv\") pod \"ingress-canary-gx9tv\" (UID: \"6201c81f-af43-46f5-8136-f4900c38f899\") " pod="openshift-ingress-canary/ingress-canary-gx9tv" Jul 09 01:38:33.215004 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.214970 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gx9tv" Jul 09 01:38:33.386266 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.386192 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gx9tv"] Jul 09 01:38:33.390921 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:38:33.390757 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6201c81f_af43_46f5_8136_f4900c38f899.slice/crio-94595ade2dd3e0ec14ac344abf6634867e6539ed047242bcbeb8ae7f96507273 WatchSource:0}: Error finding container 94595ade2dd3e0ec14ac344abf6634867e6539ed047242bcbeb8ae7f96507273: Status 404 returned error can't find the container with id 94595ade2dd3e0ec14ac344abf6634867e6539ed047242bcbeb8ae7f96507273 Jul 09 01:38:33.614666 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.614633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:33.614816 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.614677 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:33.614816 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:33.614773 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 01:38:33.614885 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:33.614817 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 01:38:33.614885 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:33.614832 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f675c8796-bnx5s: secret "image-registry-tls" not found Jul 09 01:38:33.614885 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:33.614847 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls podName:4ca68c46-c396-43fa-8692-74a84e9ea975 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:34.614832394 +0000 UTC m=+35.588304993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls") pod "dns-default-wgknd" (UID: "4ca68c46-c396-43fa-8692-74a84e9ea975") : secret "dns-default-metrics-tls" not found Jul 09 01:38:33.614885 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:33.614871 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls podName:78fbeff9-0a44-4007-85e3-c7912d8e1b9b nodeName:}" failed. No retries permitted until 2026-07-09 01:38:34.614859491 +0000 UTC m=+35.588332090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls") pod "image-registry-5f675c8796-bnx5s" (UID: "78fbeff9-0a44-4007-85e3-c7912d8e1b9b") : secret "image-registry-tls" not found Jul 09 01:38:33.787561 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:33.787523 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gx9tv" event={"ID":"6201c81f-af43-46f5-8136-f4900c38f899","Type":"ContainerStarted","Data":"94595ade2dd3e0ec14ac344abf6634867e6539ed047242bcbeb8ae7f96507273"} Jul 09 01:38:34.217242 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.217157 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:34.284700 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.284660 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:34.557637 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.557602 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:38:34.558104 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.557643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:38:34.558104 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.557709 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:38:34.560126 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.560097 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 01:38:34.560126 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.560118 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 01:38:34.560368 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.560192 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 01:38:34.560896 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.560872 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 01:38:34.561014 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.560874 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9w8gn\"" Jul 09 01:38:34.561014 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.560966 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npl7s\"" Jul 09 01:38:34.624893 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.624860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:34.625055 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.624899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:34.625055 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:34.625020 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 01:38:34.625055 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:34.625027 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 01:38:34.625231 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:34.625103 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls podName:4ca68c46-c396-43fa-8692-74a84e9ea975 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:36.625082673 +0000 UTC m=+37.598555276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls") pod "dns-default-wgknd" (UID: "4ca68c46-c396-43fa-8692-74a84e9ea975") : secret "dns-default-metrics-tls" not found Jul 09 01:38:34.625231 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:34.625035 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f675c8796-bnx5s: secret "image-registry-tls" not found Jul 09 01:38:34.625231 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:34.625196 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls podName:78fbeff9-0a44-4007-85e3-c7912d8e1b9b nodeName:}" failed. No retries permitted until 2026-07-09 01:38:36.62517828 +0000 UTC m=+37.598650897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls") pod "image-registry-5f675c8796-bnx5s" (UID: "78fbeff9-0a44-4007-85e3-c7912d8e1b9b") : secret "image-registry-tls" not found Jul 09 01:38:34.774272 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.774232 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:34.864850 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.864721 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:34.884964 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.884939 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tj77z"] Jul 09 01:38:34.903848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.903818 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:34.904134 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.904111 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tj77z"] Jul 09 01:38:34.906343 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.906319 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 01:38:34.906513 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.906451 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 01:38:34.906827 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.906805 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4v722\"" Jul 09 01:38:34.907297 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.907279 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 01:38:34.907381 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.907302 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 01:38:34.978315 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.978273 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-h6zsq"] Jul 09 01:38:34.994626 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:34.994588 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:35.002017 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.001881 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-h6zsq"] Jul 09 01:38:35.002017 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.002001 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h6zsq" Jul 09 01:38:35.011999 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.011590 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-k9w4z\"" Jul 09 01:38:35.011999 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.011732 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 01:38:35.011999 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.011846 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 01:38:35.027575 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.027501 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4f07e0cc-3728-49de-911f-d96e7bcb9693-crio-socket\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.027575 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.027564 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.027782 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.027602 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9djcz\" (UniqueName: \"kubernetes.io/projected/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-api-access-9djcz\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.027782 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.027625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f07e0cc-3728-49de-911f-d96e7bcb9693-data-volume\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.027782 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.027688 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.128794 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.128708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4f07e0cc-3728-49de-911f-d96e7bcb9693-crio-socket\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.128794 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.128742 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.128794 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.128769 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9djcz\" (UniqueName: \"kubernetes.io/projected/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-api-access-9djcz\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.129061 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:35.128848 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 01:38:35.129061 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:35.128938 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm podName:4f07e0cc-3728-49de-911f-d96e7bcb9693 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:35.628917399 +0000 UTC m=+36.602390001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tj77z" (UID: "4f07e0cc-3728-49de-911f-d96e7bcb9693") : configmap "kube-rbac-proxy" not found Jul 09 01:38:35.129061 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.128963 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f07e0cc-3728-49de-911f-d96e7bcb9693-data-volume\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.129061 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.128967 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4f07e0cc-3728-49de-911f-d96e7bcb9693-crio-socket\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.129061 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.129013 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.129061 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.129049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vpvz\" (UniqueName: \"kubernetes.io/projected/ca60759d-723c-4312-b7af-04ac90dc2b8b-kube-api-access-8vpvz\") pod \"migrator-d57d58cc9-h6zsq\" (UID: \"ca60759d-723c-4312-b7af-04ac90dc2b8b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h6zsq" Jul 09 01:38:35.129381 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:35.129123 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 01:38:35.129381 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:35.129192 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls podName:4f07e0cc-3728-49de-911f-d96e7bcb9693 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:35.629178152 +0000 UTC m=+36.602650777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tj77z" (UID: "4f07e0cc-3728-49de-911f-d96e7bcb9693") : secret "insights-runtime-extractor-tls" not found Jul 09 01:38:35.129488 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.129411 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f07e0cc-3728-49de-911f-d96e7bcb9693-data-volume\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.142168 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.142131 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9djcz\" (UniqueName: \"kubernetes.io/projected/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-api-access-9djcz\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.146884 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.146855 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:35.214393 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.214351 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:35.229473 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.229452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vpvz\" (UniqueName: \"kubernetes.io/projected/ca60759d-723c-4312-b7af-04ac90dc2b8b-kube-api-access-8vpvz\") pod \"migrator-d57d58cc9-h6zsq\" (UID: \"ca60759d-723c-4312-b7af-04ac90dc2b8b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h6zsq" Jul 09 01:38:35.240260 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.240228 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vpvz\" (UniqueName: \"kubernetes.io/projected/ca60759d-723c-4312-b7af-04ac90dc2b8b-kube-api-access-8vpvz\") pod \"migrator-d57d58cc9-h6zsq\" (UID: \"ca60759d-723c-4312-b7af-04ac90dc2b8b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h6zsq" Jul 09 01:38:35.314066 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.314031 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h6zsq" Jul 09 01:38:35.315262 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.315228 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:35.488042 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.487944 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:35.585344 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.585261 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:35.633577 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.633540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.633756 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:35.633597 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:35.633756 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:35.633676 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 01:38:35.633756 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:35.633745 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm podName:4f07e0cc-3728-49de-911f-d96e7bcb9693 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:36.633728256 +0000 UTC m=+37.607200855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tj77z" (UID: "4f07e0cc-3728-49de-911f-d96e7bcb9693") : configmap "kube-rbac-proxy" not found Jul 09 01:38:35.633917 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:35.633776 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 01:38:35.633917 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:35.633832 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls podName:4f07e0cc-3728-49de-911f-d96e7bcb9693 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:36.633820347 +0000 UTC m=+37.607292950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tj77z" (UID: "4f07e0cc-3728-49de-911f-d96e7bcb9693") : secret "insights-runtime-extractor-tls" not found Jul 09 01:38:36.275431 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:36.275391 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:36.277227 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:36.277208 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lvjrf_a4b12f0c-9647-466d-9823-a5273d80b153/dns-node-resolver/0.log" Jul 09 01:38:36.380709 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:36.380674 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:36.641722 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:36.641643 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:36.641722 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:36.641696 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:36.642288 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:36.641753 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:36.642288 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:36.641777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:36.642288 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:36.641781 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 01:38:36.642288 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:36.641867 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm podName:4f07e0cc-3728-49de-911f-d96e7bcb9693 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:38.641843874 +0000 UTC m=+39.615316495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tj77z" (UID: "4f07e0cc-3728-49de-911f-d96e7bcb9693") : configmap "kube-rbac-proxy" not found Jul 09 01:38:36.642288 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:36.641875 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 01:38:36.642288 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:36.641890 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 01:38:36.642288 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:36.641892 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 01:38:36.642288 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:36.641930 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls podName:4f07e0cc-3728-49de-911f-d96e7bcb9693 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:38.641917511 +0000 UTC m=+39.615390110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tj77z" (UID: "4f07e0cc-3728-49de-911f-d96e7bcb9693") : secret "insights-runtime-extractor-tls" not found Jul 09 01:38:36.642288 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:36.641954 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls podName:4ca68c46-c396-43fa-8692-74a84e9ea975 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:40.641937888 +0000 UTC m=+41.615410499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls") pod "dns-default-wgknd" (UID: "4ca68c46-c396-43fa-8692-74a84e9ea975") : secret "dns-default-metrics-tls" not found Jul 09 01:38:36.642288 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:36.641900 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f675c8796-bnx5s: secret "image-registry-tls" not found Jul 09 01:38:36.642288 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:36.641994 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls podName:78fbeff9-0a44-4007-85e3-c7912d8e1b9b nodeName:}" failed. No retries permitted until 2026-07-09 01:38:40.641984281 +0000 UTC m=+41.615456899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls") pod "image-registry-5f675c8796-bnx5s" (UID: "78fbeff9-0a44-4007-85e3-c7912d8e1b9b") : secret "image-registry-tls" not found Jul 09 01:38:37.109190 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.109150 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-knkxk"] Jul 09 01:38:37.125381 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.125349 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-knkxk"] Jul 09 01:38:37.125557 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.125470 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-knkxk" Jul 09 01:38:37.129172 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.129130 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vl8r7\"" Jul 09 01:38:37.129302 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.129249 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 01:38:37.130018 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.129999 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 01:38:37.130286 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.130268 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 01:38:37.130501 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.130484 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 01:38:37.191541 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.191506 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:37.247525 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.247493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/15a532e3-4361-4e62-86ee-a6e29150e83a-signing-cabundle\") pod \"service-ca-758f599c5-knkxk\" (UID: \"15a532e3-4361-4e62-86ee-a6e29150e83a\") " pod="openshift-service-ca/service-ca-758f599c5-knkxk" Jul 09 01:38:37.247701 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.247588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/15a532e3-4361-4e62-86ee-a6e29150e83a-signing-key\") pod \"service-ca-758f599c5-knkxk\" (UID: \"15a532e3-4361-4e62-86ee-a6e29150e83a\") " pod="openshift-service-ca/service-ca-758f599c5-knkxk" Jul 09 01:38:37.247701 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.247611 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtbmq\" (UniqueName: \"kubernetes.io/projected/15a532e3-4361-4e62-86ee-a6e29150e83a-kube-api-access-xtbmq\") pod \"service-ca-758f599c5-knkxk\" (UID: \"15a532e3-4361-4e62-86ee-a6e29150e83a\") " pod="openshift-service-ca/service-ca-758f599c5-knkxk" Jul 09 01:38:37.348376 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.348335 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/15a532e3-4361-4e62-86ee-a6e29150e83a-signing-cabundle\") pod \"service-ca-758f599c5-knkxk\" (UID: \"15a532e3-4361-4e62-86ee-a6e29150e83a\") " pod="openshift-service-ca/service-ca-758f599c5-knkxk" Jul 09 01:38:37.348531 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.348453 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/15a532e3-4361-4e62-86ee-a6e29150e83a-signing-key\") pod \"service-ca-758f599c5-knkxk\" (UID: \"15a532e3-4361-4e62-86ee-a6e29150e83a\") " pod="openshift-service-ca/service-ca-758f599c5-knkxk" Jul 09 01:38:37.348531 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.348481 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtbmq\" (UniqueName: \"kubernetes.io/projected/15a532e3-4361-4e62-86ee-a6e29150e83a-kube-api-access-xtbmq\") pod \"service-ca-758f599c5-knkxk\" (UID: \"15a532e3-4361-4e62-86ee-a6e29150e83a\") " pod="openshift-service-ca/service-ca-758f599c5-knkxk" Jul 09 01:38:37.349173 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.349123 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/15a532e3-4361-4e62-86ee-a6e29150e83a-signing-cabundle\") pod \"service-ca-758f599c5-knkxk\" (UID: \"15a532e3-4361-4e62-86ee-a6e29150e83a\") " pod="openshift-service-ca/service-ca-758f599c5-knkxk" Jul 09 01:38:37.351747 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.351720 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/15a532e3-4361-4e62-86ee-a6e29150e83a-signing-key\") pod \"service-ca-758f599c5-knkxk\" (UID: \"15a532e3-4361-4e62-86ee-a6e29150e83a\") " pod="openshift-service-ca/service-ca-758f599c5-knkxk" Jul 09 01:38:37.365659 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.365605 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtbmq\" (UniqueName: \"kubernetes.io/projected/15a532e3-4361-4e62-86ee-a6e29150e83a-kube-api-access-xtbmq\") pod \"service-ca-758f599c5-knkxk\" (UID: \"15a532e3-4361-4e62-86ee-a6e29150e83a\") " pod="openshift-service-ca/service-ca-758f599c5-knkxk" Jul 09 01:38:37.372835 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.372807 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:37.437436 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.437384 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-knkxk" Jul 09 01:38:37.486925 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.486895 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:37.678000 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.677933 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zktpv_66008bdf-c7e5-43e0-a569-61692022b688/node-ca/0.log" Jul 09 01:38:37.887688 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.887614 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-h6zsq"] Jul 09 01:38:37.892198 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:38:37.892163 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca60759d_723c_4312_b7af_04ac90dc2b8b.slice/crio-836b73482a590f1edb9dd377dc887a5159c254f3cbc502576c9953ddf094377d WatchSource:0}: Error finding container 836b73482a590f1edb9dd377dc887a5159c254f3cbc502576c9953ddf094377d: Status 404 returned error can't find the container with id 836b73482a590f1edb9dd377dc887a5159c254f3cbc502576c9953ddf094377d Jul 09 01:38:37.894718 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:37.894674 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-knkxk"] Jul 09 01:38:37.900584 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:38:37.900557 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a532e3_4361_4e62_86ee_a6e29150e83a.slice/crio-38214bbdca00a227e623f0540ef2bc31806a3bfd58476a344c9c140484785c7f WatchSource:0}: Error finding container 38214bbdca00a227e623f0540ef2bc31806a3bfd58476a344c9c140484785c7f: Status 404 returned error can't find the container with id 38214bbdca00a227e623f0540ef2bc31806a3bfd58476a344c9c140484785c7f Jul 09 01:38:38.055258 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:38.055100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:38.210290 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:38.210215 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:38.658200 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:38.657940 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:38.658200 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:38.658000 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:38.658200 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:38.658112 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 01:38:38.658200 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:38.658158 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 01:38:38.658200 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:38.658192 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm podName:4f07e0cc-3728-49de-911f-d96e7bcb9693 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:42.65817283 +0000 UTC m=+43.631645433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tj77z" (UID: "4f07e0cc-3728-49de-911f-d96e7bcb9693") : configmap "kube-rbac-proxy" not found Jul 09 01:38:38.658200 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:38.658210 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls podName:4f07e0cc-3728-49de-911f-d96e7bcb9693 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:42.658202499 +0000 UTC m=+43.631675098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tj77z" (UID: "4f07e0cc-3728-49de-911f-d96e7bcb9693") : secret "insights-runtime-extractor-tls" not found Jul 09 01:38:38.810514 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:38.810482 2565 generic.go:356] "Generic (PLEG): container finished" podID="703c3024-5208-43d1-829e-bc840655bf9c" containerID="0ee141ea271ca0baa1d8b535c49e5bd2d39e680b94d72294e1b8bf61748a20d8" exitCode=0 Jul 09 01:38:38.811268 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:38.810581 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5dkk" event={"ID":"703c3024-5208-43d1-829e-bc840655bf9c","Type":"ContainerDied","Data":"0ee141ea271ca0baa1d8b535c49e5bd2d39e680b94d72294e1b8bf61748a20d8"} Jul 09 01:38:38.812289 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:38.812258 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gx9tv" event={"ID":"6201c81f-af43-46f5-8136-f4900c38f899","Type":"ContainerStarted","Data":"ccd8d607a17c55f42922449ddf6e60eb46f59e7537ac67884ddd3bb24f5eee2d"} Jul 09 01:38:38.813457 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:38.813434 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-knkxk" event={"ID":"15a532e3-4361-4e62-86ee-a6e29150e83a","Type":"ContainerStarted","Data":"38214bbdca00a227e623f0540ef2bc31806a3bfd58476a344c9c140484785c7f"} Jul 09 01:38:38.814567 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:38.814545 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h6zsq" event={"ID":"ca60759d-723c-4312-b7af-04ac90dc2b8b","Type":"ContainerStarted","Data":"836b73482a590f1edb9dd377dc887a5159c254f3cbc502576c9953ddf094377d"} Jul 09 01:38:38.853242 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:38.853112 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gx9tv" podStartSLOduration=2.498193654 podStartE2EDuration="6.853073174s" totalImagesPullingTime="4.35487952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:38.85293127 +0000 UTC m=+39.826403889" watchObservedRunningTime="2026-07-09 01:38:38.853073174 +0000 UTC m=+39.826545789" Jul 09 01:38:39.820595 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:39.820558 2565 generic.go:356] "Generic (PLEG): container finished" podID="703c3024-5208-43d1-829e-bc840655bf9c" containerID="16b999bea22fe979d7040f33d195dd261dfad56be39fe69b6173c3b90f75e3eb" exitCode=0 Jul 09 01:38:39.821028 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:39.820648 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5dkk" event={"ID":"703c3024-5208-43d1-829e-bc840655bf9c","Type":"ContainerDied","Data":"16b999bea22fe979d7040f33d195dd261dfad56be39fe69b6173c3b90f75e3eb"} Jul 09 01:38:40.679429 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:40.679397 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:40.679429 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:40.679433 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:40.679587 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:40.679528 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 01:38:40.679587 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:40.679534 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 01:38:40.679587 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:40.679586 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls podName:4ca68c46-c396-43fa-8692-74a84e9ea975 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:48.679569685 +0000 UTC m=+49.653042284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls") pod "dns-default-wgknd" (UID: "4ca68c46-c396-43fa-8692-74a84e9ea975") : secret "dns-default-metrics-tls" not found Jul 09 01:38:40.679679 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:40.679542 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f675c8796-bnx5s: secret "image-registry-tls" not found Jul 09 01:38:40.679679 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:40.679649 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls podName:78fbeff9-0a44-4007-85e3-c7912d8e1b9b nodeName:}" failed. No retries permitted until 2026-07-09 01:38:48.679638585 +0000 UTC m=+49.653111185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls") pod "image-registry-5f675c8796-bnx5s" (UID: "78fbeff9-0a44-4007-85e3-c7912d8e1b9b") : secret "image-registry-tls" not found Jul 09 01:38:40.825212 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:40.825172 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h6zsq" event={"ID":"ca60759d-723c-4312-b7af-04ac90dc2b8b","Type":"ContainerStarted","Data":"dc74823d59be3d6401573da101d3ea06e047190d605bd6668e253eb69931c454"} Jul 09 01:38:40.825646 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:40.825237 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h6zsq" event={"ID":"ca60759d-723c-4312-b7af-04ac90dc2b8b","Type":"ContainerStarted","Data":"0afed1086381c87c7aaea48e77c3285c895f4fc7c251b50556fa1ec59bb881c3"} Jul 09 01:38:40.828509 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:40.828478 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f5dkk" event={"ID":"703c3024-5208-43d1-829e-bc840655bf9c","Type":"ContainerStarted","Data":"4bee03fb63fc204d3a9cd73847b37aa9a9abe4eae4204837473b3d98e1868578"} Jul 09 01:38:40.829880 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:40.829856 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-knkxk" event={"ID":"15a532e3-4361-4e62-86ee-a6e29150e83a","Type":"ContainerStarted","Data":"23959a1a64293b28f623f6cb7a286d53896398e05f5e09af66e3159ed77f39ac"} Jul 09 01:38:40.851838 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:40.851789 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-h6zsq" podStartSLOduration=4.325994018 podStartE2EDuration="6.851769853s" totalImagesPullingTime="2.525775835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:40.851706313 +0000 UTC m=+41.825178935" watchObservedRunningTime="2026-07-09 01:38:40.851769853 +0000 UTC m=+41.825242475" Jul 09 01:38:40.913814 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:40.913720 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f5dkk" podStartSLOduration=8.009835433 podStartE2EDuration="41.913705728s" totalImagesPullingTime="33.903870295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:40.897005888 +0000 UTC m=+41.870478510" watchObservedRunningTime="2026-07-09 01:38:40.913705728 +0000 UTC m=+41.887178394" Jul 09 01:38:40.914239 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:40.914211 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-knkxk" podStartSLOduration=1.390491459 podStartE2EDuration="3.914198121s" totalImagesPullingTime="2.523706662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:40.913385657 +0000 UTC m=+41.886858289" watchObservedRunningTime="2026-07-09 01:38:40.914198121 +0000 UTC m=+41.887670742" Jul 09 01:38:41.245040 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:41.245006 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:41.367877 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:41.367835 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:41.443079 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:41.443035 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:41.517258 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:41.517166 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:41.617839 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:41.617783 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:41.719130 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:41.719094 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:41.827918 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:41.827829 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:41.935855 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:41.935819 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:42.699630 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:42.699596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:42.699630 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:42.699634 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:42.699854 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:42.699753 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 01:38:42.699854 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:42.699816 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 01:38:42.699854 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:42.699847 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm podName:4f07e0cc-3728-49de-911f-d96e7bcb9693 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:50.699825105 +0000 UTC m=+51.673297725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tj77z" (UID: "4f07e0cc-3728-49de-911f-d96e7bcb9693") : configmap "kube-rbac-proxy" not found Jul 09 01:38:42.700014 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:42.699874 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls podName:4f07e0cc-3728-49de-911f-d96e7bcb9693 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:50.699861734 +0000 UTC m=+51.673334332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tj77z" (UID: "4f07e0cc-3728-49de-911f-d96e7bcb9693") : secret "insights-runtime-extractor-tls" not found Jul 09 01:38:42.929725 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:42.929691 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:43.329691 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:43.329658 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:43.534637 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:43.534602 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:43.733125 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:43.733097 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:43.931491 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:43.931457 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:44.057727 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:44.057647 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:44.842799 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:44.842771 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:44.946230 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:44.946197 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:45.044036 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:45.044004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:45.144049 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:45.143964 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:45.332901 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:45.332871 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:45.532977 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:45.532945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:45.633234 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:45.633203 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:46.539492 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:46.539455 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:46.730323 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:46.730283 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:46.923320 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:46.923244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:47.129327 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:47.129292 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:47.332608 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:47.332566 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:47.443902 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:47.443835 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:47.544832 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:47.544797 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:48.727981 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:48.727945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:48.746254 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:48.746228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:48.746371 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:48.746268 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:48.749313 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:48.749283 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ca68c46-c396-43fa-8692-74a84e9ea975-metrics-tls\") pod \"dns-default-wgknd\" (UID: \"4ca68c46-c396-43fa-8692-74a84e9ea975\") " pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:48.749472 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:48.749453 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls\") pod \"image-registry-5f675c8796-bnx5s\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:48.795886 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:48.795860 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:48.805016 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:48.804983 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:48.931340 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:48.931195 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:48.950095 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:48.950065 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f675c8796-bnx5s"] Jul 09 01:38:48.953339 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:38:48.953309 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78fbeff9_0a44_4007_85e3_c7912d8e1b9b.slice/crio-7b48f25be63af7d1299815633320d56aa0d2f0c7758d71b84898b2272354c983 WatchSource:0}: Error finding container 7b48f25be63af7d1299815633320d56aa0d2f0c7758d71b84898b2272354c983: Status 404 returned error can't find the container with id 7b48f25be63af7d1299815633320d56aa0d2f0c7758d71b84898b2272354c983 Jul 09 01:38:48.968640 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:48.968612 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wgknd"] Jul 09 01:38:48.970044 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:38:48.970019 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca68c46_c396_43fa_8692_74a84e9ea975.slice/crio-226fe47980bd6fa88b146488d402709eead077d67e0663e91fbca65b1685a801 WatchSource:0}: Error finding container 226fe47980bd6fa88b146488d402709eead077d67e0663e91fbca65b1685a801: Status 404 returned error can't find the container with id 226fe47980bd6fa88b146488d402709eead077d67e0663e91fbca65b1685a801 Jul 09 01:38:49.125928 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:49.125892 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:49.335570 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:49.335484 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:49.532062 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:49.531999 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:49.855627 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:49.855580 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" event={"ID":"78fbeff9-0a44-4007-85e3-c7912d8e1b9b","Type":"ContainerStarted","Data":"db60e67391e50fa547997e959813a450b39f4592cac14f608c09f6bcfdad66f3"} Jul 09 01:38:49.856072 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:49.855684 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:38:49.856072 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:49.855710 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" event={"ID":"78fbeff9-0a44-4007-85e3-c7912d8e1b9b","Type":"ContainerStarted","Data":"7b48f25be63af7d1299815633320d56aa0d2f0c7758d71b84898b2272354c983"} Jul 09 01:38:49.856796 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:49.856756 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wgknd" event={"ID":"4ca68c46-c396-43fa-8692-74a84e9ea975","Type":"ContainerStarted","Data":"226fe47980bd6fa88b146488d402709eead077d67e0663e91fbca65b1685a801"} Jul 09 01:38:49.875127 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:49.875077 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" podStartSLOduration=51.87506009 podStartE2EDuration="51.87506009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:49.874822418 +0000 UTC m=+50.848295039" watchObservedRunningTime="2026-07-09 01:38:49.87506009 +0000 UTC m=+50.848532712" Jul 09 01:38:49.931859 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:49.931824 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:50.552659 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:50.552624 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:50.725556 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:50.725517 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:50.764724 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:50.764691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:50.764915 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:50.764742 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:50.764915 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:50.764898 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 01:38:50.765036 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:38:50.764984 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls podName:4f07e0cc-3728-49de-911f-d96e7bcb9693 nodeName:}" failed. No retries permitted until 2026-07-09 01:39:06.764962457 +0000 UTC m=+67.738435060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tj77z" (UID: "4f07e0cc-3728-49de-911f-d96e7bcb9693") : secret "insights-runtime-extractor-tls" not found Jul 09 01:38:50.765389 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:50.765357 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f07e0cc-3728-49de-911f-d96e7bcb9693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:38:51.129883 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:51.129848 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:51.329010 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:51.328967 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:51.723181 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:51.723102 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:51.865070 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:51.865034 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wgknd" event={"ID":"4ca68c46-c396-43fa-8692-74a84e9ea975","Type":"ContainerStarted","Data":"755f5a2c18fa6f068a770bd0e1867958ef2e98911e9cf510c0fac96e8776aba2"} Jul 09 01:38:51.865340 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:51.865087 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wgknd" event={"ID":"4ca68c46-c396-43fa-8692-74a84e9ea975","Type":"ContainerStarted","Data":"c812fd9b32902d9f489b0a4aab7be70cad1d6a7a7769d3c0754d69425d9fd37d"} Jul 09 01:38:51.865340 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:51.865117 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wgknd" Jul 09 01:38:51.884027 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:51.883979 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wgknd" podStartSLOduration=17.394706987 podStartE2EDuration="19.883963373s" totalImagesPullingTime="2.489256386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:51.882744762 +0000 UTC m=+52.856217376" watchObservedRunningTime="2026-07-09 01:38:51.883963373 +0000 UTC m=+52.857435972" Jul 09 01:38:51.937642 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:51.937602 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:56.743237 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:56.743197 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:56.843810 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:56.843779 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:58.299259 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.299224 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x"] Jul 09 01:38:58.324634 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.324607 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d"] Jul 09 01:38:58.324773 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.324734 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x" Jul 09 01:38:58.330818 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.330786 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 01:38:58.330971 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.330842 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 01:38:58.330971 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.330853 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 01:38:58.330971 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.330869 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jx624\"" Jul 09 01:38:58.330971 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.330895 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 01:38:58.336321 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.336286 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:58.342983 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.342959 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d"] Jul 09 01:38:58.343102 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.342993 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c"] Jul 09 01:38:58.343102 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.343077 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" Jul 09 01:38:58.346770 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.346749 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 09 01:38:58.364962 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.364935 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x"] Jul 09 01:38:58.364962 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.364970 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f675c8796-bnx5s"] Jul 09 01:38:58.365216 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.365008 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c"] Jul 09 01:38:58.365216 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.365086 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.367623 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.367599 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 09 01:38:58.369035 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.369014 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 09 01:38:58.369035 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.369024 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 09 01:38:58.369198 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.369021 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 09 01:38:58.402905 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.402876 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dd879d8c8-k9255"] Jul 09 01:38:58.423891 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.423856 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dc232aed-4cea-448a-a192-d27107dccaf0-hub\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.424099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.423948 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc232aed-4cea-448a-a192-d27107dccaf0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.424099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.423994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75w74\" (UniqueName: \"kubernetes.io/projected/b33f6aea-51a5-493b-b733-ed2080bdf57f-kube-api-access-75w74\") pod \"klusterlet-addon-workmgr-8497bb855d-kln5d\" (UID: \"b33f6aea-51a5-493b-b733-ed2080bdf57f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" Jul 09 01:38:58.424099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.424024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b33f6aea-51a5-493b-b733-ed2080bdf57f-klusterlet-config\") pod \"klusterlet-addon-workmgr-8497bb855d-kln5d\" (UID: \"b33f6aea-51a5-493b-b733-ed2080bdf57f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" Jul 09 01:38:58.424099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.424056 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dc232aed-4cea-448a-a192-d27107dccaf0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.424394 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.424160 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7fpn\" (UniqueName: \"kubernetes.io/projected/9bb20466-fe47-4210-a00b-fb2a752edc5d-kube-api-access-s7fpn\") pod \"managed-serviceaccount-addon-agent-c765849d6-dl44x\" (UID: \"9bb20466-fe47-4210-a00b-fb2a752edc5d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x" Jul 09 01:38:58.424394 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.424188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b33f6aea-51a5-493b-b733-ed2080bdf57f-tmp\") pod \"klusterlet-addon-workmgr-8497bb855d-kln5d\" (UID: \"b33f6aea-51a5-493b-b733-ed2080bdf57f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" Jul 09 01:38:58.424394 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.424200 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dd879d8c8-k9255"] Jul 09 01:38:58.424394 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.424242 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9bb20466-fe47-4210-a00b-fb2a752edc5d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c765849d6-dl44x\" (UID: \"9bb20466-fe47-4210-a00b-fb2a752edc5d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x" Jul 09 01:38:58.424394 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.424266 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc232aed-4cea-448a-a192-d27107dccaf0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.424394 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.424286 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.424394 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.424305 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkp5n\" (UniqueName: \"kubernetes.io/projected/dc232aed-4cea-448a-a192-d27107dccaf0-kube-api-access-lkp5n\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.424394 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.424352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dc232aed-4cea-448a-a192-d27107dccaf0-ca\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.435686 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.435656 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:58.525574 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.525540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9bb20466-fe47-4210-a00b-fb2a752edc5d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c765849d6-dl44x\" (UID: \"9bb20466-fe47-4210-a00b-fb2a752edc5d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x" Jul 09 01:38:58.525574 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.525571 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc232aed-4cea-448a-a192-d27107dccaf0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.525778 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.525704 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkp5n\" (UniqueName: \"kubernetes.io/projected/dc232aed-4cea-448a-a192-d27107dccaf0-kube-api-access-lkp5n\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.525778 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.525735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69cc01a4-5f86-4786-84d2-ff8362989963-trusted-ca\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.525854 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.525776 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69cc01a4-5f86-4786-84d2-ff8362989963-bound-sa-token\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.525854 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.525828 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dc232aed-4cea-448a-a192-d27107dccaf0-ca\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.525946 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.525852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9hnp\" (UniqueName: \"kubernetes.io/projected/69cc01a4-5f86-4786-84d2-ff8362989963-kube-api-access-x9hnp\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.526006 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.525968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dc232aed-4cea-448a-a192-d27107dccaf0-hub\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.526006 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.525994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc232aed-4cea-448a-a192-d27107dccaf0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.526106 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.526021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/69cc01a4-5f86-4786-84d2-ff8362989963-registry-certificates\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.526106 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.526041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75w74\" (UniqueName: \"kubernetes.io/projected/b33f6aea-51a5-493b-b733-ed2080bdf57f-kube-api-access-75w74\") pod \"klusterlet-addon-workmgr-8497bb855d-kln5d\" (UID: \"b33f6aea-51a5-493b-b733-ed2080bdf57f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" Jul 09 01:38:58.526233 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.526177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b33f6aea-51a5-493b-b733-ed2080bdf57f-klusterlet-config\") pod \"klusterlet-addon-workmgr-8497bb855d-kln5d\" (UID: \"b33f6aea-51a5-493b-b733-ed2080bdf57f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" Jul 09 01:38:58.526233 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.526213 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/69cc01a4-5f86-4786-84d2-ff8362989963-ca-trust-extracted\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.526342 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.526313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dc232aed-4cea-448a-a192-d27107dccaf0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.526393 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.526382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7fpn\" (UniqueName: \"kubernetes.io/projected/9bb20466-fe47-4210-a00b-fb2a752edc5d-kube-api-access-s7fpn\") pod \"managed-serviceaccount-addon-agent-c765849d6-dl44x\" (UID: \"9bb20466-fe47-4210-a00b-fb2a752edc5d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x" Jul 09 01:38:58.526447 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.526415 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69cc01a4-5f86-4786-84d2-ff8362989963-installation-pull-secrets\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.526500 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.526445 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b33f6aea-51a5-493b-b733-ed2080bdf57f-tmp\") pod \"klusterlet-addon-workmgr-8497bb855d-kln5d\" (UID: \"b33f6aea-51a5-493b-b733-ed2080bdf57f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" Jul 09 01:38:58.526500 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.526476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69cc01a4-5f86-4786-84d2-ff8362989963-image-registry-private-configuration\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.526595 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.526504 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69cc01a4-5f86-4786-84d2-ff8362989963-registry-tls\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.526733 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.526711 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc232aed-4cea-448a-a192-d27107dccaf0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.527199 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.527173 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b33f6aea-51a5-493b-b733-ed2080bdf57f-tmp\") pod \"klusterlet-addon-workmgr-8497bb855d-kln5d\" (UID: \"b33f6aea-51a5-493b-b733-ed2080bdf57f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" Jul 09 01:38:58.528529 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.528496 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dc232aed-4cea-448a-a192-d27107dccaf0-ca\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.528770 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.528745 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9bb20466-fe47-4210-a00b-fb2a752edc5d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c765849d6-dl44x\" (UID: \"9bb20466-fe47-4210-a00b-fb2a752edc5d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x" Jul 09 01:38:58.528770 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.528757 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dc232aed-4cea-448a-a192-d27107dccaf0-hub\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.528920 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.528898 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc232aed-4cea-448a-a192-d27107dccaf0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.529113 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.529089 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dc232aed-4cea-448a-a192-d27107dccaf0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.529481 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.529464 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b33f6aea-51a5-493b-b733-ed2080bdf57f-klusterlet-config\") pod \"klusterlet-addon-workmgr-8497bb855d-kln5d\" (UID: \"b33f6aea-51a5-493b-b733-ed2080bdf57f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" Jul 09 01:38:58.535942 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.535895 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:58.537992 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.537968 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkp5n\" (UniqueName: \"kubernetes.io/projected/dc232aed-4cea-448a-a192-d27107dccaf0-kube-api-access-lkp5n\") pod \"cluster-proxy-proxy-agent-564d6dc85c-ncg2c\" (UID: \"dc232aed-4cea-448a-a192-d27107dccaf0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.538297 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.538278 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75w74\" (UniqueName: \"kubernetes.io/projected/b33f6aea-51a5-493b-b733-ed2080bdf57f-kube-api-access-75w74\") pod \"klusterlet-addon-workmgr-8497bb855d-kln5d\" (UID: \"b33f6aea-51a5-493b-b733-ed2080bdf57f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" Jul 09 01:38:58.538409 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.538392 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7fpn\" (UniqueName: \"kubernetes.io/projected/9bb20466-fe47-4210-a00b-fb2a752edc5d-kube-api-access-s7fpn\") pod \"managed-serviceaccount-addon-agent-c765849d6-dl44x\" (UID: \"9bb20466-fe47-4210-a00b-fb2a752edc5d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x" Jul 09 01:38:58.627112 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.627027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69cc01a4-5f86-4786-84d2-ff8362989963-bound-sa-token\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.627112 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.627074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9hnp\" (UniqueName: \"kubernetes.io/projected/69cc01a4-5f86-4786-84d2-ff8362989963-kube-api-access-x9hnp\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.627327 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.627210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/69cc01a4-5f86-4786-84d2-ff8362989963-registry-certificates\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.627327 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.627256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/69cc01a4-5f86-4786-84d2-ff8362989963-ca-trust-extracted\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.627327 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.627307 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69cc01a4-5f86-4786-84d2-ff8362989963-installation-pull-secrets\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.627468 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.627328 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69cc01a4-5f86-4786-84d2-ff8362989963-image-registry-private-configuration\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.627468 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.627358 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69cc01a4-5f86-4786-84d2-ff8362989963-registry-tls\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.627468 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.627408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69cc01a4-5f86-4786-84d2-ff8362989963-trusted-ca\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.627776 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.627742 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/69cc01a4-5f86-4786-84d2-ff8362989963-ca-trust-extracted\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.628104 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.628065 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/69cc01a4-5f86-4786-84d2-ff8362989963-registry-certificates\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.628373 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.628353 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69cc01a4-5f86-4786-84d2-ff8362989963-trusted-ca\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.629763 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.629741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69cc01a4-5f86-4786-84d2-ff8362989963-image-registry-private-configuration\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.629892 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.629871 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69cc01a4-5f86-4786-84d2-ff8362989963-registry-tls\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.629956 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.629889 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69cc01a4-5f86-4786-84d2-ff8362989963-installation-pull-secrets\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.635750 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.635724 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69cc01a4-5f86-4786-84d2-ff8362989963-bound-sa-token\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.635930 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.635911 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9hnp\" (UniqueName: \"kubernetes.io/projected/69cc01a4-5f86-4786-84d2-ff8362989963-kube-api-access-x9hnp\") pod \"image-registry-dd879d8c8-k9255\" (UID: \"69cc01a4-5f86-4786-84d2-ff8362989963\") " pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.646671 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.646636 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x" Jul 09 01:38:58.653815 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.653792 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" Jul 09 01:38:58.674582 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.674548 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" Jul 09 01:38:58.735978 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.735892 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:58.755656 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.755379 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:58.824897 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.824866 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x"] Jul 09 01:38:58.827848 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.827761 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:38:58.828545 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:38:58.828261 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bb20466_fe47_4210_a00b_fb2a752edc5d.slice/crio-113051450a085f1f922305a026b8295dadbec5527a1293dbf477e9a5b356aa89 WatchSource:0}: Error finding container 113051450a085f1f922305a026b8295dadbec5527a1293dbf477e9a5b356aa89: Status 404 returned error can't find the container with id 113051450a085f1f922305a026b8295dadbec5527a1293dbf477e9a5b356aa89 Jul 09 01:38:58.844977 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.844943 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d"] Jul 09 01:38:58.848586 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:38:58.848559 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33f6aea_51a5_493b_b733_ed2080bdf57f.slice/crio-c75b9aa136cb8fa9ace697e31be14ff26c0ae66d701cb0794b0511d0ff8f86fc WatchSource:0}: Error finding container c75b9aa136cb8fa9ace697e31be14ff26c0ae66d701cb0794b0511d0ff8f86fc: Status 404 returned error can't find the container with id c75b9aa136cb8fa9ace697e31be14ff26c0ae66d701cb0794b0511d0ff8f86fc Jul 09 01:38:58.867732 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.867710 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c"] Jul 09 01:38:58.868978 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:38:58.868957 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc232aed_4cea_448a_a192_d27107dccaf0.slice/crio-3168f3c7d1ddcbe6c658175177b10e0b49605adf97ea3180c9bf96cc390caa51 WatchSource:0}: Error finding container 3168f3c7d1ddcbe6c658175177b10e0b49605adf97ea3180c9bf96cc390caa51: Status 404 returned error can't find the container with id 3168f3c7d1ddcbe6c658175177b10e0b49605adf97ea3180c9bf96cc390caa51 Jul 09 01:38:58.894252 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.894168 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" event={"ID":"dc232aed-4cea-448a-a192-d27107dccaf0","Type":"ContainerStarted","Data":"3168f3c7d1ddcbe6c658175177b10e0b49605adf97ea3180c9bf96cc390caa51"} Jul 09 01:38:58.895376 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.895348 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x" event={"ID":"9bb20466-fe47-4210-a00b-fb2a752edc5d","Type":"ContainerStarted","Data":"113051450a085f1f922305a026b8295dadbec5527a1293dbf477e9a5b356aa89"} Jul 09 01:38:58.896453 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.896425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" event={"ID":"b33f6aea-51a5-493b-b733-ed2080bdf57f","Type":"ContainerStarted","Data":"c75b9aa136cb8fa9ace697e31be14ff26c0ae66d701cb0794b0511d0ff8f86fc"} Jul 09 01:38:58.922523 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:58.922492 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dd879d8c8-k9255"] Jul 09 01:38:58.925077 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:38:58.925042 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69cc01a4_5f86_4786_84d2_ff8362989963.slice/crio-239f6e8460d7b263aab0253a1a46bbf38f8ddaf389cb002e86eca8719835519f WatchSource:0}: Error finding container 239f6e8460d7b263aab0253a1a46bbf38f8ddaf389cb002e86eca8719835519f: Status 404 returned error can't find the container with id 239f6e8460d7b263aab0253a1a46bbf38f8ddaf389cb002e86eca8719835519f Jul 09 01:38:59.800859 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:59.800822 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w4rwf" Jul 09 01:38:59.906648 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:59.906608 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dd879d8c8-k9255" event={"ID":"69cc01a4-5f86-4786-84d2-ff8362989963","Type":"ContainerStarted","Data":"4075c296e0709b2044a2abde16d7edaf37a3906791329038658dcabe03dc4000"} Jul 09 01:38:59.906847 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:59.906677 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dd879d8c8-k9255" event={"ID":"69cc01a4-5f86-4786-84d2-ff8362989963","Type":"ContainerStarted","Data":"239f6e8460d7b263aab0253a1a46bbf38f8ddaf389cb002e86eca8719835519f"} Jul 09 01:38:59.907577 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:59.907552 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:38:59.946902 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:59.946839 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-dd879d8c8-k9255" podStartSLOduration=1.9468147 podStartE2EDuration="1.9468147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:59.946021875 +0000 UTC m=+60.919494495" watchObservedRunningTime="2026-07-09 01:38:59.9468147 +0000 UTC m=+60.920287323" Jul 09 01:38:59.964874 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:38:59.964835 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:00.066022 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:00.065863 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:00.118703 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:00.118622 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:00.503406 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:00.503306 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:00.570815 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:00.570694 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:00.918035 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:00.913890 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:01.012076 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:01.012033 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:01.364945 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:01.364881 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:01.431076 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:01.430988 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:01.526483 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:01.526421 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:01.724484 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:01.724402 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:01.797123 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:01.797088 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:01.857472 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:01.857433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:01.870321 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:01.870294 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wgknd" Jul 09 01:39:01.957858 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:01.957821 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:02.058152 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:02.058099 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:02.158693 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:02.158656 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:02.232265 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:02.232225 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:02.415508 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:02.415423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:02.518268 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:02.518229 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:02.660762 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:02.660723 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:02.732594 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:02.732563 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:02.832818 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:02.832779 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:02.901051 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:02.901004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:02.927472 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:02.927434 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x" event={"ID":"9bb20466-fe47-4210-a00b-fb2a752edc5d","Type":"ContainerStarted","Data":"fac4ad4ed16ef4176b3e6d567cc1d43fdeff1a683d4e7a04f20c81f220cd8c34"} Jul 09 01:39:02.941999 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:02.941937 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c765849d6-dl44x" podStartSLOduration=1.6592431090000002 podStartE2EDuration="4.941913127s" totalImagesPullingTime="3.282670018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:02.941642105 +0000 UTC m=+63.915114726" watchObservedRunningTime="2026-07-09 01:39:02.941913127 +0000 UTC m=+63.915385748" Jul 09 01:39:03.429065 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:03.429028 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:03.623936 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:03.623890 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:04.043358 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.043319 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:04.383365 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.383283 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbrfl\" (UniqueName: \"kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl\") pod \"network-check-target-9pjtm\" (UID: \"53c92713-90e9-4d9d-b5c6-f0f15a33fc82\") " pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:39:04.383365 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.383345 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs\") pod \"network-metrics-daemon-s7zrq\" (UID: \"c975edec-2157-4f50-85fc-102b756da42b\") " pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:39:04.383602 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.383382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:39:04.385882 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.385858 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 01:39:04.386720 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.386693 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 01:39:04.386720 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.386693 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 01:39:04.396508 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.396480 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 01:39:04.397215 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.397194 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5982d2fd-d322-47cf-a233-c41afb3ff1fd-original-pull-secret\") pod \"global-pull-secret-syncer-nd79x\" (UID: \"5982d2fd-d322-47cf-a233-c41afb3ff1fd\") " pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:39:04.397321 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.397259 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c975edec-2157-4f50-85fc-102b756da42b-metrics-certs\") pod \"network-metrics-daemon-s7zrq\" (UID: \"c975edec-2157-4f50-85fc-102b756da42b\") " pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:39:04.408004 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.407971 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbrfl\" (UniqueName: \"kubernetes.io/projected/53c92713-90e9-4d9d-b5c6-f0f15a33fc82-kube-api-access-hbrfl\") pod \"network-check-target-9pjtm\" (UID: \"53c92713-90e9-4d9d-b5c6-f0f15a33fc82\") " pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:39:04.572904 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.572876 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9w8gn\"" Jul 09 01:39:04.580070 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.580047 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:39:04.580228 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.580112 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npl7s\"" Jul 09 01:39:04.583987 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.583966 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nd79x" Jul 09 01:39:04.588998 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.588981 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s7zrq" Jul 09 01:39:04.945001 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.944886 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" event={"ID":"dc232aed-4cea-448a-a192-d27107dccaf0","Type":"ContainerStarted","Data":"3cca36a515eaae2aa10e92bf4b9677dc34e76b3d773771ed0fad9fdf5339ad55"} Jul 09 01:39:04.953534 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.952910 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" event={"ID":"b33f6aea-51a5-493b-b733-ed2080bdf57f","Type":"ContainerStarted","Data":"7965b7731e85c0858d122c2081ed4889a95fceb22029d6cae4334cbe4bd3b52a"} Jul 09 01:39:04.953534 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.953486 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" Jul 09 01:39:04.956301 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.955991 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" podUID="b33f6aea-51a5-493b-b733-ed2080bdf57f" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.13:8000/readyz\": dial tcp 10.133.0.13:8000: connect: connection refused" Jul 09 01:39:04.970416 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.969819 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" podStartSLOduration=0.975610426 podStartE2EDuration="6.969798613s" totalImagesPullingTime="5.994188187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:04.967896613 +0000 UTC m=+65.941369229" watchObservedRunningTime="2026-07-09 01:39:04.969798613 +0000 UTC m=+65.943271238" Jul 09 01:39:04.975497 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:04.975421 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9pjtm"] Jul 09 01:39:04.986104 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:39:04.986076 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53c92713_90e9_4d9d_b5c6_f0f15a33fc82.slice/crio-5d24521510c92b2a9e80fb9fb83f81a731f65d21e129cc0aac27078dbc9b8056 WatchSource:0}: Error finding container 5d24521510c92b2a9e80fb9fb83f81a731f65d21e129cc0aac27078dbc9b8056: Status 404 returned error can't find the container with id 5d24521510c92b2a9e80fb9fb83f81a731f65d21e129cc0aac27078dbc9b8056 Jul 09 01:39:05.002465 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.002437 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nd79x"] Jul 09 01:39:05.005560 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:39:05.005535 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5982d2fd_d322_47cf_a233_c41afb3ff1fd.slice/crio-e9f83a6dba8843cc7b7cc552e852c14037770ae21a8f839ecb42421b5a4b4c48 WatchSource:0}: Error finding container e9f83a6dba8843cc7b7cc552e852c14037770ae21a8f839ecb42421b5a4b4c48: Status 404 returned error can't find the container with id e9f83a6dba8843cc7b7cc552e852c14037770ae21a8f839ecb42421b5a4b4c48 Jul 09 01:39:05.208977 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.208949 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s7zrq"] Jul 09 01:39:05.211983 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:39:05.211957 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc975edec_2157_4f50_85fc_102b756da42b.slice/crio-9ef9bc5c1262dbbded3a64c9f1b8be5ddd86b5946d17848cf520c0b4330a8a30 WatchSource:0}: Error finding container 9ef9bc5c1262dbbded3a64c9f1b8be5ddd86b5946d17848cf520c0b4330a8a30: Status 404 returned error can't find the container with id 9ef9bc5c1262dbbded3a64c9f1b8be5ddd86b5946d17848cf520c0b4330a8a30 Jul 09 01:39:05.443949 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.443868 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:05.501330 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.501290 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:05.644188 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.644125 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:05.746337 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.746268 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:05.803101 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.803022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:05.960637 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.960596 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nd79x" event={"ID":"5982d2fd-d322-47cf-a233-c41afb3ff1fd","Type":"ContainerStarted","Data":"e9f83a6dba8843cc7b7cc552e852c14037770ae21a8f839ecb42421b5a4b4c48"} Jul 09 01:39:05.963769 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.963682 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" event={"ID":"dc232aed-4cea-448a-a192-d27107dccaf0","Type":"ContainerStarted","Data":"176622ffe6327ffe04aae80357c2f9012fa3aa209cbb07d1f609b6193fb48efa"} Jul 09 01:39:05.963769 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.963729 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" event={"ID":"dc232aed-4cea-448a-a192-d27107dccaf0","Type":"ContainerStarted","Data":"bd2e805a792e10c92bbd81876153abdda8e15a6c4158f34338b8546117d584d1"} Jul 09 01:39:05.965812 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.965754 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s7zrq" event={"ID":"c975edec-2157-4f50-85fc-102b756da42b","Type":"ContainerStarted","Data":"9ef9bc5c1262dbbded3a64c9f1b8be5ddd86b5946d17848cf520c0b4330a8a30"} Jul 09 01:39:05.967793 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.967739 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9pjtm" event={"ID":"53c92713-90e9-4d9d-b5c6-f0f15a33fc82","Type":"ContainerStarted","Data":"5d24521510c92b2a9e80fb9fb83f81a731f65d21e129cc0aac27078dbc9b8056"} Jul 09 01:39:05.969047 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.969020 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8497bb855d-kln5d" Jul 09 01:39:05.983790 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:05.983733 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564d6dc85c-ncg2c" podStartSLOduration=2.024708601 podStartE2EDuration="7.983713804s" totalImagesPullingTime="5.959005203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:05.982325881 +0000 UTC m=+66.955798514" watchObservedRunningTime="2026-07-09 01:39:05.983713804 +0000 UTC m=+66.957186428" Jul 09 01:39:06.547557 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:06.547507 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:06.649739 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:06.649646 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:06.805264 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:06.805224 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:39:06.808323 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:06.808097 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f07e0cc-3728-49de-911f-d96e7bcb9693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tj77z\" (UID: \"4f07e0cc-3728-49de-911f-d96e7bcb9693\") " pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:39:06.973936 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:06.973852 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s7zrq" event={"ID":"c975edec-2157-4f50-85fc-102b756da42b","Type":"ContainerStarted","Data":"61a6555b37ee9e8e4664b10cba4b7416b78ed9accbc4f67a62e795046540ef2a"} Jul 09 01:39:06.973936 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:06.973920 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s7zrq" event={"ID":"c975edec-2157-4f50-85fc-102b756da42b","Type":"ContainerStarted","Data":"029e0041158ee6ee94fa358b48abb7903377773fa3f6183d628453899172c3c1"} Jul 09 01:39:06.991694 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:06.991632 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s7zrq" podStartSLOduration=66.841342603 podStartE2EDuration="1m7.991611673s" totalImagesPullingTime="1.15026907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:06.991003734 +0000 UTC m=+67.964476356" watchObservedRunningTime="2026-07-09 01:39:06.991611673 +0000 UTC m=+67.965084295" Jul 09 01:39:07.015934 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:07.015899 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4v722\"" Jul 09 01:39:07.023838 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:07.023807 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tj77z" Jul 09 01:39:07.112525 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:07.112482 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:07.171115 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:07.171081 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:07.193214 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:07.193181 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tj77z"] Jul 09 01:39:07.196646 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:39:07.196615 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f07e0cc_3728_49de_911f_d96e7bcb9693.slice/crio-6410ced3228fa42cfbf04ba2310de331402b7244de908c497637201dea8b6fc4 WatchSource:0}: Error finding container 6410ced3228fa42cfbf04ba2310de331402b7244de908c497637201dea8b6fc4: Status 404 returned error can't find the container with id 6410ced3228fa42cfbf04ba2310de331402b7244de908c497637201dea8b6fc4 Jul 09 01:39:07.981922 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:07.981878 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tj77z" event={"ID":"4f07e0cc-3728-49de-911f-d96e7bcb9693","Type":"ContainerStarted","Data":"6410ced3228fa42cfbf04ba2310de331402b7244de908c497637201dea8b6fc4"} Jul 09 01:39:08.372477 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:08.372390 2565 patch_prober.go:28] interesting pod/image-registry-5f675c8796-bnx5s container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 01:39:08.372477 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:08.372460 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" podUID="78fbeff9-0a44-4007-85e3-c7912d8e1b9b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 01:39:10.462314 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:10.462250 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:10.521184 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:10.521129 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:10.940632 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:10.940595 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:10.995947 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:10.995908 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9pjtm" event={"ID":"53c92713-90e9-4d9d-b5c6-f0f15a33fc82","Type":"ContainerStarted","Data":"62ed1c060e78de83b00c97924a98285c8ebda207a17748496e035ef46a6f3c75"} Jul 09 01:39:10.996167 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:10.996083 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:39:10.997727 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:10.997697 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nd79x" event={"ID":"5982d2fd-d322-47cf-a233-c41afb3ff1fd","Type":"ContainerStarted","Data":"13c048a6bcc1c673840c1105594f9939fd5cf3948827c7b02eee35beb2bbd1d5"} Jul 09 01:39:11.010970 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:11.010912 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9pjtm" podStartSLOduration=66.790907038 podStartE2EDuration="1m12.010894163s" totalImagesPullingTime="5.219987125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:11.009628212 +0000 UTC m=+71.983100834" watchObservedRunningTime="2026-07-09 01:39:11.010894163 +0000 UTC m=+71.984366785" Jul 09 01:39:11.021538 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:11.021505 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:11.024414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:11.024365 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nd79x" podStartSLOduration=66.81178706 podStartE2EDuration="1m12.024347743s" totalImagesPullingTime="5.212560683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:11.023906184 +0000 UTC m=+71.997378806" watchObservedRunningTime="2026-07-09 01:39:11.024347743 +0000 UTC m=+71.997820365" Jul 09 01:39:11.588863 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:11.588818 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:11.742329 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:11.742292 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:11.794171 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:11.794117 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:13.697123 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:13.697091 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:13.916059 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:13.916014 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:13.955994 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:13.955910 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kkv4w"] Jul 09 01:39:13.958885 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:13.958860 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:13.961697 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:13.961607 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 01:39:13.961697 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:13.961626 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 01:39:13.961869 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:13.961828 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 01:39:13.962607 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:13.962582 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mb84g\"" Jul 09 01:39:13.962709 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:13.962618 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 01:39:13.962709 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:13.962646 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 01:39:13.962709 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:13.962663 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 01:39:14.005707 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.005676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:14.067740 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.067704 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-accelerators-collector-config\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.067740 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.067750 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgvdt\" (UniqueName: \"kubernetes.io/projected/607b83e6-1b31-4565-8f25-5ae4b8b5369e-kube-api-access-tgvdt\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.068004 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.067784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-tls\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.068004 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.067812 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-textfile\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.068004 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.067848 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/607b83e6-1b31-4565-8f25-5ae4b8b5369e-metrics-client-ca\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.068004 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.067873 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/607b83e6-1b31-4565-8f25-5ae4b8b5369e-sys\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.068004 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.067917 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/607b83e6-1b31-4565-8f25-5ae4b8b5369e-root\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.068004 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.067943 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-wtmp\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.068004 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.067985 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.069413 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.069373 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:14.169121 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169091 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-accelerators-collector-config\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.169297 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgvdt\" (UniqueName: \"kubernetes.io/projected/607b83e6-1b31-4565-8f25-5ae4b8b5369e-kube-api-access-tgvdt\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.169297 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-tls\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.169297 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-textfile\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.169522 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169306 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/607b83e6-1b31-4565-8f25-5ae4b8b5369e-metrics-client-ca\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.169522 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169335 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/607b83e6-1b31-4565-8f25-5ae4b8b5369e-sys\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.169522 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/607b83e6-1b31-4565-8f25-5ae4b8b5369e-root\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.169522 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-wtmp\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.169522 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169473 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.169753 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169571 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-textfile\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.169753 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169648 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/607b83e6-1b31-4565-8f25-5ae4b8b5369e-sys\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.169892 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169753 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-accelerators-collector-config\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.169892 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169812 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/607b83e6-1b31-4565-8f25-5ae4b8b5369e-root\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.169990 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.169924 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-wtmp\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.170121 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.170088 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/607b83e6-1b31-4565-8f25-5ae4b8b5369e-metrics-client-ca\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.170419 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.170371 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:14.172718 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.172698 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-tls\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.172820 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.172788 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/607b83e6-1b31-4565-8f25-5ae4b8b5369e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.177034 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.177013 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgvdt\" (UniqueName: \"kubernetes.io/projected/607b83e6-1b31-4565-8f25-5ae4b8b5369e-kube-api-access-tgvdt\") pod \"node-exporter-kkv4w\" (UID: \"607b83e6-1b31-4565-8f25-5ae4b8b5369e\") " pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.271661 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.271621 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kkv4w" Jul 09 01:39:14.272575 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.272544 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:14.283241 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:39:14.283211 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607b83e6_1b31_4565_8f25_5ae4b8b5369e.slice/crio-89cb81cf9ea1e01af1fc102e08c723f9ac7f74adc238a9bdba496ff556886c82 WatchSource:0}: Error finding container 89cb81cf9ea1e01af1fc102e08c723f9ac7f74adc238a9bdba496ff556886c82: Status 404 returned error can't find the container with id 89cb81cf9ea1e01af1fc102e08c723f9ac7f74adc238a9bdba496ff556886c82 Jul 09 01:39:14.371649 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.371610 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:14.446178 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.446125 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:14.560573 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.560543 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:14.930189 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:14.930098 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:15.005030 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:15.004992 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:15.015007 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:15.014971 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tj77z" event={"ID":"4f07e0cc-3728-49de-911f-d96e7bcb9693","Type":"ContainerStarted","Data":"c0c68e5b29fb1a9fc612ab639a4244217a8fa705e3341d253678ed268ff38696"} Jul 09 01:39:15.015198 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:15.015042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tj77z" event={"ID":"4f07e0cc-3728-49de-911f-d96e7bcb9693","Type":"ContainerStarted","Data":"13e2fcf24dc737726555e072480b170bb88a7df0407524a8bc43786161dfe983"} Jul 09 01:39:15.016488 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:15.016454 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkv4w" event={"ID":"607b83e6-1b31-4565-8f25-5ae4b8b5369e","Type":"ContainerStarted","Data":"89cb81cf9ea1e01af1fc102e08c723f9ac7f74adc238a9bdba496ff556886c82"} Jul 09 01:39:15.231341 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:15.231310 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:16.022186 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:16.022127 2565 generic.go:356] "Generic (PLEG): container finished" podID="607b83e6-1b31-4565-8f25-5ae4b8b5369e" containerID="290adcd4e6d4f593c69f625ecd09c779a59357d3d2ab25b963c574363c4d1aca" exitCode=0 Jul 09 01:39:16.022680 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:16.022243 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkv4w" event={"ID":"607b83e6-1b31-4565-8f25-5ae4b8b5369e","Type":"ContainerDied","Data":"290adcd4e6d4f593c69f625ecd09c779a59357d3d2ab25b963c574363c4d1aca"} Jul 09 01:39:16.877962 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:16.877919 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:16.951112 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:16.951041 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:17.030219 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:17.030182 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkv4w" event={"ID":"607b83e6-1b31-4565-8f25-5ae4b8b5369e","Type":"ContainerStarted","Data":"e03fd6ad954905f5b5e9defe42c9dc3d8d5727d933e06ea125db32742938e388"} Jul 09 01:39:17.149365 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:17.149290 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:17.414122 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:17.414041 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:17.472184 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:17.472107 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:18.037814 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:18.037769 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkv4w" event={"ID":"607b83e6-1b31-4565-8f25-5ae4b8b5369e","Type":"ContainerStarted","Data":"a503219b2227ffee51491dc1cd1e928adf0a9f811c3b5f3d5dde1e884543cab5"} Jul 09 01:39:18.039687 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:18.039662 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tj77z" event={"ID":"4f07e0cc-3728-49de-911f-d96e7bcb9693","Type":"ContainerStarted","Data":"80b9f3c03640e8baddfd65ac2fbd8c48d8b39010bd77101ab40905d83109bc28"} Jul 09 01:39:18.056758 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:18.056710 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kkv4w" podStartSLOduration=3.757773332 podStartE2EDuration="5.056694612s" totalImagesPullingTime="1.219539398s" totalInitContainerRuntime="79.381882ms" isStatefulPod=true podCreationTimestamp="2026-07-09 01:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:18.055100854 +0000 UTC m=+79.028573511" watchObservedRunningTime="2026-07-09 01:39:18.056694612 +0000 UTC m=+79.030167233" Jul 09 01:39:18.074177 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:18.074104 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tj77z" podStartSLOduration=34.231082354 podStartE2EDuration="44.074086883s" totalImagesPullingTime="9.843004529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:18.073174846 +0000 UTC m=+79.046647469" watchObservedRunningTime="2026-07-09 01:39:18.074086883 +0000 UTC m=+79.047559503" Jul 09 01:39:18.369711 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:18.369642 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:39:18.723047 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:18.722962 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:18.786043 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:18.786008 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:18.960540 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:18.960510 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:19.652120 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:19.652082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:19.704041 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:19.704005 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:20.136832 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:20.136793 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:20.385481 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:20.385440 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:20.438665 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:20.438583 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:21.924132 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:21.924101 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-dd879d8c8-k9255" Jul 09 01:39:22.038643 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:22.038612 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:22.139440 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:22.139404 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:23.385028 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.384984 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" podUID="78fbeff9-0a44-4007-85e3-c7912d8e1b9b" containerName="registry" containerID="cri-o://db60e67391e50fa547997e959813a450b39f4592cac14f608c09f6bcfdad66f3" gracePeriod=30 Jul 09 01:39:23.463825 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.463796 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:23.564978 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.564947 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:23.619604 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.619583 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:39:23.743522 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.743488 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-image-registry-private-configuration\") pod \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " Jul 09 01:39:23.743685 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.743536 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-certificates\") pod \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " Jul 09 01:39:23.743685 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.743569 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-ca-trust-extracted\") pod \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " Jul 09 01:39:23.743685 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.743598 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szcc9\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-kube-api-access-szcc9\") pod \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " Jul 09 01:39:23.743685 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.743632 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-installation-pull-secrets\") pod \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " Jul 09 01:39:23.743685 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.743661 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-trusted-ca\") pod \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " Jul 09 01:39:23.743921 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.743705 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls\") pod \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " Jul 09 01:39:23.743921 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.743760 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-bound-sa-token\") pod \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\" (UID: \"78fbeff9-0a44-4007-85e3-c7912d8e1b9b\") " Jul 09 01:39:23.744634 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.744361 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "78fbeff9-0a44-4007-85e3-c7912d8e1b9b" (UID: "78fbeff9-0a44-4007-85e3-c7912d8e1b9b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:39:23.746300 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.745387 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "78fbeff9-0a44-4007-85e3-c7912d8e1b9b" (UID: "78fbeff9-0a44-4007-85e3-c7912d8e1b9b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:39:23.748179 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.747052 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "78fbeff9-0a44-4007-85e3-c7912d8e1b9b" (UID: "78fbeff9-0a44-4007-85e3-c7912d8e1b9b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 01:39:23.748179 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.747679 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "78fbeff9-0a44-4007-85e3-c7912d8e1b9b" (UID: "78fbeff9-0a44-4007-85e3-c7912d8e1b9b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 01:39:23.748332 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.748172 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "78fbeff9-0a44-4007-85e3-c7912d8e1b9b" (UID: "78fbeff9-0a44-4007-85e3-c7912d8e1b9b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:39:23.748440 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.748350 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-kube-api-access-szcc9" (OuterVolumeSpecName: "kube-api-access-szcc9") pod "78fbeff9-0a44-4007-85e3-c7912d8e1b9b" (UID: "78fbeff9-0a44-4007-85e3-c7912d8e1b9b"). InnerVolumeSpecName "kube-api-access-szcc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:39:23.750628 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.750596 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "78fbeff9-0a44-4007-85e3-c7912d8e1b9b" (UID: "78fbeff9-0a44-4007-85e3-c7912d8e1b9b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:39:23.754853 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.754827 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "78fbeff9-0a44-4007-85e3-c7912d8e1b9b" (UID: "78fbeff9-0a44-4007-85e3-c7912d8e1b9b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:39:23.845970 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.845920 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-bound-sa-token\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 01:39:23.845970 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.845965 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-image-registry-private-configuration\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 01:39:23.845970 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.845976 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-certificates\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 01:39:23.846203 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.845987 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-ca-trust-extracted\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 01:39:23.846203 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.845996 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szcc9\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-kube-api-access-szcc9\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 01:39:23.846203 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.846004 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-installation-pull-secrets\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 01:39:23.846203 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.846012 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-trusted-ca\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 01:39:23.846203 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:23.846020 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/78fbeff9-0a44-4007-85e3-c7912d8e1b9b-registry-tls\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 01:39:24.062948 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:24.062864 2565 generic.go:356] "Generic (PLEG): container finished" podID="78fbeff9-0a44-4007-85e3-c7912d8e1b9b" containerID="db60e67391e50fa547997e959813a450b39f4592cac14f608c09f6bcfdad66f3" exitCode=0 Jul 09 01:39:24.062948 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:24.062925 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" event={"ID":"78fbeff9-0a44-4007-85e3-c7912d8e1b9b","Type":"ContainerDied","Data":"db60e67391e50fa547997e959813a450b39f4592cac14f608c09f6bcfdad66f3"} Jul 09 01:39:24.063117 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:24.062986 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" event={"ID":"78fbeff9-0a44-4007-85e3-c7912d8e1b9b","Type":"ContainerDied","Data":"7b48f25be63af7d1299815633320d56aa0d2f0c7758d71b84898b2272354c983"} Jul 09 01:39:24.063117 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:24.062925 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f675c8796-bnx5s" Jul 09 01:39:24.063117 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:24.063018 2565 scope.go:117] "RemoveContainer" containerID="db60e67391e50fa547997e959813a450b39f4592cac14f608c09f6bcfdad66f3" Jul 09 01:39:24.071756 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:24.071736 2565 scope.go:117] "RemoveContainer" containerID="db60e67391e50fa547997e959813a450b39f4592cac14f608c09f6bcfdad66f3" Jul 09 01:39:24.072008 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:39:24.071987 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db60e67391e50fa547997e959813a450b39f4592cac14f608c09f6bcfdad66f3\": container with ID starting with db60e67391e50fa547997e959813a450b39f4592cac14f608c09f6bcfdad66f3 not found: ID does not exist" containerID="db60e67391e50fa547997e959813a450b39f4592cac14f608c09f6bcfdad66f3" Jul 09 01:39:24.072075 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:24.072021 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db60e67391e50fa547997e959813a450b39f4592cac14f608c09f6bcfdad66f3"} err="failed to get container status \"db60e67391e50fa547997e959813a450b39f4592cac14f608c09f6bcfdad66f3\": rpc error: code = NotFound desc = could not find container \"db60e67391e50fa547997e959813a450b39f4592cac14f608c09f6bcfdad66f3\": container with ID starting with db60e67391e50fa547997e959813a450b39f4592cac14f608c09f6bcfdad66f3 not found: ID does not exist" Jul 09 01:39:24.082593 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:24.082570 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f675c8796-bnx5s"] Jul 09 01:39:24.088629 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:24.088610 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f675c8796-bnx5s"] Jul 09 01:39:24.426201 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:24.426086 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:24.481016 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:24.480982 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:25.446339 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:25.446300 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:25.521033 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:25.521000 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:25.562982 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:25.562949 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78fbeff9-0a44-4007-85e3-c7912d8e1b9b" path="/var/lib/kubelet/pods/78fbeff9-0a44-4007-85e3-c7912d8e1b9b/volumes" Jul 09 01:39:25.669368 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:25.669337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:26.745774 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:26.745743 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:26.846310 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:26.846280 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:27.169658 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:27.169577 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:27.271982 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:27.271948 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:29.568023 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:29.567992 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:29.671699 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:29.671666 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:30.259315 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:30.259283 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:32.065088 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:32.065055 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:32.119045 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:32.119006 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:32.641194 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:32.641134 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:32.738065 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:32.738015 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:32.842051 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:32.842019 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:33.572723 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:33.572690 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:33.673622 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:33.673589 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:40.750605 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:40.750574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:40.846731 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:40.846696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:40.905949 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:40.905915 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:41.744099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:41.744066 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:41.795564 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:41.795526 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:42.003346 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:42.003267 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9pjtm" Jul 09 01:39:54.403390 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:54.403351 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:56.830745 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:56.830705 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:39:56.891098 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:39:56.891066 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:40:00.001593 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:40:00.001552 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:40:00.058938 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:40:00.058907 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:40:01.052888 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:40:01.052849 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:40:01.154135 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:40:01.154100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:40:11.771425 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:40:11.771380 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:40:11.872722 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:40:11.872683 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:40:11.973130 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:40:11.973096 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:40:26.753005 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:40:26.752971 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:40:26.854329 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:40:26.854297 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:40:57.166894 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:40:57.166816 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:40:57.270329 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:40:57.270301 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:23.840754 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:23.840721 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:24.652771 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:24.652741 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:27.694117 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:27.694082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:27.795778 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:27.795736 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:28.865298 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:28.865259 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:28.932339 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:28.932306 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:29.409573 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:29.409544 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:29.530488 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:29.530451 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:30.877435 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:30.877400 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:31.275393 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:31.275361 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:34.439694 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:34.439637 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:34.494945 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:34.494910 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:39.478171 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:39.478115 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:41.453803 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:41.453764 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:41.524942 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:41.524908 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:44.643653 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:44.643620 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:44.742108 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:44.742077 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:47.699635 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:47.699598 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:47.768860 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:47.768828 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:50.694731 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:50.694694 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:50.795694 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:50.795663 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:41:52.701939 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:41:52.701909 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:09.003936 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.003899 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:09.060971 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.060940 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn"] Jul 09 01:42:09.061234 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.061221 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78fbeff9-0a44-4007-85e3-c7912d8e1b9b" containerName="registry" Jul 09 01:42:09.061290 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.061236 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="78fbeff9-0a44-4007-85e3-c7912d8e1b9b" containerName="registry" Jul 09 01:42:09.061290 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.061285 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="78fbeff9-0a44-4007-85e3-c7912d8e1b9b" containerName="registry" Jul 09 01:42:09.063021 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.063005 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.066653 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.066622 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 01:42:09.066820 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.066661 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wbqgm\"" Jul 09 01:42:09.066820 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.066672 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 01:42:09.066820 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.066676 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 01:42:09.066820 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.066724 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 01:42:09.066999 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.066986 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 01:42:09.073506 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.073486 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn"] Jul 09 01:42:09.101033 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.100998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:09.128252 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.128212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9b0569b-9cb4-46bb-9252-bbbab6073536-cert\") pod \"lws-controller-manager-6489dc67d-ghjvn\" (UID: \"e9b0569b-9cb4-46bb-9252-bbbab6073536\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.128410 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.128269 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n92sf\" (UniqueName: \"kubernetes.io/projected/e9b0569b-9cb4-46bb-9252-bbbab6073536-kube-api-access-n92sf\") pod \"lws-controller-manager-6489dc67d-ghjvn\" (UID: \"e9b0569b-9cb4-46bb-9252-bbbab6073536\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.128410 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.128298 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9b0569b-9cb4-46bb-9252-bbbab6073536-manager-config\") pod \"lws-controller-manager-6489dc67d-ghjvn\" (UID: \"e9b0569b-9cb4-46bb-9252-bbbab6073536\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.128410 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.128333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9b0569b-9cb4-46bb-9252-bbbab6073536-metrics-cert\") pod \"lws-controller-manager-6489dc67d-ghjvn\" (UID: \"e9b0569b-9cb4-46bb-9252-bbbab6073536\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.229507 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.229472 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9b0569b-9cb4-46bb-9252-bbbab6073536-metrics-cert\") pod \"lws-controller-manager-6489dc67d-ghjvn\" (UID: \"e9b0569b-9cb4-46bb-9252-bbbab6073536\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.229670 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.229532 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9b0569b-9cb4-46bb-9252-bbbab6073536-cert\") pod \"lws-controller-manager-6489dc67d-ghjvn\" (UID: \"e9b0569b-9cb4-46bb-9252-bbbab6073536\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.229670 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.229570 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n92sf\" (UniqueName: \"kubernetes.io/projected/e9b0569b-9cb4-46bb-9252-bbbab6073536-kube-api-access-n92sf\") pod \"lws-controller-manager-6489dc67d-ghjvn\" (UID: \"e9b0569b-9cb4-46bb-9252-bbbab6073536\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.229670 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.229588 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9b0569b-9cb4-46bb-9252-bbbab6073536-manager-config\") pod \"lws-controller-manager-6489dc67d-ghjvn\" (UID: \"e9b0569b-9cb4-46bb-9252-bbbab6073536\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.230316 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.230293 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9b0569b-9cb4-46bb-9252-bbbab6073536-manager-config\") pod \"lws-controller-manager-6489dc67d-ghjvn\" (UID: \"e9b0569b-9cb4-46bb-9252-bbbab6073536\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.231991 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.231972 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9b0569b-9cb4-46bb-9252-bbbab6073536-metrics-cert\") pod \"lws-controller-manager-6489dc67d-ghjvn\" (UID: \"e9b0569b-9cb4-46bb-9252-bbbab6073536\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.232064 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.232003 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9b0569b-9cb4-46bb-9252-bbbab6073536-cert\") pod \"lws-controller-manager-6489dc67d-ghjvn\" (UID: \"e9b0569b-9cb4-46bb-9252-bbbab6073536\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.238546 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.238523 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n92sf\" (UniqueName: \"kubernetes.io/projected/e9b0569b-9cb4-46bb-9252-bbbab6073536-kube-api-access-n92sf\") pod \"lws-controller-manager-6489dc67d-ghjvn\" (UID: \"e9b0569b-9cb4-46bb-9252-bbbab6073536\") " pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.373029 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.372938 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:09.478400 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.478371 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:09.513664 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.513634 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn"] Jul 09 01:42:09.517000 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:42:09.516972 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b0569b_9cb4_46bb_9252_bbbab6073536.slice/crio-dc7ea8c9875d103f3263a3bff055aef17ca7727ed84018a5b7d2612e18b52823 WatchSource:0}: Error finding container dc7ea8c9875d103f3263a3bff055aef17ca7727ed84018a5b7d2612e18b52823: Status 404 returned error can't find the container with id dc7ea8c9875d103f3263a3bff055aef17ca7727ed84018a5b7d2612e18b52823 Jul 09 01:42:09.575443 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.575409 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:09.604275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:09.604239 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" event={"ID":"e9b0569b-9cb4-46bb-9252-bbbab6073536","Type":"ContainerStarted","Data":"dc7ea8c9875d103f3263a3bff055aef17ca7727ed84018a5b7d2612e18b52823"} Jul 09 01:42:10.062694 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.062640 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:10.353241 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.353096 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:10.453863 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.453805 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:10.496934 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.496657 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq"] Jul 09 01:42:10.499281 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.499255 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.507767 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.507473 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 01:42:10.507912 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.507885 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 01:42:10.507977 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.507922 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 01:42:10.508039 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.507922 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jb862\"" Jul 09 01:42:10.508881 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.508517 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 01:42:10.521253 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.521218 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq"] Jul 09 01:42:10.541054 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.541008 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bs44\" (UniqueName: \"kubernetes.io/projected/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-kube-api-access-5bs44\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.541223 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.541061 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-manifests\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.541223 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.541089 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-tmp\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.541411 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.541212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.541411 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.541257 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.641823 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.641731 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bs44\" (UniqueName: \"kubernetes.io/projected/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-kube-api-access-5bs44\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.641823 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.641779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-manifests\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.642051 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.641968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-tmp\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.642109 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.642070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.642183 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.642110 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.642303 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.642267 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-manifests\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.644256 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.644228 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-tmp\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.644465 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.644445 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.644520 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.644500 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.650460 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.650412 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bs44\" (UniqueName: \"kubernetes.io/projected/93be9941-f0d5-4c7a-a3a4-f1dd819cf63b-kube-api-access-5bs44\") pod \"opendatahub-operator-controller-manager-b4b98c894-4wgwq\" (UID: \"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.656711 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.656675 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:10.772825 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.772790 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:10.812869 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.812781 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:10.874095 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.873374 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:10.933263 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.933234 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:10.966547 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.966516 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq"] Jul 09 01:42:10.999268 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:10.999237 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:11.100420 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:11.100373 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:11.205260 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:11.205183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:11.300373 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:11.300342 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:11.828660 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:42:11.828608 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93be9941_f0d5_4c7a_a3a4_f1dd819cf63b.slice/crio-df3d207c0b246bb837d86e63d2b5dd9f4f5ce4b37a7816c09e5c355a95773d34 WatchSource:0}: Error finding container df3d207c0b246bb837d86e63d2b5dd9f4f5ce4b37a7816c09e5c355a95773d34: Status 404 returned error can't find the container with id df3d207c0b246bb837d86e63d2b5dd9f4f5ce4b37a7816c09e5c355a95773d34 Jul 09 01:42:12.617451 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:12.617411 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" event={"ID":"e9b0569b-9cb4-46bb-9252-bbbab6073536","Type":"ContainerStarted","Data":"a584a260463655a92a5652d05ae51ba599f6678b01cb9a734377d2741b545a5e"} Jul 09 01:42:12.617911 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:12.617810 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:12.619654 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:12.619619 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" event={"ID":"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b","Type":"ContainerStarted","Data":"df3d207c0b246bb837d86e63d2b5dd9f4f5ce4b37a7816c09e5c355a95773d34"} Jul 09 01:42:12.637723 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:12.637607 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" podStartSLOduration=1.288156248 podStartE2EDuration="3.637585027s" totalImagesPullingTime="2.349428779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:12.635721698 +0000 UTC m=+253.609194322" watchObservedRunningTime="2026-07-09 01:42:12.637585027 +0000 UTC m=+253.611057649" Jul 09 01:42:13.888956 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:13.888925 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:13.991473 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:13.991437 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:14.628282 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:14.628251 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" event={"ID":"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b","Type":"ContainerStarted","Data":"16dac1b7ede4d56312b10a59d4af5345de27c2a8e0768352f49076730133149b"} Jul 09 01:42:16.637733 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:16.637700 2565 generic.go:356] "Generic (PLEG): container finished" podID="93be9941-f0d5-4c7a-a3a4-f1dd819cf63b" containerID="16dac1b7ede4d56312b10a59d4af5345de27c2a8e0768352f49076730133149b" exitCode=0 Jul 09 01:42:16.638108 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:16.637776 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" event={"ID":"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b","Type":"ContainerDied","Data":"16dac1b7ede4d56312b10a59d4af5345de27c2a8e0768352f49076730133149b"} Jul 09 01:42:17.642796 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:17.642765 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" event={"ID":"93be9941-f0d5-4c7a-a3a4-f1dd819cf63b","Type":"ContainerStarted","Data":"1aa89b5f4b156c630fa5be215b45ee06e66955f6dd19dcbb65b3332dfb2ec6cb"} Jul 09 01:42:17.643196 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:17.642978 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:17.663077 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:17.662795 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" podStartSLOduration=3.457922598 podStartE2EDuration="7.662777985s" totalImagesPullingTime="3.117712134s" totalInitContainerRuntime="1.087143253s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:17.661582045 +0000 UTC m=+258.635054667" watchObservedRunningTime="2026-07-09 01:42:17.662777985 +0000 UTC m=+258.636250664" Jul 09 01:42:22.460924 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:22.460832 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:22.561151 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:22.561116 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:23.626273 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:23.626241 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6489dc67d-ghjvn" Jul 09 01:42:28.648649 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:28.648621 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-4wgwq" Jul 09 01:42:30.245755 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:30.245726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:30.347398 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:30.347361 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:30.611065 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:30.610962 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:30.985179 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:30.985118 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:31.098882 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:31.098843 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:31.200909 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:31.200877 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:31.300188 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:31.300089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:31.492113 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:31.492080 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:31.918502 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:31.918469 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:32.031623 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:32.031581 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:32.280156 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:32.280095 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:32.348593 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:32.348558 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:33.251634 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:33.251605 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:36.680312 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:36.680230 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:36.730595 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:36.730565 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:38.105503 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.105472 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:38.251023 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.250987 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:38.845310 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.845281 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc"] Jul 09 01:42:38.854087 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.854064 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:38.856675 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.856654 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 01:42:38.856798 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.856694 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 01:42:38.856940 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.856922 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8pbjd\"" Jul 09 01:42:38.857005 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.856928 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 01:42:38.868066 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.868037 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:38.868326 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.868303 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc"] Jul 09 01:42:38.964461 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.964417 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:38.964461 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.964466 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:38.964686 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.964549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:38.964686 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.964588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:38.964686 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.964612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:38.964686 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.964639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:38.964686 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.964664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:38.964840 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.964702 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:38.964840 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.964723 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj9zw\" (UniqueName: \"kubernetes.io/projected/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-kube-api-access-sj9zw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:38.970418 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:38.970384 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:39.065928 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.065892 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.065928 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.065931 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj9zw\" (UniqueName: \"kubernetes.io/projected/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-kube-api-access-sj9zw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.066266 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.066070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.066266 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.066133 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.066266 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.066235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.066266 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.066265 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.066465 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.066295 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.066465 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.066324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.066465 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.066361 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.066614 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.066534 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.066671 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.066641 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.066727 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.066694 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.066781 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.066738 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.067166 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.067118 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.068574 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.068540 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.068735 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.068719 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.076166 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.076125 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.076361 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.076343 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj9zw\" (UniqueName: \"kubernetes.io/projected/6d6e7a59-f5f9-435b-911b-0cd22c3d9424-kube-api-access-sj9zw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42s2tc\" (UID: \"6d6e7a59-f5f9-435b-911b-0cd22c3d9424\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.076573 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.076558 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:39.164727 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.164625 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:39.316008 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.315955 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc"] Jul 09 01:42:39.318089 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:42:39.318056 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6e7a59_f5f9_435b_911b_0cd22c3d9424.slice/crio-ea620347d78e7f488cd796dcb7eb865c12780779b35a6d5da510206b630ffa59 WatchSource:0}: Error finding container ea620347d78e7f488cd796dcb7eb865c12780779b35a6d5da510206b630ffa59: Status 404 returned error can't find the container with id ea620347d78e7f488cd796dcb7eb865c12780779b35a6d5da510206b630ffa59 Jul 09 01:42:39.719281 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:39.719247 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" event={"ID":"6d6e7a59-f5f9-435b-911b-0cd22c3d9424","Type":"ContainerStarted","Data":"ea620347d78e7f488cd796dcb7eb865c12780779b35a6d5da510206b630ffa59"} Jul 09 01:42:42.304407 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.304329 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:42.373252 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.373215 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc"] Jul 09 01:42:42.378884 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.378520 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc" Jul 09 01:42:42.379999 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.379972 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp"] Jul 09 01:42:42.382963 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.382938 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-c5hm9\"" Jul 09 01:42:42.383409 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.383389 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 01:42:42.384246 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.384228 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" Jul 09 01:42:42.386329 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.386309 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-x2tbk\"" Jul 09 01:42:42.386879 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.386584 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 09 01:42:42.392075 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.392049 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc"] Jul 09 01:42:42.396636 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.396617 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp"] Jul 09 01:42:42.407777 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.407702 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:42.496381 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.496342 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4j5k\" (UniqueName: \"kubernetes.io/projected/1fa97358-a112-4926-80c9-94c7d839fdac-kube-api-access-t4j5k\") pod \"llmisvc-controller-manager-777c6bd7d5-5swkp\" (UID: \"1fa97358-a112-4926-80c9-94c7d839fdac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" Jul 09 01:42:42.496573 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.496426 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jbtr\" (UniqueName: \"kubernetes.io/projected/e3108506-1e77-4960-ac7c-3574868bc47f-kube-api-access-8jbtr\") pod \"kserve-controller-manager-d6f4b65b8-bxlzc\" (UID: \"e3108506-1e77-4960-ac7c-3574868bc47f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc" Jul 09 01:42:42.496573 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.496471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fa97358-a112-4926-80c9-94c7d839fdac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5swkp\" (UID: \"1fa97358-a112-4926-80c9-94c7d839fdac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" Jul 09 01:42:42.496698 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.496569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3108506-1e77-4960-ac7c-3574868bc47f-cert\") pod \"kserve-controller-manager-d6f4b65b8-bxlzc\" (UID: \"e3108506-1e77-4960-ac7c-3574868bc47f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc" Jul 09 01:42:42.597985 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.597899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jbtr\" (UniqueName: \"kubernetes.io/projected/e3108506-1e77-4960-ac7c-3574868bc47f-kube-api-access-8jbtr\") pod \"kserve-controller-manager-d6f4b65b8-bxlzc\" (UID: \"e3108506-1e77-4960-ac7c-3574868bc47f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc" Jul 09 01:42:42.597985 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.597955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fa97358-a112-4926-80c9-94c7d839fdac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5swkp\" (UID: \"1fa97358-a112-4926-80c9-94c7d839fdac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" Jul 09 01:42:42.598222 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.598002 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3108506-1e77-4960-ac7c-3574868bc47f-cert\") pod \"kserve-controller-manager-d6f4b65b8-bxlzc\" (UID: \"e3108506-1e77-4960-ac7c-3574868bc47f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc" Jul 09 01:42:42.598222 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.598048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4j5k\" (UniqueName: \"kubernetes.io/projected/1fa97358-a112-4926-80c9-94c7d839fdac-kube-api-access-t4j5k\") pod \"llmisvc-controller-manager-777c6bd7d5-5swkp\" (UID: \"1fa97358-a112-4926-80c9-94c7d839fdac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" Jul 09 01:42:42.598222 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:42:42.598162 2565 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 09 01:42:42.598342 ip-10-0-130-184 kubenswrapper[2565]: E0709 01:42:42.598246 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fa97358-a112-4926-80c9-94c7d839fdac-cert podName:1fa97358-a112-4926-80c9-94c7d839fdac nodeName:}" failed. No retries permitted until 2026-07-09 01:42:43.09822739 +0000 UTC m=+284.071700008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1fa97358-a112-4926-80c9-94c7d839fdac-cert") pod "llmisvc-controller-manager-777c6bd7d5-5swkp" (UID: "1fa97358-a112-4926-80c9-94c7d839fdac") : secret "llmisvc-webhook-server-cert" not found Jul 09 01:42:42.600758 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.600730 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:42.600881 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.600851 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3108506-1e77-4960-ac7c-3574868bc47f-cert\") pod \"kserve-controller-manager-d6f4b65b8-bxlzc\" (UID: \"e3108506-1e77-4960-ac7c-3574868bc47f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc" Jul 09 01:42:42.610782 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.610759 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jbtr\" (UniqueName: \"kubernetes.io/projected/e3108506-1e77-4960-ac7c-3574868bc47f-kube-api-access-8jbtr\") pod \"kserve-controller-manager-d6f4b65b8-bxlzc\" (UID: \"e3108506-1e77-4960-ac7c-3574868bc47f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc" Jul 09 01:42:42.613297 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.613274 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4j5k\" (UniqueName: \"kubernetes.io/projected/1fa97358-a112-4926-80c9-94c7d839fdac-kube-api-access-t4j5k\") pod \"llmisvc-controller-manager-777c6bd7d5-5swkp\" (UID: \"1fa97358-a112-4926-80c9-94c7d839fdac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" Jul 09 01:42:42.693399 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.693361 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc" Jul 09 01:42:42.701359 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:42.701329 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:43.100779 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.100742 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fa97358-a112-4926-80c9-94c7d839fdac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5swkp\" (UID: \"1fa97358-a112-4926-80c9-94c7d839fdac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" Jul 09 01:42:43.103480 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.103450 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fa97358-a112-4926-80c9-94c7d839fdac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5swkp\" (UID: \"1fa97358-a112-4926-80c9-94c7d839fdac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" Jul 09 01:42:43.303189 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.303150 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" Jul 09 01:42:43.356669 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.356622 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 01:42:43.356934 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.356733 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 01:42:43.356934 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.356777 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 01:42:43.445005 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.444681 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc"] Jul 09 01:42:43.448085 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:42:43.448044 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3108506_1e77_4960_ac7c_3574868bc47f.slice/crio-f9d5c8692e1b44748cbe63366a6b1812ed7451a9825d478482422a1398e6f7e3 WatchSource:0}: Error finding container f9d5c8692e1b44748cbe63366a6b1812ed7451a9825d478482422a1398e6f7e3: Status 404 returned error can't find the container with id f9d5c8692e1b44748cbe63366a6b1812ed7451a9825d478482422a1398e6f7e3 Jul 09 01:42:43.495063 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.495027 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp"] Jul 09 01:42:43.499605 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:42:43.499575 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1fa97358_a112_4926_80c9_94c7d839fdac.slice/crio-13dbbaeb99e23880261d5f8d0f502fa99436aac499bdea761297b85453b2fc9c WatchSource:0}: Error finding container 13dbbaeb99e23880261d5f8d0f502fa99436aac499bdea761297b85453b2fc9c: Status 404 returned error can't find the container with id 13dbbaeb99e23880261d5f8d0f502fa99436aac499bdea761297b85453b2fc9c Jul 09 01:42:43.597891 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.597861 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:43.686557 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.686481 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:42:43.739367 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.739333 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" event={"ID":"6d6e7a59-f5f9-435b-911b-0cd22c3d9424","Type":"ContainerStarted","Data":"430e450f7314007ccd04a358f573d491793962f8a3e86a000d587a52f6d9a49d"} Jul 09 01:42:43.740570 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.740531 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" event={"ID":"1fa97358-a112-4926-80c9-94c7d839fdac","Type":"ContainerStarted","Data":"13dbbaeb99e23880261d5f8d0f502fa99436aac499bdea761297b85453b2fc9c"} Jul 09 01:42:43.741643 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.741616 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc" event={"ID":"e3108506-1e77-4960-ac7c-3574868bc47f","Type":"ContainerStarted","Data":"f9d5c8692e1b44748cbe63366a6b1812ed7451a9825d478482422a1398e6f7e3"} Jul 09 01:42:43.763952 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:43.763900 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" podStartSLOduration=1.727796153 podStartE2EDuration="5.76388358s" totalImagesPullingTime="4.036087427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:43.762737879 +0000 UTC m=+284.736210499" watchObservedRunningTime="2026-07-09 01:42:43.76388358 +0000 UTC m=+284.737356200" Jul 09 01:42:44.165682 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:44.165646 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:44.171624 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:44.171592 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:44.748067 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:44.748020 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:44.749393 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:44.749369 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42s2tc" Jul 09 01:42:46.757454 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:46.757418 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc" event={"ID":"e3108506-1e77-4960-ac7c-3574868bc47f","Type":"ContainerStarted","Data":"160e5c7abc7a87e6e2861d8277513e558ca642e7a4bde40be9403bdba9bf2542"} Jul 09 01:42:46.777406 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:46.777352 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc" podStartSLOduration=1.56474764 podStartE2EDuration="4.777337142s" totalImagesPullingTime="3.212589502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:46.77571409 +0000 UTC m=+287.749186713" watchObservedRunningTime="2026-07-09 01:42:46.777337142 +0000 UTC m=+287.750809763" Jul 09 01:42:47.763287 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:47.763241 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" event={"ID":"1fa97358-a112-4926-80c9-94c7d839fdac","Type":"ContainerStarted","Data":"9807d40dda3b585ca78abf8d253c19e13e1f08de428879d9960b98b8b2d1007f"} Jul 09 01:42:47.763758 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:47.763527 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" Jul 09 01:42:47.763758 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:47.763569 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc" Jul 09 01:42:47.779444 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:47.779395 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" podStartSLOduration=2.615356838 podStartE2EDuration="5.779377367s" totalImagesPullingTime="3.164020529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:47.777950939 +0000 UTC m=+288.751423554" watchObservedRunningTime="2026-07-09 01:42:47.779377367 +0000 UTC m=+288.752849988" Jul 09 01:42:59.463738 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:59.463706 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 01:42:59.467984 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:59.467959 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 01:42:59.471821 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:42:59.471795 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 01:43:18.769862 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:43:18.769828 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5swkp" Jul 09 01:43:18.776003 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:43:18.772693 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bxlzc" Jul 09 01:43:31.712969 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:43:31.712931 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:43:32.931491 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:43:32.931414 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:01.224217 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:01.224119 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:04.462426 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:04.462382 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:05.073772 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:05.073739 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:09.091045 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:09.091008 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:09.269176 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:09.269121 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:09.424837 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:09.424760 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:09.533430 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:09.533394 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:12.463358 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:12.463316 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:12.649321 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:12.649288 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:15.256732 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:15.256704 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:16.625936 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:16.625903 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:16.726618 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:16.726580 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:18.613132 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.613092 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz"] Jul 09 01:44:18.615563 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.615541 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" Jul 09 01:44:18.617985 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.617952 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9s292\"" Jul 09 01:44:18.617985 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.617954 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 01:44:18.618130 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.618000 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 09 01:44:18.618130 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.618010 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 01:44:18.618626 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.618611 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 09 01:44:18.622987 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.622833 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz"] Jul 09 01:44:18.625538 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.625519 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:18.667027 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.666992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9ce999b4-5620-477f-96e6-67983d20593e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-64hzz\" (UID: \"9ce999b4-5620-477f-96e6-67983d20593e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" Jul 09 01:44:18.667027 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.667028 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ce999b4-5620-477f-96e6-67983d20593e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-64hzz\" (UID: \"9ce999b4-5620-477f-96e6-67983d20593e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" Jul 09 01:44:18.667262 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.667057 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw9q4\" (UniqueName: \"kubernetes.io/projected/9ce999b4-5620-477f-96e6-67983d20593e-kube-api-access-gw9q4\") pod \"kuadrant-console-plugin-66b5774985-64hzz\" (UID: \"9ce999b4-5620-477f-96e6-67983d20593e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" Jul 09 01:44:18.768504 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.768471 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9ce999b4-5620-477f-96e6-67983d20593e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-64hzz\" (UID: \"9ce999b4-5620-477f-96e6-67983d20593e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" Jul 09 01:44:18.768705 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.768511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ce999b4-5620-477f-96e6-67983d20593e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-64hzz\" (UID: \"9ce999b4-5620-477f-96e6-67983d20593e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" Jul 09 01:44:18.768705 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.768657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw9q4\" (UniqueName: \"kubernetes.io/projected/9ce999b4-5620-477f-96e6-67983d20593e-kube-api-access-gw9q4\") pod \"kuadrant-console-plugin-66b5774985-64hzz\" (UID: \"9ce999b4-5620-477f-96e6-67983d20593e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" Jul 09 01:44:18.769257 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.769229 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9ce999b4-5620-477f-96e6-67983d20593e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-64hzz\" (UID: \"9ce999b4-5620-477f-96e6-67983d20593e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" Jul 09 01:44:18.771120 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.771103 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ce999b4-5620-477f-96e6-67983d20593e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-64hzz\" (UID: \"9ce999b4-5620-477f-96e6-67983d20593e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" Jul 09 01:44:18.776382 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.776352 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw9q4\" (UniqueName: \"kubernetes.io/projected/9ce999b4-5620-477f-96e6-67983d20593e-kube-api-access-gw9q4\") pod \"kuadrant-console-plugin-66b5774985-64hzz\" (UID: \"9ce999b4-5620-477f-96e6-67983d20593e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" Jul 09 01:44:18.789985 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.789963 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:18.925499 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:18.925405 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" Jul 09 01:44:19.050715 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:19.050689 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz"] Jul 09 01:44:19.052979 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:44:19.052956 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ce999b4_5620_477f_96e6_67983d20593e.slice/crio-683d97d077a1345a0bcdc934130233ae1906bae9b1fe2011e6237813091f5d0a WatchSource:0}: Error finding container 683d97d077a1345a0bcdc934130233ae1906bae9b1fe2011e6237813091f5d0a: Status 404 returned error can't find the container with id 683d97d077a1345a0bcdc934130233ae1906bae9b1fe2011e6237813091f5d0a Jul 09 01:44:19.054785 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:19.054767 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 01:44:19.116671 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:19.116637 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" event={"ID":"9ce999b4-5620-477f-96e6-67983d20593e","Type":"ContainerStarted","Data":"683d97d077a1345a0bcdc934130233ae1906bae9b1fe2011e6237813091f5d0a"} Jul 09 01:44:19.831556 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:19.831518 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:19.893511 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:19.893477 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:28.702104 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:28.702067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:28.796005 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:28.795963 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:31.118669 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:31.118622 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:31.219746 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:31.219715 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:32.631156 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:32.631109 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:32.766414 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:32.766378 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:33.056275 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:33.056242 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:35.431103 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:35.431063 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:35.537729 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:35.537701 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:37.857486 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:37.857437 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:37.957488 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:37.957444 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:43.103067 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:43.103031 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:43.201965 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:43.201927 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:43.233432 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:43.233392 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" event={"ID":"9ce999b4-5620-477f-96e6-67983d20593e","Type":"ContainerStarted","Data":"1bae990a093f0409e4dbf49c0e8328027a91ebbdc3da2ee412945c683d4c0f4d"} Jul 09 01:44:43.249886 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:43.249835 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-64hzz" podStartSLOduration=1.579579383 podStartE2EDuration="25.24981638s" totalImagesPullingTime="23.670236997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:44:43.248906741 +0000 UTC m=+404.222379364" watchObservedRunningTime="2026-07-09 01:44:43.24981638 +0000 UTC m=+404.223289000" Jul 09 01:44:43.304806 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:43.304777 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:46.700359 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:46.700314 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:46.801320 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:46.801285 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:49.148887 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:49.148848 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:49.247815 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:49.247784 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:53.535084 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:53.535049 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:53.672618 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:53.672589 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:56.299629 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:56.299599 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:56.400056 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:56.400019 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:56.458386 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:56.458347 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:57.304280 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.304249 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c"] Jul 09 01:44:57.306479 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.306455 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.310242 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.310216 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cnp6b\"" Jul 09 01:44:57.326542 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.326517 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c"] Jul 09 01:44:57.350890 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.350858 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:57.402669 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.402625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.402860 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.402680 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.402860 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.402738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.402860 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.402766 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.402860 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.402787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.402860 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.402836 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.402860 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.402856 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.403183 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.402893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbddr\" (UniqueName: \"kubernetes.io/projected/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-kube-api-access-xbddr\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.403183 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.402948 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.503727 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.503689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.503727 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.503726 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.503963 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.503749 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.503963 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.503783 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.503963 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.503806 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.503963 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.503847 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbddr\" (UniqueName: \"kubernetes.io/projected/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-kube-api-access-xbddr\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.503963 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.503884 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.503963 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.503956 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.504311 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.503983 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.504311 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.504182 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.504311 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.504223 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.505068 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.504597 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.505068 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.504694 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.505068 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.504707 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.506628 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.506593 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.506711 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.506623 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.514463 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.514440 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.514578 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.514535 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbddr\" (UniqueName: \"kubernetes.io/projected/9c83a710-22c1-41ac-9ac7-79aabc1a11b8-kube-api-access-xbddr\") pod \"maas-default-gateway-openshift-default-56654dcf7-zxv5c\" (UID: \"9c83a710-22c1-41ac-9ac7-79aabc1a11b8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.543789 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.543749 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:44:57.617688 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.617606 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:57.746461 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.746427 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c"] Jul 09 01:44:57.749714 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:44:57.749686 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c83a710_22c1_41ac_9ac7_79aabc1a11b8.slice/crio-38d3bb20106e9ec1996268906a1908d5e7700243a354572a130df65952a837af WatchSource:0}: Error finding container 38d3bb20106e9ec1996268906a1908d5e7700243a354572a130df65952a837af: Status 404 returned error can't find the container with id 38d3bb20106e9ec1996268906a1908d5e7700243a354572a130df65952a837af Jul 09 01:44:57.751777 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.751741 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 01:44:57.751870 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.751827 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 01:44:57.751928 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:57.751874 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 01:44:58.300953 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:58.300912 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" event={"ID":"9c83a710-22c1-41ac-9ac7-79aabc1a11b8","Type":"ContainerStarted","Data":"1c1cc4ce3a7073be590a02e431083856a8e47ae3fda1e27143f43b9fe20ca2f1"} Jul 09 01:44:58.301124 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:58.300969 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" event={"ID":"9c83a710-22c1-41ac-9ac7-79aabc1a11b8","Type":"ContainerStarted","Data":"38d3bb20106e9ec1996268906a1908d5e7700243a354572a130df65952a837af"} Jul 09 01:44:58.319339 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:58.319282 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" podStartSLOduration=1.319267227 podStartE2EDuration="1.319267227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:44:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:44:58.317596337 +0000 UTC m=+419.291068957" watchObservedRunningTime="2026-07-09 01:44:58.319267227 +0000 UTC m=+419.292739848" Jul 09 01:44:58.617838 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:58.617758 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:58.622343 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:58.622319 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:59.305208 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:59.305175 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:44:59.306099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:44:59.306075 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:45:05.508320 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:05.508281 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:05.609420 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:05.609379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:07.955890 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:07.955852 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:08.056638 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:08.056604 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:12.223264 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.223232 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:12.325327 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.325289 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:12.424745 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.424686 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:12.630114 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.630075 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:45:12.720327 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.720292 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:45:12.720327 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.720329 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:45:12.720574 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.720437 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6swvj" Jul 09 01:45:12.722827 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.722807 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 01:45:12.814351 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.814311 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txtz4\" (UniqueName: \"kubernetes.io/projected/3585a98d-9332-453d-a248-fbc5c3db777c-kube-api-access-txtz4\") pod \"limitador-limitador-54d6d988d5-6swvj\" (UID: \"3585a98d-9332-453d-a248-fbc5c3db777c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6swvj" Jul 09 01:45:12.814529 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.814371 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3585a98d-9332-453d-a248-fbc5c3db777c-config-file\") pod \"limitador-limitador-54d6d988d5-6swvj\" (UID: \"3585a98d-9332-453d-a248-fbc5c3db777c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6swvj" Jul 09 01:45:12.915830 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.915742 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txtz4\" (UniqueName: \"kubernetes.io/projected/3585a98d-9332-453d-a248-fbc5c3db777c-kube-api-access-txtz4\") pod \"limitador-limitador-54d6d988d5-6swvj\" (UID: \"3585a98d-9332-453d-a248-fbc5c3db777c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6swvj" Jul 09 01:45:12.915830 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.915802 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3585a98d-9332-453d-a248-fbc5c3db777c-config-file\") pod \"limitador-limitador-54d6d988d5-6swvj\" (UID: \"3585a98d-9332-453d-a248-fbc5c3db777c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6swvj" Jul 09 01:45:12.916474 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.916454 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3585a98d-9332-453d-a248-fbc5c3db777c-config-file\") pod \"limitador-limitador-54d6d988d5-6swvj\" (UID: \"3585a98d-9332-453d-a248-fbc5c3db777c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6swvj" Jul 09 01:45:12.923572 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:12.923542 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txtz4\" (UniqueName: \"kubernetes.io/projected/3585a98d-9332-453d-a248-fbc5c3db777c-kube-api-access-txtz4\") pod \"limitador-limitador-54d6d988d5-6swvj\" (UID: \"3585a98d-9332-453d-a248-fbc5c3db777c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6swvj" Jul 09 01:45:13.030192 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:13.030159 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6swvj" Jul 09 01:45:13.051360 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:13.051329 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:13.141261 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:13.141192 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:13.173352 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:13.173323 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:45:13.176073 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:45:13.176044 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3585a98d_9332_453d_a248_fbc5c3db777c.slice/crio-0b15c314718cd80448e4244d1f87c2f889a6bbc3b3818565a16c7a4449640453 WatchSource:0}: Error finding container 0b15c314718cd80448e4244d1f87c2f889a6bbc3b3818565a16c7a4449640453: Status 404 returned error can't find the container with id 0b15c314718cd80448e4244d1f87c2f889a6bbc3b3818565a16c7a4449640453 Jul 09 01:45:13.359551 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:13.359516 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6swvj" event={"ID":"3585a98d-9332-453d-a248-fbc5c3db777c","Type":"ContainerStarted","Data":"0b15c314718cd80448e4244d1f87c2f889a6bbc3b3818565a16c7a4449640453"} Jul 09 01:45:16.375078 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:16.375041 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6swvj" event={"ID":"3585a98d-9332-453d-a248-fbc5c3db777c","Type":"ContainerStarted","Data":"22496db2b528c4e23b1736d45c381c24c60cc2bb064dbdb92f6cd6caedc72cee"} Jul 09 01:45:16.375540 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:16.375168 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6swvj" Jul 09 01:45:16.389370 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:16.389308 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-6swvj" podStartSLOduration=1.968796749 podStartE2EDuration="4.389288066s" totalImagesPullingTime="2.420491317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:45:16.389133569 +0000 UTC m=+437.362606236" watchObservedRunningTime="2026-07-09 01:45:16.389288066 +0000 UTC m=+437.362760688" Jul 09 01:45:27.380452 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:27.380422 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6swvj" Jul 09 01:45:30.789306 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:30.789275 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:30.890495 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:30.890463 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:31.300960 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:31.300926 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:43.704536 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:43.704502 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:43.949811 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:43.949781 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:49.782543 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:49.782506 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:49.847436 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:49.847401 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:49.904937 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:49.904902 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:52.562305 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:52.562269 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:52.650854 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:52.650818 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:55.630792 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:55.630758 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:45:55.733083 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:45:55.733050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:46:11.563930 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:11.563899 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:46:24.951998 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:24.951959 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:46:25.358251 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:25.358223 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:46:25.793891 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:25.793857 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:46:25.896976 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:25.896942 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:46:25.999322 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:25.999287 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:46:26.035525 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:26.035493 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:46:35.698570 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:35.698462 2565 generic.go:356] "Generic (PLEG): container finished" podID="9c83a710-22c1-41ac-9ac7-79aabc1a11b8" containerID="1c1cc4ce3a7073be590a02e431083856a8e47ae3fda1e27143f43b9fe20ca2f1" exitCode=0 Jul 09 01:46:35.698570 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:35.698534 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" event={"ID":"9c83a710-22c1-41ac-9ac7-79aabc1a11b8","Type":"ContainerDied","Data":"1c1cc4ce3a7073be590a02e431083856a8e47ae3fda1e27143f43b9fe20ca2f1"} Jul 09 01:46:35.699064 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:35.698914 2565 scope.go:117] "RemoveContainer" containerID="1c1cc4ce3a7073be590a02e431083856a8e47ae3fda1e27143f43b9fe20ca2f1" Jul 09 01:46:35.699856 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:35.699825 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 01:46:35.699931 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:35.699913 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 01:46:35.699979 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:35.699964 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 01:46:36.091836 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:36.091801 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:46:36.187292 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:36.187262 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:46:36.704053 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:36.704018 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" event={"ID":"9c83a710-22c1-41ac-9ac7-79aabc1a11b8","Type":"ContainerStarted","Data":"e4f7fe8ae6d6bea5e1c75ece7c6acf7daeda910caaa45e4ac1e6911cdf09796a"} Jul 09 01:46:37.618718 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:37.618625 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:46:37.619361 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:37.619330 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zxv5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 09 01:46:37.619563 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:37.619537 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" podUID="9c83a710-22c1-41ac-9ac7-79aabc1a11b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 09 01:46:38.618639 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:38.618599 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zxv5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 09 01:46:38.619262 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:38.619227 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" podUID="9c83a710-22c1-41ac-9ac7-79aabc1a11b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 09 01:46:39.618400 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:39.618359 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zxv5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 09 01:46:39.618689 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:39.618660 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" podUID="9c83a710-22c1-41ac-9ac7-79aabc1a11b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 09 01:46:40.618163 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:40.618097 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zxv5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 09 01:46:40.618379 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:40.618189 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" podUID="9c83a710-22c1-41ac-9ac7-79aabc1a11b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 09 01:46:41.622430 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:41.622400 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:46:41.622824 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:41.622776 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:46:41.623528 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:41.623509 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zxv5c" Jul 09 01:46:47.676923 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:47.676889 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:46:48.210326 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:48.210284 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:46:56.295342 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:56.295253 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:46:57.320339 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:46:57.320307 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:47:03.147910 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.147881 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc"] Jul 09 01:47:03.151308 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.151280 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.153679 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.153658 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 01:47:03.154519 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.154496 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 01:47:03.154743 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.154713 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wtkjc\"" Jul 09 01:47:03.154743 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.154732 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 01:47:03.163663 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.163634 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc"] Jul 09 01:47:03.181753 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.181724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:47:03.311766 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.311724 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe3e4380-d62b-42c3-a906-9aa385d2abfb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.311766 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.311769 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe3e4380-d62b-42c3-a906-9aa385d2abfb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.311983 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.311800 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe3e4380-d62b-42c3-a906-9aa385d2abfb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.311983 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.311836 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe3e4380-d62b-42c3-a906-9aa385d2abfb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.311983 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.311856 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kfcl\" (UniqueName: \"kubernetes.io/projected/fe3e4380-d62b-42c3-a906-9aa385d2abfb-kube-api-access-2kfcl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.311983 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.311908 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe3e4380-d62b-42c3-a906-9aa385d2abfb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.413376 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.413284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe3e4380-d62b-42c3-a906-9aa385d2abfb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.413376 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.413325 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe3e4380-d62b-42c3-a906-9aa385d2abfb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.413376 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.413347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kfcl\" (UniqueName: \"kubernetes.io/projected/fe3e4380-d62b-42c3-a906-9aa385d2abfb-kube-api-access-2kfcl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.413376 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.413380 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe3e4380-d62b-42c3-a906-9aa385d2abfb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.413690 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.413423 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe3e4380-d62b-42c3-a906-9aa385d2abfb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.413690 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.413459 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe3e4380-d62b-42c3-a906-9aa385d2abfb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.413787 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.413771 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe3e4380-d62b-42c3-a906-9aa385d2abfb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.413825 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.413787 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe3e4380-d62b-42c3-a906-9aa385d2abfb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.413879 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.413858 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe3e4380-d62b-42c3-a906-9aa385d2abfb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.415713 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.415688 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe3e4380-d62b-42c3-a906-9aa385d2abfb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.415851 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.415831 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe3e4380-d62b-42c3-a906-9aa385d2abfb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.421252 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.421226 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kfcl\" (UniqueName: \"kubernetes.io/projected/fe3e4380-d62b-42c3-a906-9aa385d2abfb-kube-api-access-2kfcl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lmvpc\" (UID: \"fe3e4380-d62b-42c3-a906-9aa385d2abfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.462192 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.462133 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:03.617317 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.617284 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc"] Jul 09 01:47:03.620684 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:47:03.620645 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3e4380_d62b_42c3_a906_9aa385d2abfb.slice/crio-b8594c625d839ee61e090829932aeadf140e550008fa3a1fc151ca1c75732c47 WatchSource:0}: Error finding container b8594c625d839ee61e090829932aeadf140e550008fa3a1fc151ca1c75732c47: Status 404 returned error can't find the container with id b8594c625d839ee61e090829932aeadf140e550008fa3a1fc151ca1c75732c47 Jul 09 01:47:03.820706 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:03.820672 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" event={"ID":"fe3e4380-d62b-42c3-a906-9aa385d2abfb","Type":"ContainerStarted","Data":"b8594c625d839ee61e090829932aeadf140e550008fa3a1fc151ca1c75732c47"} Jul 09 01:47:04.319080 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:04.319041 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:47:04.826515 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:04.826472 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" event={"ID":"fe3e4380-d62b-42c3-a906-9aa385d2abfb","Type":"ContainerStarted","Data":"8870b6d5852ad4f2b239525bcff56e46b84303dfe27395b10ea5f3070982d94d"} Jul 09 01:47:04.848621 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:04.848567 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" podStartSLOduration=0.863670449 podStartE2EDuration="1.848550743s" totalImagesPullingTime="984.880294ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:47:04.841920662 +0000 UTC m=+545.815393306" watchObservedRunningTime="2026-07-09 01:47:04.848550743 +0000 UTC m=+545.822023363" Jul 09 01:47:09.389994 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:09.389957 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:47:09.441892 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:09.441857 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:47:13.463030 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:13.462995 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:13.463471 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:13.463057 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:13.475424 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:13.475397 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:13.873736 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:13.873708 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lmvpc" Jul 09 01:47:15.978478 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:15.978439 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:47:17.418682 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:17.418649 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:47:20.958924 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:20.958890 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s"] Jul 09 01:47:20.965628 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:20.965604 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:20.967874 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:20.967851 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 01:47:20.976242 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:20.976210 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s"] Jul 09 01:47:20.992313 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:20.992285 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:47:21.055288 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.055256 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50a3376e-dd40-4b99-bb64-13951d4e6c91-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.055288 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.055290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50a3376e-dd40-4b99-bb64-13951d4e6c91-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.055494 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.055310 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50a3376e-dd40-4b99-bb64-13951d4e6c91-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.055494 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.055389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6lcf\" (UniqueName: \"kubernetes.io/projected/50a3376e-dd40-4b99-bb64-13951d4e6c91-kube-api-access-k6lcf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.055494 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.055446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50a3376e-dd40-4b99-bb64-13951d4e6c91-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.055494 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.055487 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50a3376e-dd40-4b99-bb64-13951d4e6c91-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.156632 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.156597 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50a3376e-dd40-4b99-bb64-13951d4e6c91-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.156814 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.156646 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50a3376e-dd40-4b99-bb64-13951d4e6c91-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.156814 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.156753 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50a3376e-dd40-4b99-bb64-13951d4e6c91-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.156814 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.156782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50a3376e-dd40-4b99-bb64-13951d4e6c91-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.156814 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.156804 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50a3376e-dd40-4b99-bb64-13951d4e6c91-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.157032 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.156847 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lcf\" (UniqueName: \"kubernetes.io/projected/50a3376e-dd40-4b99-bb64-13951d4e6c91-kube-api-access-k6lcf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.157244 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.157206 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50a3376e-dd40-4b99-bb64-13951d4e6c91-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.157335 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.157243 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50a3376e-dd40-4b99-bb64-13951d4e6c91-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.157335 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.157290 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50a3376e-dd40-4b99-bb64-13951d4e6c91-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.158950 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.158930 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50a3376e-dd40-4b99-bb64-13951d4e6c91-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.159123 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.159103 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50a3376e-dd40-4b99-bb64-13951d4e6c91-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.166949 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.166922 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6lcf\" (UniqueName: \"kubernetes.io/projected/50a3376e-dd40-4b99-bb64-13951d4e6c91-kube-api-access-k6lcf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7th2s\" (UID: \"50a3376e-dd40-4b99-bb64-13951d4e6c91\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.279159 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.279104 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:21.408670 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.408637 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s"] Jul 09 01:47:21.411799 ip-10-0-130-184 kubenswrapper[2565]: W0709 01:47:21.411773 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a3376e_dd40_4b99_bb64_13951d4e6c91.slice/crio-443763f56deab090800c94c22cdc34b6807236e336fb22e876fdf73d6767ba52 WatchSource:0}: Error finding container 443763f56deab090800c94c22cdc34b6807236e336fb22e876fdf73d6767ba52: Status 404 returned error can't find the container with id 443763f56deab090800c94c22cdc34b6807236e336fb22e876fdf73d6767ba52 Jul 09 01:47:21.900099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.900009 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" event={"ID":"50a3376e-dd40-4b99-bb64-13951d4e6c91","Type":"ContainerStarted","Data":"93d7c17c35ee9fff8f8ecf857ebd76ba499101742e1a9a4dc0636c32d8f4880e"} Jul 09 01:47:21.900099 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.900061 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" event={"ID":"50a3376e-dd40-4b99-bb64-13951d4e6c91","Type":"ContainerStarted","Data":"443763f56deab090800c94c22cdc34b6807236e336fb22e876fdf73d6767ba52"} Jul 09 01:47:21.916683 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:21.916626 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" podStartSLOduration=1.6836808589999999 podStartE2EDuration="1.916606072s" totalImagesPullingTime="232.925213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:47:21.915841039 +0000 UTC m=+562.889313661" watchObservedRunningTime="2026-07-09 01:47:21.916606072 +0000 UTC m=+562.890078695" Jul 09 01:47:23.224480 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:23.224437 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:47:31.279265 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:31.279232 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:31.279736 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:31.279318 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:31.291786 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:31.291762 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:31.954287 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:31.954260 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7th2s" Jul 09 01:47:33.763500 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:33.763461 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:47:47.400450 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:47.400412 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:47:50.017373 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:50.017341 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:47:59.490800 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:59.490767 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 01:47:59.494786 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:47:59.494765 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 01:48:47.061193 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:48:47.061135 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:48:48.779651 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:48:48.779621 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:49:01.713106 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:49:01.713054 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:49:01.764457 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:49:01.764424 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:49:16.122646 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:49:16.122609 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:49:25.416057 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:49:25.416018 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:49:36.412124 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:49:36.412086 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:49:45.514896 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:49:45.514863 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:49:56.411779 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:49:56.411699 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:49:58.176245 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:49:58.176204 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:49:59.434662 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:49:59.434596 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:10.716807 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:10.716767 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:10.766801 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:10.766764 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:22.826057 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:22.826020 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:50:30.103040 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:30.102970 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:30.157782 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:30.157753 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:34.816190 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:34.816156 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:50:40.273889 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:40.273853 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:40.383687 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:40.383653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:40.525563 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:40.525471 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:46.196764 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:46.196730 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:46.254672 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:46.254643 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:46.327633 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:46.327604 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:46.426966 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:46.426939 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:46.631324 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:46.631281 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:52.460481 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:52.460446 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:50:52.567686 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:50:52.567653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:51:09.220023 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:51:09.219986 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:51:18.912494 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:51:18.912460 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:51:28.815975 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:51:28.815933 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:51:37.111782 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:51:37.111747 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:51:46.414791 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:51:46.414749 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:51:48.008004 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:51:48.007968 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:51:55.529838 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:51:55.529772 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:52:05.920172 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:52:05.920122 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:52:15.819187 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:52:15.819133 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:52:38.222384 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:52:38.222348 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:52:47.423985 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:52:47.423949 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:52:59.514524 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:52:59.514450 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 01:52:59.516112 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:52:59.516077 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 01:53:11.024926 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:53:11.024893 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:53:20.831596 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:53:20.831559 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:53:28.997780 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:53:28.997748 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:53:39.785801 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:53:39.785764 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:53:49.434540 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:53:49.434497 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:53:58.567974 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:53:58.567935 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:54:08.480336 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:54:08.480294 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:54:18.121748 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:54:18.121716 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:54:26.948957 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:54:26.948927 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:56:09.915634 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:56:09.915601 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:56:18.910477 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:56:18.910439 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:56:31.630733 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:56:31.630685 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:56:43.416037 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:56:43.416003 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:56:53.919915 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:56:53.919878 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:57:03.881479 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:57:03.881442 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:57:05.220093 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:57:05.220046 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:57:14.421469 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:57:14.421429 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:57:25.219989 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:57:25.219909 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:57:34.918680 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:57:34.918645 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:57:45.421467 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:57:45.421426 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:57:57.712750 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:57:57.712710 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:57:59.539356 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:57:59.539324 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 01:57:59.540637 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:57:59.540617 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 01:58:20.334778 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:58:20.334744 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:58:29.726814 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:58:29.726780 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:58:39.216735 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:58:39.216691 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:58:48.522520 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:58:48.522484 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:58:58.517754 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:58:58.517674 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:59:09.025697 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:59:09.025656 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:59:20.321110 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:59:20.321072 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:59:29.564591 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:59:29.564554 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:59:35.174814 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:59:35.174776 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:59:36.438034 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:59:36.438000 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 01:59:39.919089 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:59:39.919052 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:59:48.914573 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:59:48.914536 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 01:59:58.518155 ip-10-0-130-184 kubenswrapper[2565]: I0709 01:59:58.518105 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:00:12.017598 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:00:12.017559 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:00:21.152026 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:00:21.151941 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:00:30.218468 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:00:30.218427 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:00:42.622805 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:00:42.622770 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:00:51.717912 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:00:51.717870 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:00:58.726433 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:00:58.726396 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:01:14.919040 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:01:14.918997 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:01:23.174688 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:01:23.174633 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:01:27.030423 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:01:27.030380 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:01:37.722151 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:01:37.722112 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:01:40.758633 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:01:40.758594 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:01:46.531438 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:01:46.531400 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:01:50.215296 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:01:50.215232 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:01:58.408225 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:01:58.408184 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:03.450899 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:03.450863 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:06.244505 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:06.244464 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:06.347837 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:06.347798 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:06.670169 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:06.670071 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:07.823744 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:07.823713 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:02:12.720581 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:12.720545 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:12.826796 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:12.826767 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:12.905418 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:12.905385 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729"] Jul 09 02:02:12.908727 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:12.908702 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:12.911315 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:12.911293 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-648e4a0f-openshift-default-dockercfg-4svv8\"" Jul 09 02:02:12.923957 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:12.923928 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729"] Jul 09 02:02:12.950809 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:12.950772 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:13.008480 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.008442 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-token\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.008656 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.008502 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cctn\" (UniqueName: \"kubernetes.io/projected/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-kube-api-access-4cctn\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.008656 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.008527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istiod-ca-cert\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.008656 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.008569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-workload-certs\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.008821 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.008646 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-credential-socket\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.008821 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.008676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-envoy\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.008821 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.008698 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-data\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.008821 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.008773 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-workload-socket\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.008821 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.008800 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-podinfo\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.044937 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.044901 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:13.110120 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.110086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cctn\" (UniqueName: \"kubernetes.io/projected/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-kube-api-access-4cctn\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.110120 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.110121 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istiod-ca-cert\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.110376 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.110171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-workload-certs\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.110376 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.110192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-credential-socket\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.110376 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.110208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-envoy\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.110376 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.110232 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-data\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.110376 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.110281 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-workload-socket\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.110376 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.110309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-podinfo\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.110376 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.110356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-token\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.110723 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.110696 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-workload-certs\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.110911 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.110731 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-credential-socket\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.110911 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.110841 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-data\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.110911 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.110892 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-workload-socket\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.111126 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.111099 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istiod-ca-cert\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.113179 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.113157 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-envoy\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.113388 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.113373 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-podinfo\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.118554 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.118535 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-token\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.119210 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.119187 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cctn\" (UniqueName: \"kubernetes.io/projected/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-kube-api-access-4cctn\") pod \"e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.219208 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.219175 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:13.362851 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.362814 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729"] Jul 09 02:02:13.365766 ip-10-0-130-184 kubenswrapper[2565]: W0709 02:02:13.365739 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16fb8c7_c5a9_4bda_bd2d_0ca7a8a7a014.slice/crio-6184a736bdd7e17f8267376af2d95befd67901672e5d4df0ccdd1300bb7b4510 WatchSource:0}: Error finding container 6184a736bdd7e17f8267376af2d95befd67901672e5d4df0ccdd1300bb7b4510: Status 404 returned error can't find the container with id 6184a736bdd7e17f8267376af2d95befd67901672e5d4df0ccdd1300bb7b4510 Jul 09 02:02:13.367990 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.367952 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:02:13.368093 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.368024 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:02:13.368093 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.368052 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:02:13.596874 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.596789 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" event={"ID":"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014","Type":"ContainerStarted","Data":"822f476d0677a6bf212bcde687c9e32fa319a0a7ee3003e3c840df91c737d3af"} Jul 09 02:02:13.596874 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.596843 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" event={"ID":"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014","Type":"ContainerStarted","Data":"6184a736bdd7e17f8267376af2d95befd67901672e5d4df0ccdd1300bb7b4510"} Jul 09 02:02:13.621467 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:13.621415 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" podStartSLOduration=1.621366283 podStartE2EDuration="1.621366283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:02:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:02:13.620542729 +0000 UTC m=+1454.594015347" watchObservedRunningTime="2026-07-09 02:02:13.621366283 +0000 UTC m=+1454.594838907" Jul 09 02:02:14.220108 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:14.220072 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:14.225160 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:14.225122 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:14.601183 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:14.601134 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:14.602195 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:14.602175 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:15.073836 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:15.073798 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:15.176568 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:15.176532 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:16.425633 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:16.425593 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:02:16.689811 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:16.689722 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:19.159237 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:19.159196 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:19.421310 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:19.421216 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729"] Jul 09 02:02:19.421484 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:19.421434 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" podUID="a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" containerName="istio-proxy" containerID="cri-o://822f476d0677a6bf212bcde687c9e32fa319a0a7ee3003e3c840df91c737d3af" gracePeriod=30 Jul 09 02:02:19.446778 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:19.446739 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:19.547157 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:19.547109 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:19.752123 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:19.752085 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:20.813130 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:20.813087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:24.367628 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.367604 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:24.514209 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514176 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cctn\" (UniqueName: \"kubernetes.io/projected/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-kube-api-access-4cctn\") pod \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " Jul 09 02:02:24.514452 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514234 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-workload-certs\") pod \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " Jul 09 02:02:24.514452 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514251 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-data\") pod \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " Jul 09 02:02:24.514452 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514275 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-workload-socket\") pod \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " Jul 09 02:02:24.514452 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514312 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istiod-ca-cert\") pod \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " Jul 09 02:02:24.514452 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514329 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-podinfo\") pod \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " Jul 09 02:02:24.514452 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514373 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-token\") pod \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " Jul 09 02:02:24.514452 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514398 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-credential-socket\") pod \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " Jul 09 02:02:24.514802 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514522 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" (UID: "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:24.514802 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514643 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" (UID: "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:24.514802 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514650 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-envoy\") pod \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\" (UID: \"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014\") " Jul 09 02:02:24.514802 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514737 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" (UID: "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:02:24.514987 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514875 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" (UID: "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:24.515044 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.514998 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-workload-certs\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:24.515044 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.515028 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-workload-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:24.515119 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.515042 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istiod-ca-cert\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:24.515119 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.515055 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-credential-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:24.515315 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.515289 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-data" (OuterVolumeSpecName: "istio-data") pod "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" (UID: "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:24.516866 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.516846 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-kube-api-access-4cctn" (OuterVolumeSpecName: "kube-api-access-4cctn") pod "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" (UID: "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014"). InnerVolumeSpecName "kube-api-access-4cctn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:02:24.516866 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.516858 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-token" (OuterVolumeSpecName: "istio-token") pod "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" (UID: "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:02:24.517058 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.517037 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" (UID: "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:24.517185 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.517060 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" (UID: "a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 02:02:24.615521 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.615483 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-podinfo\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:24.615521 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.615515 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-token\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:24.615521 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.615525 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-envoy\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:24.615757 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.615534 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cctn\" (UniqueName: \"kubernetes.io/projected/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-kube-api-access-4cctn\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:24.615757 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.615543 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014-istio-data\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:24.653020 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.652985 2565 generic.go:356] "Generic (PLEG): container finished" podID="a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" containerID="822f476d0677a6bf212bcde687c9e32fa319a0a7ee3003e3c840df91c737d3af" exitCode=0 Jul 09 02:02:24.653172 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.653026 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" Jul 09 02:02:24.653172 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.653050 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" event={"ID":"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014","Type":"ContainerDied","Data":"822f476d0677a6bf212bcde687c9e32fa319a0a7ee3003e3c840df91c737d3af"} Jul 09 02:02:24.653172 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.653101 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729" event={"ID":"a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014","Type":"ContainerDied","Data":"6184a736bdd7e17f8267376af2d95befd67901672e5d4df0ccdd1300bb7b4510"} Jul 09 02:02:24.653172 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.653124 2565 scope.go:117] "RemoveContainer" containerID="822f476d0677a6bf212bcde687c9e32fa319a0a7ee3003e3c840df91c737d3af" Jul 09 02:02:24.662266 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.662212 2565 scope.go:117] "RemoveContainer" containerID="822f476d0677a6bf212bcde687c9e32fa319a0a7ee3003e3c840df91c737d3af" Jul 09 02:02:24.662473 ip-10-0-130-184 kubenswrapper[2565]: E0709 02:02:24.662454 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"822f476d0677a6bf212bcde687c9e32fa319a0a7ee3003e3c840df91c737d3af\": container with ID starting with 822f476d0677a6bf212bcde687c9e32fa319a0a7ee3003e3c840df91c737d3af not found: ID does not exist" containerID="822f476d0677a6bf212bcde687c9e32fa319a0a7ee3003e3c840df91c737d3af" Jul 09 02:02:24.662513 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.662481 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"822f476d0677a6bf212bcde687c9e32fa319a0a7ee3003e3c840df91c737d3af"} err="failed to get container status \"822f476d0677a6bf212bcde687c9e32fa319a0a7ee3003e3c840df91c737d3af\": rpc error: code = NotFound desc = could not find container \"822f476d0677a6bf212bcde687c9e32fa319a0a7ee3003e3c840df91c737d3af\": container with ID starting with 822f476d0677a6bf212bcde687c9e32fa319a0a7ee3003e3c840df91c737d3af not found: ID does not exist" Jul 09 02:02:24.675599 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.675572 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729"] Jul 09 02:02:24.679737 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:24.679717 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-648e4a0f-openshift-default-c546c7b95-jd729"] Jul 09 02:02:25.276074 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.276036 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:25.376716 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.376673 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:25.458168 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.458120 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs"] Jul 09 02:02:25.458649 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.458607 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" containerName="istio-proxy" Jul 09 02:02:25.458822 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.458795 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" containerName="istio-proxy" Jul 09 02:02:25.458927 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.458906 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" containerName="istio-proxy" Jul 09 02:02:25.463183 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.463070 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.466113 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.466090 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c2d2d4a2-openshift-default-dockercfg-2sql5\"" Jul 09 02:02:25.476891 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.476869 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs"] Jul 09 02:02:25.515258 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.515213 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:25.564000 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.563915 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014" path="/var/lib/kubelet/pods/a16fb8c7-c5a9-4bda-bd2d-0ca7a8a7a014/volumes" Jul 09 02:02:25.613771 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.613737 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:25.624820 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.624791 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-token\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.624953 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.624826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-data\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.624953 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.624889 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-workload-socket\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.624953 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.624924 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istiod-ca-cert\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.625054 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.624996 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-credential-socket\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.625054 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.625025 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbn5p\" (UniqueName: \"kubernetes.io/projected/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-kube-api-access-cbn5p\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.625054 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.625046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-workload-certs\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.625173 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.625089 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-podinfo\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.625173 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.625107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-envoy\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.725698 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.725662 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-credential-socket\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.725872 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.725726 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbn5p\" (UniqueName: \"kubernetes.io/projected/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-kube-api-access-cbn5p\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.725872 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.725746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-workload-certs\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.725872 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.725774 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-podinfo\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.725872 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.725796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-envoy\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.725872 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.725850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-token\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.726126 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.725882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-data\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.726126 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.725933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-workload-socket\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.726126 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.725962 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istiod-ca-cert\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.726314 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.726123 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-credential-socket\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.726398 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.726373 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-data\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.726450 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.726426 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-workload-certs\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.726507 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.726453 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-workload-socket\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.726602 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.726584 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istiod-ca-cert\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.728691 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.728666 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-envoy\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.728902 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.728881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-podinfo\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.734181 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.734158 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbn5p\" (UniqueName: \"kubernetes.io/projected/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-kube-api-access-cbn5p\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.734419 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.734401 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-token\") pod \"e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.772882 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.772853 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:25.909265 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.909240 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs"] Jul 09 02:02:25.911525 ip-10-0-130-184 kubenswrapper[2565]: W0709 02:02:25.911500 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56cd0e6f_eba9_4f8e_b92e_8d4613a47ecb.slice/crio-0f68cf5df47c064531801f62a24d5554465a448f0795474a4ea4536d11e61272 WatchSource:0}: Error finding container 0f68cf5df47c064531801f62a24d5554465a448f0795474a4ea4536d11e61272: Status 404 returned error can't find the container with id 0f68cf5df47c064531801f62a24d5554465a448f0795474a4ea4536d11e61272 Jul 09 02:02:25.913550 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.913517 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:02:25.913651 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.913622 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:02:25.913713 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:25.913667 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:02:26.664476 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:26.664439 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" event={"ID":"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb","Type":"ContainerStarted","Data":"abefb68769929b676324a448251b358bf8f41b6e147937abd2ae909a53ab730c"} Jul 09 02:02:26.664842 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:26.664492 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" event={"ID":"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb","Type":"ContainerStarted","Data":"0f68cf5df47c064531801f62a24d5554465a448f0795474a4ea4536d11e61272"} Jul 09 02:02:26.696510 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:26.696459 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" podStartSLOduration=1.696442923 podStartE2EDuration="1.696442923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:02:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:02:26.694847203 +0000 UTC m=+1467.668319824" watchObservedRunningTime="2026-07-09 02:02:26.696442923 +0000 UTC m=+1467.669915543" Jul 09 02:02:26.717988 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:26.717948 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:26.774013 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:26.773979 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:26.779773 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:26.779731 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:26.820360 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:26.820333 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:26.906103 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:26.906061 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:27.197474 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:27.197441 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:27.408518 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:27.408476 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:27.508822 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:27.508787 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:27.668696 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:27.668667 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:27.669770 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:27.669753 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:27.961261 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:27.961226 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:02:29.092000 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:29.091954 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:31.728775 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:31.728724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:32.250909 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:32.250873 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:37.809746 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:37.809712 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs"] Jul 09 02:02:37.810214 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:37.809950 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" podUID="56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" containerName="istio-proxy" containerID="cri-o://abefb68769929b676324a448251b358bf8f41b6e147937abd2ae909a53ab730c" gracePeriod=30 Jul 09 02:02:37.838792 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:37.838751 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:37.926611 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:37.926571 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:39.441310 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.441273 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:39.723928 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.723893 2565 generic.go:356] "Generic (PLEG): container finished" podID="56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" containerID="abefb68769929b676324a448251b358bf8f41b6e147937abd2ae909a53ab730c" exitCode=0 Jul 09 02:02:39.724056 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.723959 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" event={"ID":"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb","Type":"ContainerDied","Data":"abefb68769929b676324a448251b358bf8f41b6e147937abd2ae909a53ab730c"} Jul 09 02:02:39.855263 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.855238 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:39.954640 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.954556 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-credential-socket\") pod \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " Jul 09 02:02:39.954640 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.954604 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-envoy\") pod \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " Jul 09 02:02:39.954848 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.954647 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-podinfo\") pod \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " Jul 09 02:02:39.954848 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.954670 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-token\") pod \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " Jul 09 02:02:39.954848 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.954690 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbn5p\" (UniqueName: \"kubernetes.io/projected/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-kube-api-access-cbn5p\") pod \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " Jul 09 02:02:39.954848 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.954717 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istiod-ca-cert\") pod \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " Jul 09 02:02:39.954848 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.954739 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-workload-certs\") pod \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " Jul 09 02:02:39.954848 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.954771 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-data\") pod \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " Jul 09 02:02:39.954848 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.954795 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-workload-socket\") pod \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\" (UID: \"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb\") " Jul 09 02:02:39.955244 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.954887 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" (UID: "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:39.955244 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.955112 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" (UID: "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:39.955244 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.955124 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-credential-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:39.955244 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.955201 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" (UID: "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:39.955426 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.955255 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" (UID: "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:02:39.955961 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.955933 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-data" (OuterVolumeSpecName: "istio-data") pod "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" (UID: "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:39.957022 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.956991 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" (UID: "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 02:02:39.957022 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.956996 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" (UID: "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:39.957188 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.957104 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-kube-api-access-cbn5p" (OuterVolumeSpecName: "kube-api-access-cbn5p") pod "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" (UID: "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb"). InnerVolumeSpecName "kube-api-access-cbn5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:02:39.957188 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:39.957113 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-token" (OuterVolumeSpecName: "istio-token") pod "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" (UID: "56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:02:40.056506 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:40.056475 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-podinfo\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:40.056506 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:40.056500 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-token\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:40.056506 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:40.056511 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbn5p\" (UniqueName: \"kubernetes.io/projected/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-kube-api-access-cbn5p\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:40.056734 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:40.056520 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istiod-ca-cert\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:40.056734 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:40.056529 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-workload-certs\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:40.056734 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:40.056537 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-data\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:40.056734 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:40.056544 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-workload-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:40.056734 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:40.056551 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb-istio-envoy\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:40.728910 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:40.728873 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" event={"ID":"56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb","Type":"ContainerDied","Data":"0f68cf5df47c064531801f62a24d5554465a448f0795474a4ea4536d11e61272"} Jul 09 02:02:40.728910 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:40.728898 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs" Jul 09 02:02:40.729419 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:40.728943 2565 scope.go:117] "RemoveContainer" containerID="abefb68769929b676324a448251b358bf8f41b6e147937abd2ae909a53ab730c" Jul 09 02:02:40.751044 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:40.751007 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs"] Jul 09 02:02:40.755827 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:40.755800 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c2d2d4a2-openshift-default-d67cbbf8c-t9tgs"] Jul 09 02:02:41.563636 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:41.563592 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" path="/var/lib/kubelet/pods/56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb/volumes" Jul 09 02:02:43.618343 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.618307 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:43.687428 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.687391 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:43.809362 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.809331 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4"] Jul 09 02:02:43.809641 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.809629 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" containerName="istio-proxy" Jul 09 02:02:43.809685 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.809642 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" containerName="istio-proxy" Jul 09 02:02:43.809719 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.809707 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="56cd0e6f-eba9-4f8e-b92e-8d4613a47ecb" containerName="istio-proxy" Jul 09 02:02:43.813898 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.813878 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.817423 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.817400 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-aad4ce3b-openshift-default-dockercfg-9hdxj\"" Jul 09 02:02:43.840017 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.839987 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4"] Jul 09 02:02:43.885932 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.885852 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:43.889938 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.889918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-workload-socket\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.890020 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.889945 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-credential-socket\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.890020 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.889968 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-token\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.890020 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.889993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-workload-certs\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.890109 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.890052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbg58\" (UniqueName: \"kubernetes.io/projected/53f63560-6c5a-4535-b8f0-c7b6b871327b-kube-api-access-sbg58\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.890159 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.890104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-podinfo\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.890159 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.890129 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53f63560-6c5a-4535-b8f0-c7b6b871327b-istiod-ca-cert\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.890244 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.890231 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-data\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.890279 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.890261 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-envoy\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.984371 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.984321 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:43.991524 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.991477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-data\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.991675 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.991539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-envoy\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.991675 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.991582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-workload-socket\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.991675 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.991606 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-credential-socket\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.991675 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.991633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-token\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.991675 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.991669 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-workload-certs\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.991927 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.991701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbg58\" (UniqueName: \"kubernetes.io/projected/53f63560-6c5a-4535-b8f0-c7b6b871327b-kube-api-access-sbg58\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.991927 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.991899 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-data\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.992032 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.991924 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-podinfo\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.992032 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.991967 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53f63560-6c5a-4535-b8f0-c7b6b871327b-istiod-ca-cert\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.992032 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.991977 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-workload-socket\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.992032 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.992006 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-credential-socket\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.992229 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.992116 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-workload-certs\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.992560 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.992537 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53f63560-6c5a-4535-b8f0-c7b6b871327b-istiod-ca-cert\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.993832 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.993810 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-envoy\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.994279 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.994261 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-podinfo\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:43.999818 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:43.999792 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbg58\" (UniqueName: \"kubernetes.io/projected/53f63560-6c5a-4535-b8f0-c7b6b871327b-kube-api-access-sbg58\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:44.000190 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:44.000112 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-token\") pod \"e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:44.124176 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:44.124114 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:44.259656 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:44.259630 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4"] Jul 09 02:02:44.261221 ip-10-0-130-184 kubenswrapper[2565]: W0709 02:02:44.261193 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f63560_6c5a_4535_b8f0_c7b6b871327b.slice/crio-12b84b7d5eb4b617ac8fff6ce2bf08eda86db556e5a5090931d6160a83f934ee WatchSource:0}: Error finding container 12b84b7d5eb4b617ac8fff6ce2bf08eda86db556e5a5090931d6160a83f934ee: Status 404 returned error can't find the container with id 12b84b7d5eb4b617ac8fff6ce2bf08eda86db556e5a5090931d6160a83f934ee Jul 09 02:02:44.263272 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:44.263240 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:02:44.263366 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:44.263325 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:02:44.263421 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:44.263371 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:02:44.748670 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:44.748626 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" event={"ID":"53f63560-6c5a-4535-b8f0-c7b6b871327b","Type":"ContainerStarted","Data":"9e0829e69bcf198437c6d94025e9765df0dcf44f90fdcba585b37154663b21d6"} Jul 09 02:02:44.749050 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:44.748680 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" event={"ID":"53f63560-6c5a-4535-b8f0-c7b6b871327b","Type":"ContainerStarted","Data":"12b84b7d5eb4b617ac8fff6ce2bf08eda86db556e5a5090931d6160a83f934ee"} Jul 09 02:02:44.770812 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:44.770766 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" podStartSLOduration=1.770747327 podStartE2EDuration="1.770747327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:02:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:02:44.769591243 +0000 UTC m=+1485.743063859" watchObservedRunningTime="2026-07-09 02:02:44.770747327 +0000 UTC m=+1485.744219949" Jul 09 02:02:45.060050 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:45.059953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:45.124864 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:45.124823 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:45.130668 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:45.130641 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:45.226015 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:45.225983 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:45.338933 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:45.338851 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:45.463304 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:45.463252 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:45.737087 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:45.737052 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:45.753403 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:45.753376 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:45.754418 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:45.754399 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:45.845474 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:45.845431 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:47.261720 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:47.261690 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:47.715644 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:47.715556 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:02:49.411075 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:49.411027 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:49.563736 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:49.563703 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4"] Jul 09 02:02:49.563904 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:49.563866 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" podUID="53f63560-6c5a-4535-b8f0-c7b6b871327b" containerName="istio-proxy" containerID="cri-o://9e0829e69bcf198437c6d94025e9765df0dcf44f90fdcba585b37154663b21d6" gracePeriod=30 Jul 09 02:02:49.585936 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:49.585900 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:49.689254 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:49.689162 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:49.826631 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:49.826593 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:51.363551 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:51.363515 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:55.504974 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.504950 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:55.543790 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.543708 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:55.596832 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.596800 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbg58\" (UniqueName: \"kubernetes.io/projected/53f63560-6c5a-4535-b8f0-c7b6b871327b-kube-api-access-sbg58\") pod \"53f63560-6c5a-4535-b8f0-c7b6b871327b\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " Jul 09 02:02:55.596989 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.596849 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53f63560-6c5a-4535-b8f0-c7b6b871327b-istiod-ca-cert\") pod \"53f63560-6c5a-4535-b8f0-c7b6b871327b\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " Jul 09 02:02:55.596989 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.596885 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-data\") pod \"53f63560-6c5a-4535-b8f0-c7b6b871327b\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " Jul 09 02:02:55.597133 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.596985 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-workload-certs\") pod \"53f63560-6c5a-4535-b8f0-c7b6b871327b\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " Jul 09 02:02:55.597133 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597034 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-workload-socket\") pod \"53f63560-6c5a-4535-b8f0-c7b6b871327b\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " Jul 09 02:02:55.597133 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597108 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-credential-socket\") pod \"53f63560-6c5a-4535-b8f0-c7b6b871327b\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " Jul 09 02:02:55.597322 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597133 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-envoy\") pod \"53f63560-6c5a-4535-b8f0-c7b6b871327b\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " Jul 09 02:02:55.597322 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597194 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-token\") pod \"53f63560-6c5a-4535-b8f0-c7b6b871327b\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " Jul 09 02:02:55.597322 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597222 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-podinfo\") pod \"53f63560-6c5a-4535-b8f0-c7b6b871327b\" (UID: \"53f63560-6c5a-4535-b8f0-c7b6b871327b\") " Jul 09 02:02:55.597468 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597312 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "53f63560-6c5a-4535-b8f0-c7b6b871327b" (UID: "53f63560-6c5a-4535-b8f0-c7b6b871327b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:55.597468 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597412 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "53f63560-6c5a-4535-b8f0-c7b6b871327b" (UID: "53f63560-6c5a-4535-b8f0-c7b6b871327b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:55.597468 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597424 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "53f63560-6c5a-4535-b8f0-c7b6b871327b" (UID: "53f63560-6c5a-4535-b8f0-c7b6b871327b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:55.597468 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597320 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53f63560-6c5a-4535-b8f0-c7b6b871327b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "53f63560-6c5a-4535-b8f0-c7b6b871327b" (UID: "53f63560-6c5a-4535-b8f0-c7b6b871327b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:02:55.597682 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597563 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-credential-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:55.597682 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597583 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53f63560-6c5a-4535-b8f0-c7b6b871327b-istiod-ca-cert\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:55.597682 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597592 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-workload-certs\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:55.597682 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597599 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-workload-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:55.597829 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.597744 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-data" (OuterVolumeSpecName: "istio-data") pod "53f63560-6c5a-4535-b8f0-c7b6b871327b" (UID: "53f63560-6c5a-4535-b8f0-c7b6b871327b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:55.599286 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.599265 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "53f63560-6c5a-4535-b8f0-c7b6b871327b" (UID: "53f63560-6c5a-4535-b8f0-c7b6b871327b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 02:02:55.599409 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.599391 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "53f63560-6c5a-4535-b8f0-c7b6b871327b" (UID: "53f63560-6c5a-4535-b8f0-c7b6b871327b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:02:55.599550 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.599528 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53f63560-6c5a-4535-b8f0-c7b6b871327b-kube-api-access-sbg58" (OuterVolumeSpecName: "kube-api-access-sbg58") pod "53f63560-6c5a-4535-b8f0-c7b6b871327b" (UID: "53f63560-6c5a-4535-b8f0-c7b6b871327b"). InnerVolumeSpecName "kube-api-access-sbg58". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:02:55.599640 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.599610 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-token" (OuterVolumeSpecName: "istio-token") pod "53f63560-6c5a-4535-b8f0-c7b6b871327b" (UID: "53f63560-6c5a-4535-b8f0-c7b6b871327b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:02:55.617154 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.617113 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:55.698291 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.698259 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-data\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:55.698291 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.698286 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-envoy\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:55.698291 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.698296 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-token\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:55.698515 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.698306 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53f63560-6c5a-4535-b8f0-c7b6b871327b-istio-podinfo\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:55.698515 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.698318 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbg58\" (UniqueName: \"kubernetes.io/projected/53f63560-6c5a-4535-b8f0-c7b6b871327b-kube-api-access-sbg58\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:02:55.795983 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.795891 2565 generic.go:356] "Generic (PLEG): container finished" podID="53f63560-6c5a-4535-b8f0-c7b6b871327b" containerID="9e0829e69bcf198437c6d94025e9765df0dcf44f90fdcba585b37154663b21d6" exitCode=0 Jul 09 02:02:55.795983 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.795938 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" Jul 09 02:02:55.796243 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.795976 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" event={"ID":"53f63560-6c5a-4535-b8f0-c7b6b871327b","Type":"ContainerDied","Data":"9e0829e69bcf198437c6d94025e9765df0dcf44f90fdcba585b37154663b21d6"} Jul 09 02:02:55.796243 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.796042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4" event={"ID":"53f63560-6c5a-4535-b8f0-c7b6b871327b","Type":"ContainerDied","Data":"12b84b7d5eb4b617ac8fff6ce2bf08eda86db556e5a5090931d6160a83f934ee"} Jul 09 02:02:55.796243 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.796073 2565 scope.go:117] "RemoveContainer" containerID="9e0829e69bcf198437c6d94025e9765df0dcf44f90fdcba585b37154663b21d6" Jul 09 02:02:55.804991 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.804963 2565 scope.go:117] "RemoveContainer" containerID="9e0829e69bcf198437c6d94025e9765df0dcf44f90fdcba585b37154663b21d6" Jul 09 02:02:55.805329 ip-10-0-130-184 kubenswrapper[2565]: E0709 02:02:55.805308 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e0829e69bcf198437c6d94025e9765df0dcf44f90fdcba585b37154663b21d6\": container with ID starting with 9e0829e69bcf198437c6d94025e9765df0dcf44f90fdcba585b37154663b21d6 not found: ID does not exist" containerID="9e0829e69bcf198437c6d94025e9765df0dcf44f90fdcba585b37154663b21d6" Jul 09 02:02:55.805387 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.805338 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e0829e69bcf198437c6d94025e9765df0dcf44f90fdcba585b37154663b21d6"} err="failed to get container status \"9e0829e69bcf198437c6d94025e9765df0dcf44f90fdcba585b37154663b21d6\": rpc error: code = NotFound desc = could not find container \"9e0829e69bcf198437c6d94025e9765df0dcf44f90fdcba585b37154663b21d6\": container with ID starting with 9e0829e69bcf198437c6d94025e9765df0dcf44f90fdcba585b37154663b21d6 not found: ID does not exist" Jul 09 02:02:55.818415 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.818383 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4"] Jul 09 02:02:55.825156 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:55.825119 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-aad4ce3b-openshift-default-6885c5d89f-mpdw4"] Jul 09 02:02:56.041734 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:56.041699 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:56.197512 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:56.197424 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:56.330743 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:56.330708 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:02:57.563409 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:57.563368 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53f63560-6c5a-4535-b8f0-c7b6b871327b" path="/var/lib/kubelet/pods/53f63560-6c5a-4535-b8f0-c7b6b871327b/volumes" Jul 09 02:02:57.566739 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:57.566713 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:02:59.564578 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:59.564552 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 02:02:59.565180 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:02:59.565124 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 02:03:03.354186 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:03.354154 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:03.455920 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:03.455883 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:03.554823 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:03.554783 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:03.654421 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:03.654335 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:04.056511 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:04.056477 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:20.702025 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:20.701940 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:20.759438 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:20.759395 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:30.028038 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:30.028000 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:32.788451 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:32.788415 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:35.705765 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:35.705727 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:35.820408 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:35.820369 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:35.915063 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:35.915024 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:51.787572 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:51.787528 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:57.470464 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:57.470427 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:57.532049 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:57.532015 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:57.681475 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:57.681434 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:03:57.843705 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:03:57.843667 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:08.233522 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:08.233476 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:09.033213 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:09.033168 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:14.685280 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:14.685243 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:14.789691 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:14.789659 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:14.891792 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:14.891759 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:14.985536 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:14.985503 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:15.732644 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:15.732607 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:15.833708 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:15.833672 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:15.926604 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:15.926566 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:17.529446 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:17.529402 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:18.128702 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:18.128664 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:04:23.385271 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:23.385231 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:23.486254 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:23.486206 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:24.075979 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:24.075943 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:25.917453 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:25.917415 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:04:29.822113 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:29.822077 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:29.882455 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:29.882417 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:30.057528 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.057494 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:30.354274 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.354244 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk"] Jul 09 02:04:30.354577 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.354565 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53f63560-6c5a-4535-b8f0-c7b6b871327b" containerName="istio-proxy" Jul 09 02:04:30.354629 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.354578 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="53f63560-6c5a-4535-b8f0-c7b6b871327b" containerName="istio-proxy" Jul 09 02:04:30.354673 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.354645 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="53f63560-6c5a-4535-b8f0-c7b6b871327b" containerName="istio-proxy" Jul 09 02:04:30.356512 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.356495 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.359018 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.358991 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-51c9da2a-openshift-default-dockercfg-5n5wn\"" Jul 09 02:04:30.381580 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.381541 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk"] Jul 09 02:04:30.384005 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.383977 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:30.396343 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.396315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-workload-socket\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.396660 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.396632 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-workload-certs\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.396763 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.396676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8z6x\" (UniqueName: \"kubernetes.io/projected/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-kube-api-access-k8z6x\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.396763 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.396703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-envoy\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.396848 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.396787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-token\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.396848 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.396821 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-credential-socket\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.396929 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.396846 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-data\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.396929 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.396869 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-podinfo\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.396929 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.396915 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istiod-ca-cert\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.497529 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.497489 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8z6x\" (UniqueName: \"kubernetes.io/projected/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-kube-api-access-k8z6x\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.497529 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.497531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-envoy\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.497791 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.497575 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-token\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.497791 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.497600 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-credential-socket\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.497791 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.497626 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-data\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.497791 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.497648 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-podinfo\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.497791 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.497699 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istiod-ca-cert\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.497791 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.497742 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-workload-socket\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.498065 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.497795 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-workload-certs\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.498117 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.498096 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-credential-socket\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.498383 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.498360 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-workload-socket\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.498548 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.498524 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istiod-ca-cert\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.498657 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.498499 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-data\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.498762 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.498739 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-workload-certs\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.500433 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.500412 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-envoy\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.500560 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.500542 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-podinfo\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.505529 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.505507 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-token\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.505675 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.505648 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8z6x\" (UniqueName: \"kubernetes.io/projected/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-kube-api-access-k8z6x\") pod \"e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.573967 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.573917 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:30.668003 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.667920 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:30.805565 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.805533 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk"] Jul 09 02:04:30.806857 ip-10-0-130-184 kubenswrapper[2565]: W0709 02:04:30.806828 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06deb10_4c43_4c2f_9a4d_76fc42cabe95.slice/crio-d58dab03691ad293b35042f52ae00c6c698e6594eb786cdbecab9a5b5035355b WatchSource:0}: Error finding container d58dab03691ad293b35042f52ae00c6c698e6594eb786cdbecab9a5b5035355b: Status 404 returned error can't find the container with id d58dab03691ad293b35042f52ae00c6c698e6594eb786cdbecab9a5b5035355b Jul 09 02:04:30.808884 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.808851 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:04:30.808986 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.808948 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:04:30.809048 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:30.808999 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:04:31.192762 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:31.192728 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" event={"ID":"d06deb10-4c43-4c2f-9a4d-76fc42cabe95","Type":"ContainerStarted","Data":"2819953b51f47133d916d2d6f89e47ae26833da743d324f97ca43d41f020da41"} Jul 09 02:04:31.193165 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:31.192780 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" event={"ID":"d06deb10-4c43-4c2f-9a4d-76fc42cabe95","Type":"ContainerStarted","Data":"d58dab03691ad293b35042f52ae00c6c698e6594eb786cdbecab9a5b5035355b"} Jul 09 02:04:31.215939 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:31.215886 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" podStartSLOduration=1.21586644 podStartE2EDuration="1.21586644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:04:31.21407218 +0000 UTC m=+1592.187544803" watchObservedRunningTime="2026-07-09 02:04:31.21586644 +0000 UTC m=+1592.189339039" Jul 09 02:04:31.668785 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:31.668745 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:31.673394 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:31.673367 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:32.199871 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:32.199830 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:32.200856 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:32.200838 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:33.142862 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:33.142801 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:33.238248 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:33.238205 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:33.306101 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:33.306070 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:33.566694 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:33.566660 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:33.804495 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:33.804459 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:33.902767 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:33.902681 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:37.643195 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:37.643160 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:37.819584 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:37.819547 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:04:38.764548 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:38.764491 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:44.674254 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:44.674213 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:44.733389 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:44.733349 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:45.123412 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:45.123375 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:45.505236 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:45.505196 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:45.606036 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:45.606001 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:46.260632 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:46.260604 2565 generic.go:356] "Generic (PLEG): container finished" podID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" containerID="2819953b51f47133d916d2d6f89e47ae26833da743d324f97ca43d41f020da41" exitCode=0 Jul 09 02:04:46.261074 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:46.260684 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" event={"ID":"d06deb10-4c43-4c2f-9a4d-76fc42cabe95","Type":"ContainerDied","Data":"2819953b51f47133d916d2d6f89e47ae26833da743d324f97ca43d41f020da41"} Jul 09 02:04:46.261074 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:46.261062 2565 scope.go:117] "RemoveContainer" containerID="2819953b51f47133d916d2d6f89e47ae26833da743d324f97ca43d41f020da41" Jul 09 02:04:46.262012 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:46.261980 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:04:46.262182 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:46.262051 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:04:46.262182 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:46.262086 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:04:47.200453 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:47.200413 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:47.266113 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:47.266078 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" event={"ID":"d06deb10-4c43-4c2f-9a4d-76fc42cabe95","Type":"ContainerStarted","Data":"a5b925a0701c95454e6ec8a265dd634db545cc548ef02c758de25a16dca08cff"} Jul 09 02:04:47.668846 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:47.668812 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:47.669842 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:47.669816 2565 patch_prober.go:28] interesting pod/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 09 02:04:47.669963 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:47.669864 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" podUID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 09 02:04:48.668965 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:48.668926 2565 patch_prober.go:28] interesting pod/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 09 02:04:48.669392 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:48.668984 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" podUID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 09 02:04:48.919168 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:48.919041 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:04:49.668630 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:49.668585 2565 patch_prober.go:28] interesting pod/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 09 02:04:49.668807 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:49.668657 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" podUID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 09 02:04:50.669011 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:50.668917 2565 patch_prober.go:28] interesting pod/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 09 02:04:50.669011 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:50.668993 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" podUID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 09 02:04:51.466905 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:51.466869 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:51.534033 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:51.533975 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:51.672695 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:51.672665 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:51.673119 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:51.672929 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:51.673589 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:51.673575 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:51.715404 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:51.715371 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk"] Jul 09 02:04:51.732897 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:51.732861 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:52.062863 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:52.062774 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:52.161390 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:52.161351 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:52.281232 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:52.281195 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:52.287513 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:52.287478 2565 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" secret="" err="secret \"e2e-mt-51c9da2a-openshift-default-dockercfg-5n5wn\" not found" Jul 09 02:04:53.291885 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:53.291847 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" podUID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" containerName="istio-proxy" containerID="cri-o://a5b925a0701c95454e6ec8a265dd634db545cc548ef02c758de25a16dca08cff" gracePeriod=30 Jul 09 02:04:57.917381 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:57.917338 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:58.020803 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.020765 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:58.117348 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.117303 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:58.263889 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.263819 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:04:58.544186 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.544162 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:58.640502 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.640459 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-data\") pod \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " Jul 09 02:04:58.640699 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.640530 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-workload-socket\") pod \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " Jul 09 02:04:58.640699 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.640555 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-credential-socket\") pod \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " Jul 09 02:04:58.640699 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.640581 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-workload-certs\") pod \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " Jul 09 02:04:58.640699 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.640603 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istiod-ca-cert\") pod \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " Jul 09 02:04:58.640699 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.640640 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-podinfo\") pod \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " Jul 09 02:04:58.640699 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.640676 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8z6x\" (UniqueName: \"kubernetes.io/projected/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-kube-api-access-k8z6x\") pod \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " Jul 09 02:04:58.641087 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.640763 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-token\") pod \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " Jul 09 02:04:58.641087 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.640798 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-envoy\") pod \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\" (UID: \"d06deb10-4c43-4c2f-9a4d-76fc42cabe95\") " Jul 09 02:04:58.641087 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.640866 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d06deb10-4c43-4c2f-9a4d-76fc42cabe95" (UID: "d06deb10-4c43-4c2f-9a4d-76fc42cabe95"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:04:58.641087 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.640993 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d06deb10-4c43-4c2f-9a4d-76fc42cabe95" (UID: "d06deb10-4c43-4c2f-9a4d-76fc42cabe95"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:04:58.641087 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.641031 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d06deb10-4c43-4c2f-9a4d-76fc42cabe95" (UID: "d06deb10-4c43-4c2f-9a4d-76fc42cabe95"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:04:58.641399 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.641279 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-workload-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:04:58.641399 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.641296 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-credential-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:04:58.641399 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.641294 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d06deb10-4c43-4c2f-9a4d-76fc42cabe95" (UID: "d06deb10-4c43-4c2f-9a4d-76fc42cabe95"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:04:58.641399 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.641311 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istiod-ca-cert\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:04:58.641592 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.641484 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-data" (OuterVolumeSpecName: "istio-data") pod "d06deb10-4c43-4c2f-9a4d-76fc42cabe95" (UID: "d06deb10-4c43-4c2f-9a4d-76fc42cabe95"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:04:58.643175 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.643122 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d06deb10-4c43-4c2f-9a4d-76fc42cabe95" (UID: "d06deb10-4c43-4c2f-9a4d-76fc42cabe95"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 02:04:58.643175 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.643126 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d06deb10-4c43-4c2f-9a4d-76fc42cabe95" (UID: "d06deb10-4c43-4c2f-9a4d-76fc42cabe95"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:04:58.643443 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.643420 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-kube-api-access-k8z6x" (OuterVolumeSpecName: "kube-api-access-k8z6x") pod "d06deb10-4c43-4c2f-9a4d-76fc42cabe95" (UID: "d06deb10-4c43-4c2f-9a4d-76fc42cabe95"). InnerVolumeSpecName "kube-api-access-k8z6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:04:58.643580 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.643564 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-token" (OuterVolumeSpecName: "istio-token") pod "d06deb10-4c43-4c2f-9a4d-76fc42cabe95" (UID: "d06deb10-4c43-4c2f-9a4d-76fc42cabe95"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:04:58.742019 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.741986 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-envoy\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:04:58.742019 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.742015 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-data\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:04:58.742019 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.742024 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-workload-certs\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:04:58.742276 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.742031 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-podinfo\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:04:58.742276 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.742039 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8z6x\" (UniqueName: \"kubernetes.io/projected/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-kube-api-access-k8z6x\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:04:58.742276 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:58.742048 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d06deb10-4c43-4c2f-9a4d-76fc42cabe95-istio-token\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:04:59.318870 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:59.318833 2565 generic.go:356] "Generic (PLEG): container finished" podID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" containerID="a5b925a0701c95454e6ec8a265dd634db545cc548ef02c758de25a16dca08cff" exitCode=0 Jul 09 02:04:59.319374 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:59.318880 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" Jul 09 02:04:59.319374 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:59.318918 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" event={"ID":"d06deb10-4c43-4c2f-9a4d-76fc42cabe95","Type":"ContainerDied","Data":"a5b925a0701c95454e6ec8a265dd634db545cc548ef02c758de25a16dca08cff"} Jul 09 02:04:59.319374 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:59.318975 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk" event={"ID":"d06deb10-4c43-4c2f-9a4d-76fc42cabe95","Type":"ContainerDied","Data":"d58dab03691ad293b35042f52ae00c6c698e6594eb786cdbecab9a5b5035355b"} Jul 09 02:04:59.319374 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:59.319008 2565 scope.go:117] "RemoveContainer" containerID="a5b925a0701c95454e6ec8a265dd634db545cc548ef02c758de25a16dca08cff" Jul 09 02:04:59.327692 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:59.327673 2565 scope.go:117] "RemoveContainer" containerID="2819953b51f47133d916d2d6f89e47ae26833da743d324f97ca43d41f020da41" Jul 09 02:04:59.337009 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:59.336980 2565 scope.go:117] "RemoveContainer" containerID="a5b925a0701c95454e6ec8a265dd634db545cc548ef02c758de25a16dca08cff" Jul 09 02:04:59.337454 ip-10-0-130-184 kubenswrapper[2565]: E0709 02:04:59.337431 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5b925a0701c95454e6ec8a265dd634db545cc548ef02c758de25a16dca08cff\": container with ID starting with a5b925a0701c95454e6ec8a265dd634db545cc548ef02c758de25a16dca08cff not found: ID does not exist" containerID="a5b925a0701c95454e6ec8a265dd634db545cc548ef02c758de25a16dca08cff" Jul 09 02:04:59.337548 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:59.337461 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b925a0701c95454e6ec8a265dd634db545cc548ef02c758de25a16dca08cff"} err="failed to get container status \"a5b925a0701c95454e6ec8a265dd634db545cc548ef02c758de25a16dca08cff\": rpc error: code = NotFound desc = could not find container \"a5b925a0701c95454e6ec8a265dd634db545cc548ef02c758de25a16dca08cff\": container with ID starting with a5b925a0701c95454e6ec8a265dd634db545cc548ef02c758de25a16dca08cff not found: ID does not exist" Jul 09 02:04:59.337548 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:59.337480 2565 scope.go:117] "RemoveContainer" containerID="2819953b51f47133d916d2d6f89e47ae26833da743d324f97ca43d41f020da41" Jul 09 02:04:59.337773 ip-10-0-130-184 kubenswrapper[2565]: E0709 02:04:59.337756 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2819953b51f47133d916d2d6f89e47ae26833da743d324f97ca43d41f020da41\": container with ID starting with 2819953b51f47133d916d2d6f89e47ae26833da743d324f97ca43d41f020da41 not found: ID does not exist" containerID="2819953b51f47133d916d2d6f89e47ae26833da743d324f97ca43d41f020da41" Jul 09 02:04:59.337819 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:59.337779 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2819953b51f47133d916d2d6f89e47ae26833da743d324f97ca43d41f020da41"} err="failed to get container status \"2819953b51f47133d916d2d6f89e47ae26833da743d324f97ca43d41f020da41\": rpc error: code = NotFound desc = could not find container \"2819953b51f47133d916d2d6f89e47ae26833da743d324f97ca43d41f020da41\": container with ID starting with 2819953b51f47133d916d2d6f89e47ae26833da743d324f97ca43d41f020da41 not found: ID does not exist" Jul 09 02:04:59.340965 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:59.340942 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk"] Jul 09 02:04:59.344467 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:59.344445 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-51c9da2a-openshift-default-57b7b59475-5ckdk"] Jul 09 02:04:59.564615 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:04:59.564582 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" path="/var/lib/kubelet/pods/d06deb10-4c43-4c2f-9a4d-76fc42cabe95/volumes" Jul 09 02:05:04.145156 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:04.145115 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:04.216197 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:04.216164 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:10.927160 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:10.927109 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:11.222961 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.222879 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq"] Jul 09 02:05:11.223370 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.223354 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" containerName="istio-proxy" Jul 09 02:05:11.223422 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.223374 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" containerName="istio-proxy" Jul 09 02:05:11.223490 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.223479 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" containerName="istio-proxy" Jul 09 02:05:11.223527 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.223493 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" containerName="istio-proxy" Jul 09 02:05:11.228128 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.228103 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.230745 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.230712 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bafacff2-openshift-default-dockercfg-z52cr\"" Jul 09 02:05:11.238262 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.238235 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq"] Jul 09 02:05:11.256354 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.256318 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:11.355687 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.355653 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-envoy\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.355888 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.355724 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-data\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.355888 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.355791 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-workload-socket\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.355888 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.355820 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-token\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.355888 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.355839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7f17a5-f425-407f-9ceb-56c2177e0511-istiod-ca-cert\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.355888 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.355882 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhfkr\" (UniqueName: \"kubernetes.io/projected/de7f17a5-f425-407f-9ceb-56c2177e0511-kube-api-access-nhfkr\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.356052 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.355903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-podinfo\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.356052 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.355922 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-workload-certs\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.356052 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.355969 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-credential-socket\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.456914 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.456871 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-envoy\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.457113 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.456950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-data\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.457113 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.456988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-workload-socket\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.457113 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.457012 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-token\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.457113 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.457036 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7f17a5-f425-407f-9ceb-56c2177e0511-istiod-ca-cert\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.457113 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.457067 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhfkr\" (UniqueName: \"kubernetes.io/projected/de7f17a5-f425-407f-9ceb-56c2177e0511-kube-api-access-nhfkr\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.457113 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.457099 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-podinfo\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.457449 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.457131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-workload-certs\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.457449 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.457191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-credential-socket\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.457449 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.457415 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-data\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.457606 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.457499 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-credential-socket\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.457704 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.457684 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-workload-socket\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.457770 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.457733 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-workload-certs\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.457884 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.457860 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7f17a5-f425-407f-9ceb-56c2177e0511-istiod-ca-cert\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.459260 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.459237 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-envoy\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.459664 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.459643 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-podinfo\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.465781 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.465751 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhfkr\" (UniqueName: \"kubernetes.io/projected/de7f17a5-f425-407f-9ceb-56c2177e0511-kube-api-access-nhfkr\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.466028 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.466012 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-token\") pod \"e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.540244 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.540205 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:11.685824 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.685796 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq"] Jul 09 02:05:11.688559 ip-10-0-130-184 kubenswrapper[2565]: W0709 02:05:11.688530 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7f17a5_f425_407f_9ceb_56c2177e0511.slice/crio-84956f239080dc596c013b8af842e818c1eaf14d27b30c55976faff193b2783c WatchSource:0}: Error finding container 84956f239080dc596c013b8af842e818c1eaf14d27b30c55976faff193b2783c: Status 404 returned error can't find the container with id 84956f239080dc596c013b8af842e818c1eaf14d27b30c55976faff193b2783c Jul 09 02:05:11.690913 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.690874 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:05:11.690999 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.690956 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:05:11.691043 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.691016 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:05:11.814353 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:11.814262 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:12.378650 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:12.378613 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" event={"ID":"de7f17a5-f425-407f-9ceb-56c2177e0511","Type":"ContainerStarted","Data":"24c3dc6fd827206381bbd8a1002c70d8e499ac080021e020f37d4749a36b95ca"} Jul 09 02:05:12.379046 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:12.378690 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" event={"ID":"de7f17a5-f425-407f-9ceb-56c2177e0511","Type":"ContainerStarted","Data":"84956f239080dc596c013b8af842e818c1eaf14d27b30c55976faff193b2783c"} Jul 09 02:05:12.398344 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:12.398295 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" podStartSLOduration=1.398281041 podStartE2EDuration="1.398281041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:05:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:05:12.396864561 +0000 UTC m=+1633.370337179" watchObservedRunningTime="2026-07-09 02:05:12.398281041 +0000 UTC m=+1633.371753705" Jul 09 02:05:12.541492 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:12.541445 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:12.546183 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:12.546154 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:13.382387 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:13.382355 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:13.383306 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:13.383287 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:14.360541 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:14.360499 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:14.457866 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:14.457835 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:14.573678 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:14.573639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:14.803779 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:14.803741 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:14.997281 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:14.997239 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:15.097453 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:15.097356 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:18.864510 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:18.864471 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:19.220090 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:19.219993 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:05:21.421562 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:21.421514 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:21.519876 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:21.519836 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:27.449779 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:27.449665 2565 generic.go:356] "Generic (PLEG): container finished" podID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerID="24c3dc6fd827206381bbd8a1002c70d8e499ac080021e020f37d4749a36b95ca" exitCode=0 Jul 09 02:05:27.449779 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:27.449710 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" event={"ID":"de7f17a5-f425-407f-9ceb-56c2177e0511","Type":"ContainerDied","Data":"24c3dc6fd827206381bbd8a1002c70d8e499ac080021e020f37d4749a36b95ca"} Jul 09 02:05:27.450371 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:27.450224 2565 scope.go:117] "RemoveContainer" containerID="24c3dc6fd827206381bbd8a1002c70d8e499ac080021e020f37d4749a36b95ca" Jul 09 02:05:27.451341 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:27.451308 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:05:27.451460 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:27.451394 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:05:27.451460 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:27.451443 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:05:28.382815 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:28.382772 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:28.456040 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:28.456005 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" event={"ID":"de7f17a5-f425-407f-9ceb-56c2177e0511","Type":"ContainerStarted","Data":"9c7c760e27c0039935b46f7ea9609b8d1b5496f7a56a3e78683008786c4d0ce9"} Jul 09 02:05:28.540956 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:28.540912 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:28.541986 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:28.541959 2565 patch_prober.go:28] interesting pod/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 09 02:05:28.542105 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:28.542009 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" podUID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 09 02:05:29.541582 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:29.541538 2565 patch_prober.go:28] interesting pod/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 09 02:05:29.542050 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:29.541613 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" podUID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 09 02:05:30.540895 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:30.540859 2565 patch_prober.go:28] interesting pod/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 09 02:05:30.541079 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:30.540913 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" podUID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 09 02:05:31.540956 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:31.540918 2565 patch_prober.go:28] interesting pod/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 09 02:05:31.541384 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:31.540972 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" podUID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 09 02:05:32.544884 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:32.544851 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:32.545291 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:32.545114 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:32.545911 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:32.545892 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:05:34.487388 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:34.487356 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:36.628807 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:36.628766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:36.730657 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:36.730619 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:05:37.713599 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:05:37.713562 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:06:04.327424 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:06:04.327385 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:06:06.613806 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:06:06.613770 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:06:06.991863 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:06:06.991825 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:06:12.669637 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:06:12.669597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:06:15.121451 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:06:15.121417 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:06:17.701200 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:06:17.701163 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:06:53.872060 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:06:53.872016 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:06:54.875236 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:06:54.875201 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:06:57.120437 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:06:57.120403 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:07:00.477610 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:00.477549 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:00.538903 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:00.538868 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:00.738659 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:00.738623 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq"] Jul 09 02:07:00.738900 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:00.738876 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" podUID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerName="istio-proxy" containerID="cri-o://9c7c760e27c0039935b46f7ea9609b8d1b5496f7a56a3e78683008786c4d0ce9" gracePeriod=30 Jul 09 02:07:00.766681 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:00.766651 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:02.030130 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:02.030065 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:02.126023 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:02.125984 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:02.226206 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:02.226135 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:02.547205 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:02.547169 2565 patch_prober.go:28] interesting pod/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 02:07:02.547369 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:02.547229 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" podUID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 02:07:02.994511 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:02.994483 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:03.091045 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:03.091004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:03.189411 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:03.189378 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:04.518913 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:04.518881 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:05.867005 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:05.866965 2565 generic.go:356] "Generic (PLEG): container finished" podID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerID="9c7c760e27c0039935b46f7ea9609b8d1b5496f7a56a3e78683008786c4d0ce9" exitCode=0 Jul 09 02:07:05.867399 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:05.867041 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" event={"ID":"de7f17a5-f425-407f-9ceb-56c2177e0511","Type":"ContainerDied","Data":"9c7c760e27c0039935b46f7ea9609b8d1b5496f7a56a3e78683008786c4d0ce9"} Jul 09 02:07:05.867399 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:05.867104 2565 scope.go:117] "RemoveContainer" containerID="24c3dc6fd827206381bbd8a1002c70d8e499ac080021e020f37d4749a36b95ca" Jul 09 02:07:05.995311 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:05.995280 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:07:06.077319 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077230 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-data\") pod \"de7f17a5-f425-407f-9ceb-56c2177e0511\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " Jul 09 02:07:06.077319 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077311 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhfkr\" (UniqueName: \"kubernetes.io/projected/de7f17a5-f425-407f-9ceb-56c2177e0511-kube-api-access-nhfkr\") pod \"de7f17a5-f425-407f-9ceb-56c2177e0511\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " Jul 09 02:07:06.077552 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077351 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-podinfo\") pod \"de7f17a5-f425-407f-9ceb-56c2177e0511\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " Jul 09 02:07:06.077552 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077374 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-token\") pod \"de7f17a5-f425-407f-9ceb-56c2177e0511\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " Jul 09 02:07:06.077552 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077400 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-workload-certs\") pod \"de7f17a5-f425-407f-9ceb-56c2177e0511\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " Jul 09 02:07:06.077552 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077501 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-credential-socket\") pod \"de7f17a5-f425-407f-9ceb-56c2177e0511\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " Jul 09 02:07:06.077552 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077550 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7f17a5-f425-407f-9ceb-56c2177e0511-istiod-ca-cert\") pod \"de7f17a5-f425-407f-9ceb-56c2177e0511\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " Jul 09 02:07:06.077819 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077578 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-workload-socket\") pod \"de7f17a5-f425-407f-9ceb-56c2177e0511\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " Jul 09 02:07:06.077819 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077649 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de7f17a5-f425-407f-9ceb-56c2177e0511" (UID: "de7f17a5-f425-407f-9ceb-56c2177e0511"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:07:06.077819 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077660 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-envoy\") pod \"de7f17a5-f425-407f-9ceb-56c2177e0511\" (UID: \"de7f17a5-f425-407f-9ceb-56c2177e0511\") " Jul 09 02:07:06.077994 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077834 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de7f17a5-f425-407f-9ceb-56c2177e0511" (UID: "de7f17a5-f425-407f-9ceb-56c2177e0511"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:07:06.077994 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077866 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de7f17a5-f425-407f-9ceb-56c2177e0511-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de7f17a5-f425-407f-9ceb-56c2177e0511" (UID: "de7f17a5-f425-407f-9ceb-56c2177e0511"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:07:06.077994 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077965 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-workload-certs\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:07:06.077994 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077983 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7f17a5-f425-407f-9ceb-56c2177e0511-istiod-ca-cert\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:07:06.078234 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.077997 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-workload-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:07:06.078234 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.078072 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-data" (OuterVolumeSpecName: "istio-data") pod "de7f17a5-f425-407f-9ceb-56c2177e0511" (UID: "de7f17a5-f425-407f-9ceb-56c2177e0511"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:07:06.078371 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.078344 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de7f17a5-f425-407f-9ceb-56c2177e0511" (UID: "de7f17a5-f425-407f-9ceb-56c2177e0511"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:07:06.079712 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.079683 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de7f17a5-f425-407f-9ceb-56c2177e0511-kube-api-access-nhfkr" (OuterVolumeSpecName: "kube-api-access-nhfkr") pod "de7f17a5-f425-407f-9ceb-56c2177e0511" (UID: "de7f17a5-f425-407f-9ceb-56c2177e0511"). InnerVolumeSpecName "kube-api-access-nhfkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:07:06.079712 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.079690 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de7f17a5-f425-407f-9ceb-56c2177e0511" (UID: "de7f17a5-f425-407f-9ceb-56c2177e0511"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 02:07:06.079858 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.079840 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de7f17a5-f425-407f-9ceb-56c2177e0511" (UID: "de7f17a5-f425-407f-9ceb-56c2177e0511"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:07:06.079906 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.079892 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-token" (OuterVolumeSpecName: "istio-token") pod "de7f17a5-f425-407f-9ceb-56c2177e0511" (UID: "de7f17a5-f425-407f-9ceb-56c2177e0511"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:07:06.179246 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.179208 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-credential-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:07:06.179246 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.179241 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-envoy\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:07:06.179246 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.179251 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-data\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:07:06.179246 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.179259 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhfkr\" (UniqueName: \"kubernetes.io/projected/de7f17a5-f425-407f-9ceb-56c2177e0511-kube-api-access-nhfkr\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:07:06.179524 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.179270 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-podinfo\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:07:06.179524 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.179278 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7f17a5-f425-407f-9ceb-56c2177e0511-istio-token\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:07:06.723206 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.723168 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:07:06.873069 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.873033 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" event={"ID":"de7f17a5-f425-407f-9ceb-56c2177e0511","Type":"ContainerDied","Data":"84956f239080dc596c013b8af842e818c1eaf14d27b30c55976faff193b2783c"} Jul 09 02:07:06.873069 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.873055 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq" Jul 09 02:07:06.873581 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.873092 2565 scope.go:117] "RemoveContainer" containerID="9c7c760e27c0039935b46f7ea9609b8d1b5496f7a56a3e78683008786c4d0ce9" Jul 09 02:07:06.894423 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.894335 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq"] Jul 09 02:07:06.896095 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:06.896072 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bafacff2-openshift-default-5dc47d84bc-crjsq"] Jul 09 02:07:07.563261 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:07.563227 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de7f17a5-f425-407f-9ceb-56c2177e0511" path="/var/lib/kubelet/pods/de7f17a5-f425-407f-9ceb-56c2177e0511/volumes" Jul 09 02:07:10.406443 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:10.406406 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:10.473297 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:10.473258 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:11.074561 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:11.074530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:16.884795 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:16.884761 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:16.942576 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:16.942541 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:17.042655 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:17.042605 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:17.133563 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:17.133530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:17.623029 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:17.622987 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:07:27.608929 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:27.608890 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:27.942194 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:27.942101 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:48.868340 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:48.868291 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:54.653314 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:54.653225 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:54.718254 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:54.718210 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:54.980593 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:54.980556 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:55.270156 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.270066 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d"] Jul 09 02:07:55.270426 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.270411 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" containerName="istio-proxy" Jul 09 02:07:55.270468 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.270427 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d06deb10-4c43-4c2f-9a4d-76fc42cabe95" containerName="istio-proxy" Jul 09 02:07:55.270468 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.270439 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerName="istio-proxy" Jul 09 02:07:55.270468 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.270445 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerName="istio-proxy" Jul 09 02:07:55.270468 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.270451 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerName="istio-proxy" Jul 09 02:07:55.270468 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.270457 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerName="istio-proxy" Jul 09 02:07:55.270648 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.270519 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerName="istio-proxy" Jul 09 02:07:55.270648 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.270527 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="de7f17a5-f425-407f-9ceb-56c2177e0511" containerName="istio-proxy" Jul 09 02:07:55.273530 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.273514 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.276766 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.276748 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-528913-openshift-default-dockercfg-bxqhv\"" Jul 09 02:07:55.288503 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.288476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-data\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.288633 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.288518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-workload-socket\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.288704 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.288629 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-podinfo\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.288704 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.288669 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9h7g\" (UniqueName: \"kubernetes.io/projected/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-kube-api-access-x9h7g\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.288866 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.288700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istiod-ca-cert\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.288866 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.288776 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-workload-certs\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.288866 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.288800 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-envoy\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.288866 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.288854 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-token\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.289014 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.288898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-credential-socket\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.290432 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.290410 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d"] Jul 09 02:07:55.297410 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.297380 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:55.389447 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.389404 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-podinfo\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.389447 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.389450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9h7g\" (UniqueName: \"kubernetes.io/projected/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-kube-api-access-x9h7g\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.389722 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.389480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istiod-ca-cert\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.389722 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.389526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-workload-certs\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.389722 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.389546 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-envoy\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.389722 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.389566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-token\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.389722 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.389596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-credential-socket\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.389722 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.389651 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-data\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.389722 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.389680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-workload-socket\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.390119 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.390093 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-data\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.390215 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.390129 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-workload-socket\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.390275 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.390228 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-workload-certs\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.390454 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.390436 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istiod-ca-cert\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.390507 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.390489 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-credential-socket\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.392297 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.392278 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-envoy\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.392618 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.392603 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-podinfo\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.399894 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.399872 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-token\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.400312 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.400290 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9h7g\" (UniqueName: \"kubernetes.io/projected/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-kube-api-access-x9h7g\") pod \"e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.585117 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.585019 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:55.722760 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.722722 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:55.731713 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.731680 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d"] Jul 09 02:07:55.735975 ip-10-0-130-184 kubenswrapper[2565]: W0709 02:07:55.735947 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80b889d_82f1_4a38_bd04_5cc0d4f37f5c.slice/crio-07fb53682bf7f6a33d85dd263dd84667d356eb44a80bfaead10564263cde7355 WatchSource:0}: Error finding container 07fb53682bf7f6a33d85dd263dd84667d356eb44a80bfaead10564263cde7355: Status 404 returned error can't find the container with id 07fb53682bf7f6a33d85dd263dd84667d356eb44a80bfaead10564263cde7355 Jul 09 02:07:55.737949 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.737916 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:07:55.738032 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.737985 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:07:55.738032 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:55.738010 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:07:56.081621 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:56.081585 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" event={"ID":"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c","Type":"ContainerStarted","Data":"5fb672b59404bb728d2f1e854c902a2c3aadacc8519f70bbc5cae17b6eb97457"} Jul 09 02:07:56.081796 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:56.081640 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" event={"ID":"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c","Type":"ContainerStarted","Data":"07fb53682bf7f6a33d85dd263dd84667d356eb44a80bfaead10564263cde7355"} Jul 09 02:07:56.104703 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:56.104653 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" podStartSLOduration=1.104633049 podStartE2EDuration="1.104633049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:07:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:07:56.102565618 +0000 UTC m=+1797.076038242" watchObservedRunningTime="2026-07-09 02:07:56.104633049 +0000 UTC m=+1797.078105733" Jul 09 02:07:56.585243 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:56.585205 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:56.590303 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:56.590273 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:57.086026 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:57.085989 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:57.087162 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:57.087124 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:07:58.127419 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:58.127319 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:58.273749 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:58.273720 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:58.471898 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:58.471789 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:58.636498 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:58.636463 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:59.019162 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:59.019093 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:59.119973 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:59.119921 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:07:59.588778 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:59.588747 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 02:07:59.589659 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:07:59.589630 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 02:08:02.586328 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:02.586291 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:02.919532 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:02.919433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:03.230301 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:03.230272 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:03.500477 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:03.500378 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:05.118776 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:05.118737 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:08:09.777158 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:09.777111 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:09.954543 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:09.954499 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:10.045824 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:10.045720 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:10.510040 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:10.510010 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:10.614230 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:10.614198 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:10.711182 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:10.711124 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:12.937934 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:12.937267 2565 patch_prober.go:28] interesting pod/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": read tcp 10.133.0.2:36396->10.133.0.31:15021: read: connection reset by peer" start-of-body= Jul 09 02:08:12.937934 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:12.937334 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" podUID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": read tcp 10.133.0.2:36396->10.133.0.31:15021: read: connection reset by peer" Jul 09 02:08:13.156270 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:13.156189 2565 generic.go:356] "Generic (PLEG): container finished" podID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerID="5fb672b59404bb728d2f1e854c902a2c3aadacc8519f70bbc5cae17b6eb97457" exitCode=0 Jul 09 02:08:13.156270 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:13.156230 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" event={"ID":"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c","Type":"ContainerDied","Data":"5fb672b59404bb728d2f1e854c902a2c3aadacc8519f70bbc5cae17b6eb97457"} Jul 09 02:08:13.156624 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:13.156609 2565 scope.go:117] "RemoveContainer" containerID="5fb672b59404bb728d2f1e854c902a2c3aadacc8519f70bbc5cae17b6eb97457" Jul 09 02:08:13.157564 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:13.157534 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:08:13.157625 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:13.157600 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:08:13.157668 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:13.157632 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:08:14.161973 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:14.161937 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" event={"ID":"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c","Type":"ContainerStarted","Data":"adfe7f492856086815ee88e074d12d5b18f338a193dda987c2b27a5e08c14755"} Jul 09 02:08:14.253244 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:14.253205 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:14.585716 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:14.585671 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:08:14.585945 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:14.585921 2565 patch_prober.go:28] interesting pod/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 09 02:08:14.585997 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:14.585981 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" podUID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 09 02:08:15.585569 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:15.585528 2565 patch_prober.go:28] interesting pod/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 09 02:08:15.585931 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:15.585587 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" podUID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 09 02:08:16.585841 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:16.585798 2565 patch_prober.go:28] interesting pod/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 09 02:08:16.586341 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:16.585861 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" podUID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 09 02:08:17.586351 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:17.586313 2565 patch_prober.go:28] interesting pod/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 09 02:08:17.586749 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:17.586375 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" podUID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 09 02:08:18.589083 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:18.589050 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:08:18.589521 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:18.589418 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:08:18.590024 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:18.590006 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:08:19.488412 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:19.488369 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:19.916767 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:19.916678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:20.021631 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:20.021602 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:22.418912 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:22.418871 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:08:23.534559 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:23.534522 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:32.373341 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:32.373303 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:32.474373 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:32.474343 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:37.718664 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:37.718628 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:08:47.358604 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.358566 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8"] Jul 09 02:08:47.361641 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.361620 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.365388 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.365360 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-65e1b4\"/\"default-dockercfg-pmwxw\"" Jul 09 02:08:47.365388 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.365366 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-65e1b4\"/\"kube-root-ca.crt\"" Jul 09 02:08:47.365596 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.365426 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-65e1b4\"/\"test-model-65e1b4-kserve-self-signed-certs\"" Jul 09 02:08:47.365596 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.365441 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-65e1b4\"/\"openshift-service-ca.crt\"" Jul 09 02:08:47.371003 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.370973 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8"] Jul 09 02:08:47.391479 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.391439 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:47.468844 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.468800 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-dshm\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.469021 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.468855 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-home\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.469021 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.468903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce348fb7-caff-4d87-a67d-143b1eaecfa8-tls-certs\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.469021 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.468929 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-model-cache\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.469021 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.468984 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-tmp-dir\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.469021 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.469004 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlrnn\" (UniqueName: \"kubernetes.io/projected/ce348fb7-caff-4d87-a67d-143b1eaecfa8-kube-api-access-dlrnn\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.569441 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.569405 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-tmp-dir\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.569441 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.569443 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlrnn\" (UniqueName: \"kubernetes.io/projected/ce348fb7-caff-4d87-a67d-143b1eaecfa8-kube-api-access-dlrnn\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.569694 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.569480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-dshm\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.569694 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.569523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-home\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.569694 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.569549 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce348fb7-caff-4d87-a67d-143b1eaecfa8-tls-certs\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.569694 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.569601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-model-cache\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.569887 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.569799 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-tmp-dir\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.569887 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.569877 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-home\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.570015 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.569998 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-model-cache\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.571918 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.571884 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-dshm\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.571918 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.571889 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce348fb7-caff-4d87-a67d-143b1eaecfa8-tls-certs\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.577746 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.577726 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlrnn\" (UniqueName: \"kubernetes.io/projected/ce348fb7-caff-4d87-a67d-143b1eaecfa8-kube-api-access-dlrnn\") pod \"test-model-65e1b4-kserve-5db6899b67-7hvd8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.672575 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.672485 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:47.806703 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:47.806509 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8"] Jul 09 02:08:47.809251 ip-10-0-130-184 kubenswrapper[2565]: W0709 02:08:47.809224 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce348fb7_caff_4d87_a67d_143b1eaecfa8.slice/crio-61ce6a2f67605505b227b38a87b7d69b3dba6de2ded05e545bae10a816db60c3 WatchSource:0}: Error finding container 61ce6a2f67605505b227b38a87b7d69b3dba6de2ded05e545bae10a816db60c3: Status 404 returned error can't find the container with id 61ce6a2f67605505b227b38a87b7d69b3dba6de2ded05e545bae10a816db60c3 Jul 09 02:08:48.305395 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:48.305356 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" event={"ID":"ce348fb7-caff-4d87-a67d-143b1eaecfa8","Type":"ContainerStarted","Data":"7d5d19700bbd0fff6be28820172a93cca4c156fcd9c7e9c4d89e3e2958dc17ba"} Jul 09 02:08:48.305590 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:48.305405 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" event={"ID":"ce348fb7-caff-4d87-a67d-143b1eaecfa8","Type":"ContainerStarted","Data":"61ce6a2f67605505b227b38a87b7d69b3dba6de2ded05e545bae10a816db60c3"} Jul 09 02:08:48.325102 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:48.325045 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" podStartSLOduration=1.325030683 podStartE2EDuration="1.325030683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:08:48.323316558 +0000 UTC m=+1849.296789179" watchObservedRunningTime="2026-07-09 02:08:48.325030683 +0000 UTC m=+1849.298503303" Jul 09 02:08:53.818088 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:53.818045 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:08:57.673085 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:57.673046 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:57.673085 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:57.673092 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:57.685873 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:57.685841 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:08:58.006314 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:58.006277 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:08:58.357705 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:08:58.357613 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:09:07.419557 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:07.419515 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:09:08.596839 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:08.596800 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:09.466438 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:09.466392 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8"] Jul 09 02:09:09.490190 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:09.490157 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:09.668264 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:09.668213 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:10.050906 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:10.050872 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:10.149843 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:10.149806 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:10.251962 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:10.251920 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:10.418108 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:10.418014 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:15.114977 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:15.114906 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:20.119865 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:20.119825 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:09:24.487242 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.487198 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" podUID="ce348fb7-caff-4d87-a67d-143b1eaecfa8" containerName="main" containerID="cri-o://7d5d19700bbd0fff6be28820172a93cca4c156fcd9c7e9c4d89e3e2958dc17ba" gracePeriod=45 Jul 09 02:09:24.743237 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.743172 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:09:24.797572 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.797527 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-tmp-dir\") pod \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " Jul 09 02:09:24.797572 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.797578 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-home\") pod \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " Jul 09 02:09:24.797824 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.797613 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-dshm\") pod \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " Jul 09 02:09:24.797824 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.797631 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-model-cache\") pod \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " Jul 09 02:09:24.797824 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.797653 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlrnn\" (UniqueName: \"kubernetes.io/projected/ce348fb7-caff-4d87-a67d-143b1eaecfa8-kube-api-access-dlrnn\") pod \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " Jul 09 02:09:24.797824 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.797707 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce348fb7-caff-4d87-a67d-143b1eaecfa8-tls-certs\") pod \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\" (UID: \"ce348fb7-caff-4d87-a67d-143b1eaecfa8\") " Jul 09 02:09:24.798043 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.797852 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ce348fb7-caff-4d87-a67d-143b1eaecfa8" (UID: "ce348fb7-caff-4d87-a67d-143b1eaecfa8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:09:24.798043 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.797922 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-model-cache" (OuterVolumeSpecName: "model-cache") pod "ce348fb7-caff-4d87-a67d-143b1eaecfa8" (UID: "ce348fb7-caff-4d87-a67d-143b1eaecfa8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:09:24.798043 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.797935 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-home" (OuterVolumeSpecName: "home") pod "ce348fb7-caff-4d87-a67d-143b1eaecfa8" (UID: "ce348fb7-caff-4d87-a67d-143b1eaecfa8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:09:24.798043 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.797993 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-tmp-dir\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:24.798043 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.798008 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-home\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:24.798043 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.798021 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-model-cache\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:24.799950 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.799922 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-dshm" (OuterVolumeSpecName: "dshm") pod "ce348fb7-caff-4d87-a67d-143b1eaecfa8" (UID: "ce348fb7-caff-4d87-a67d-143b1eaecfa8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:09:24.799950 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.799927 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce348fb7-caff-4d87-a67d-143b1eaecfa8-kube-api-access-dlrnn" (OuterVolumeSpecName: "kube-api-access-dlrnn") pod "ce348fb7-caff-4d87-a67d-143b1eaecfa8" (UID: "ce348fb7-caff-4d87-a67d-143b1eaecfa8"). InnerVolumeSpecName "kube-api-access-dlrnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:09:24.800127 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.799932 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce348fb7-caff-4d87-a67d-143b1eaecfa8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ce348fb7-caff-4d87-a67d-143b1eaecfa8" (UID: "ce348fb7-caff-4d87-a67d-143b1eaecfa8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:09:24.899358 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.899319 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce348fb7-caff-4d87-a67d-143b1eaecfa8-dshm\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:24.899358 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.899352 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlrnn\" (UniqueName: \"kubernetes.io/projected/ce348fb7-caff-4d87-a67d-143b1eaecfa8-kube-api-access-dlrnn\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:24.899358 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:24.899363 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce348fb7-caff-4d87-a67d-143b1eaecfa8-tls-certs\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:25.466041 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:25.466008 2565 generic.go:356] "Generic (PLEG): container finished" podID="ce348fb7-caff-4d87-a67d-143b1eaecfa8" containerID="7d5d19700bbd0fff6be28820172a93cca4c156fcd9c7e9c4d89e3e2958dc17ba" exitCode=0 Jul 09 02:09:25.466244 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:25.466048 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" Jul 09 02:09:25.466244 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:25.466102 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" event={"ID":"ce348fb7-caff-4d87-a67d-143b1eaecfa8","Type":"ContainerDied","Data":"7d5d19700bbd0fff6be28820172a93cca4c156fcd9c7e9c4d89e3e2958dc17ba"} Jul 09 02:09:25.466244 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:25.466163 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8" event={"ID":"ce348fb7-caff-4d87-a67d-143b1eaecfa8","Type":"ContainerDied","Data":"61ce6a2f67605505b227b38a87b7d69b3dba6de2ded05e545bae10a816db60c3"} Jul 09 02:09:25.466244 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:25.466185 2565 scope.go:117] "RemoveContainer" containerID="7d5d19700bbd0fff6be28820172a93cca4c156fcd9c7e9c4d89e3e2958dc17ba" Jul 09 02:09:25.474663 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:25.474647 2565 scope.go:117] "RemoveContainer" containerID="7d5d19700bbd0fff6be28820172a93cca4c156fcd9c7e9c4d89e3e2958dc17ba" Jul 09 02:09:25.474921 ip-10-0-130-184 kubenswrapper[2565]: E0709 02:09:25.474903 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d5d19700bbd0fff6be28820172a93cca4c156fcd9c7e9c4d89e3e2958dc17ba\": container with ID starting with 7d5d19700bbd0fff6be28820172a93cca4c156fcd9c7e9c4d89e3e2958dc17ba not found: ID does not exist" containerID="7d5d19700bbd0fff6be28820172a93cca4c156fcd9c7e9c4d89e3e2958dc17ba" Jul 09 02:09:25.474966 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:25.474930 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d5d19700bbd0fff6be28820172a93cca4c156fcd9c7e9c4d89e3e2958dc17ba"} err="failed to get container status \"7d5d19700bbd0fff6be28820172a93cca4c156fcd9c7e9c4d89e3e2958dc17ba\": rpc error: code = NotFound desc = could not find container \"7d5d19700bbd0fff6be28820172a93cca4c156fcd9c7e9c4d89e3e2958dc17ba\": container with ID starting with 7d5d19700bbd0fff6be28820172a93cca4c156fcd9c7e9c4d89e3e2958dc17ba not found: ID does not exist" Jul 09 02:09:25.487248 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:25.487221 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8"] Jul 09 02:09:25.491947 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:25.491923 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-65e1b4/test-model-65e1b4-kserve-5db6899b67-7hvd8"] Jul 09 02:09:25.563285 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:25.563249 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce348fb7-caff-4d87-a67d-143b1eaecfa8" path="/var/lib/kubelet/pods/ce348fb7-caff-4d87-a67d-143b1eaecfa8/volumes" Jul 09 02:09:25.990286 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:25.990256 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:26.041519 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:26.041484 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:31.834644 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:31.834604 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:52.236864 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:52.236825 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:52.474794 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:52.474760 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d"] Jul 09 02:09:52.474989 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:52.474965 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" podUID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerName="istio-proxy" containerID="cri-o://adfe7f492856086815ee88e074d12d5b18f338a193dda987c2b27a5e08c14755" gracePeriod=30 Jul 09 02:09:53.637041 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:53.637008 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:56.722275 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:56.722238 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:09:57.607759 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.607718 2565 generic.go:356] "Generic (PLEG): container finished" podID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerID="adfe7f492856086815ee88e074d12d5b18f338a193dda987c2b27a5e08c14755" exitCode=0 Jul 09 02:09:57.607958 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.607785 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" event={"ID":"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c","Type":"ContainerDied","Data":"adfe7f492856086815ee88e074d12d5b18f338a193dda987c2b27a5e08c14755"} Jul 09 02:09:57.607958 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.607859 2565 scope.go:117] "RemoveContainer" containerID="5fb672b59404bb728d2f1e854c902a2c3aadacc8519f70bbc5cae17b6eb97457" Jul 09 02:09:57.735967 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.735904 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:09:57.874735 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.874707 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-envoy\") pod \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " Jul 09 02:09:57.874926 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.874749 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-workload-certs\") pod \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " Jul 09 02:09:57.874926 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.874775 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-workload-socket\") pod \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " Jul 09 02:09:57.874926 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.874797 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9h7g\" (UniqueName: \"kubernetes.io/projected/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-kube-api-access-x9h7g\") pod \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " Jul 09 02:09:57.874926 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.874844 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-podinfo\") pod \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " Jul 09 02:09:57.874926 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.874862 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-credential-socket\") pod \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " Jul 09 02:09:57.874926 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.874885 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-data\") pod \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " Jul 09 02:09:57.874926 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.874913 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istiod-ca-cert\") pod \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " Jul 09 02:09:57.875324 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.874960 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-token\") pod \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\" (UID: \"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c\") " Jul 09 02:09:57.875324 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.875047 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" (UID: "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:09:57.875324 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.875105 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" (UID: "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:09:57.875324 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.875228 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-workload-certs\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:57.875324 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.875248 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-workload-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:57.875586 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.875454 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" (UID: "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:09:57.875586 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.875468 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" (UID: "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:09:57.876051 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.876018 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-data" (OuterVolumeSpecName: "istio-data") pod "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" (UID: "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:09:57.877033 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.877004 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" (UID: "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:09:57.877161 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.877065 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" (UID: "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 02:09:57.877221 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.877175 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-kube-api-access-x9h7g" (OuterVolumeSpecName: "kube-api-access-x9h7g") pod "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" (UID: "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c"). InnerVolumeSpecName "kube-api-access-x9h7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:09:57.877314 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.877296 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-token" (OuterVolumeSpecName: "istio-token") pod "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" (UID: "b80b889d-82f1-4a38-bd04-5cc0d4f37f5c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:09:57.976162 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.976096 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-token\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:57.976162 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.976130 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-envoy\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:57.976162 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.976161 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9h7g\" (UniqueName: \"kubernetes.io/projected/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-kube-api-access-x9h7g\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:57.976162 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.976171 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-podinfo\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:57.976431 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.976180 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-credential-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:57.976431 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.976190 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istio-data\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:57.976431 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:57.976198 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c-istiod-ca-cert\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:09:58.613337 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:58.613306 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" Jul 09 02:09:58.613511 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:58.613308 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d" event={"ID":"b80b889d-82f1-4a38-bd04-5cc0d4f37f5c","Type":"ContainerDied","Data":"07fb53682bf7f6a33d85dd263dd84667d356eb44a80bfaead10564263cde7355"} Jul 09 02:09:58.613511 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:58.613449 2565 scope.go:117] "RemoveContainer" containerID="adfe7f492856086815ee88e074d12d5b18f338a193dda987c2b27a5e08c14755" Jul 09 02:09:58.635057 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:58.635026 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d"] Jul 09 02:09:58.639306 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:58.639276 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-528913-openshift-default-59b6c94d65-pw49d"] Jul 09 02:09:59.029574 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:59.029532 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:59.089166 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:59.089112 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:59.315253 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:59.315170 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:09:59.563531 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:59.563497 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" path="/var/lib/kubelet/pods/b80b889d-82f1-4a38-bd04-5cc0d4f37f5c/volumes" Jul 09 02:09:59.913199 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:09:59.913081 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:00.302198 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.302157 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp"] Jul 09 02:10:00.302606 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.302589 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce348fb7-caff-4d87-a67d-143b1eaecfa8" containerName="main" Jul 09 02:10:00.302651 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.302610 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce348fb7-caff-4d87-a67d-143b1eaecfa8" containerName="main" Jul 09 02:10:00.302651 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.302636 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerName="istio-proxy" Jul 09 02:10:00.302651 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.302645 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerName="istio-proxy" Jul 09 02:10:00.302764 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.302655 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerName="istio-proxy" Jul 09 02:10:00.302764 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.302663 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerName="istio-proxy" Jul 09 02:10:00.302764 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.302749 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerName="istio-proxy" Jul 09 02:10:00.302764 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.302760 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b80b889d-82f1-4a38-bd04-5cc0d4f37f5c" containerName="istio-proxy" Jul 09 02:10:00.302890 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.302768 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce348fb7-caff-4d87-a67d-143b1eaecfa8" containerName="main" Jul 09 02:10:00.307360 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.307341 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.309963 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.309941 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-fbb202-openshift-default-dockercfg-lcg7z\"" Jul 09 02:10:00.335673 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.335643 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp"] Jul 09 02:10:00.355640 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.355608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:00.396375 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.396345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-podinfo\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.396564 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.396382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istiod-ca-cert\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.396564 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.396408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-data\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.396564 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.396461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-credential-socket\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.396564 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.396489 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-envoy\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.396564 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.396520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-token\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.396564 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.396543 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-workload-socket\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.396795 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.396570 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28w8q\" (UniqueName: \"kubernetes.io/projected/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-kube-api-access-28w8q\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.396795 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.396625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-workload-certs\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.497583 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.497544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-data\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.497795 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.497592 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-credential-socket\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.497795 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.497613 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-envoy\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.497795 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.497669 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-token\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.497795 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.497724 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-workload-socket\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.497795 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.497763 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28w8q\" (UniqueName: \"kubernetes.io/projected/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-kube-api-access-28w8q\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.497795 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.497789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-workload-certs\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.498103 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.497908 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-podinfo\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.498103 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.497947 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istiod-ca-cert\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.498286 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.498234 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-workload-socket\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.498413 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.498300 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-data\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.498413 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.498307 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-workload-certs\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.498553 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.498529 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-credential-socket\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.498714 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.498686 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istiod-ca-cert\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.500019 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.499990 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-envoy\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.500434 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.500418 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-podinfo\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.505957 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.505929 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-token\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.508254 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.506452 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28w8q\" (UniqueName: \"kubernetes.io/projected/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-kube-api-access-28w8q\") pod \"e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.618705 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.618614 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:00.759042 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.759013 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp"] Jul 09 02:10:00.761346 ip-10-0-130-184 kubenswrapper[2565]: W0709 02:10:00.761311 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087d2675_9bbb_424a_a6a2_ba2bdc9fd8b0.slice/crio-23538f9b295d49426c86285ecf68fa2190d6ff99666e9157ec9d57bcf6d573d5 WatchSource:0}: Error finding container 23538f9b295d49426c86285ecf68fa2190d6ff99666e9157ec9d57bcf6d573d5: Status 404 returned error can't find the container with id 23538f9b295d49426c86285ecf68fa2190d6ff99666e9157ec9d57bcf6d573d5 Jul 09 02:10:00.763862 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.763822 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:00.763928 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.763910 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:00.763976 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.763951 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:00.874864 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:00.874777 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:01.629183 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:01.629122 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" event={"ID":"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0","Type":"ContainerStarted","Data":"02b74b9da7f49c3fcab2a322278e7f5630693bc775fb266b42f5f0c3db4d0bd9"} Jul 09 02:10:01.629639 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:01.629203 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" event={"ID":"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0","Type":"ContainerStarted","Data":"23538f9b295d49426c86285ecf68fa2190d6ff99666e9157ec9d57bcf6d573d5"} Jul 09 02:10:01.651446 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:01.651388 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" podStartSLOduration=1.651367824 podStartE2EDuration="1.651367824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:10:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:10:01.649803058 +0000 UTC m=+1922.623275679" watchObservedRunningTime="2026-07-09 02:10:01.651367824 +0000 UTC m=+1922.624840445" Jul 09 02:10:02.619877 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:02.619841 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:02.624675 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:02.624646 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:02.632982 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:02.632951 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:02.633898 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:02.633880 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:03.562463 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:03.562429 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:03.634484 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:03.634448 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:03.704863 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:03.704825 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:03.938833 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:03.938741 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:04.160061 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:04.160015 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:04.262615 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:04.262574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:08.083390 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.083343 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:08.554902 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.554869 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:08.823841 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.823760 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5"] Jul 09 02:10:08.827308 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.827287 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:08.829947 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.829916 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-8d3ee6-openshift-default-dockercfg-2g2bw\"" Jul 09 02:10:08.839614 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.839582 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5"] Jul 09 02:10:08.852722 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.852689 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:08.952115 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.952068 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:08.977280 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.977249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-podinfo\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:08.977418 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.977296 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-envoy\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:08.977418 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.977341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51463a3c-3c66-43fd-80b3-9bbb467f9612-istiod-ca-cert\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:08.977418 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.977373 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-credential-socket\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:08.977525 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.977416 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-workload-socket\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:08.977525 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.977444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-workload-certs\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:08.977525 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.977470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-data\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:08.977525 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.977491 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qllfq\" (UniqueName: \"kubernetes.io/projected/51463a3c-3c66-43fd-80b3-9bbb467f9612-kube-api-access-qllfq\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:08.977525 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:08.977510 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-token\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.078750 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.078652 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51463a3c-3c66-43fd-80b3-9bbb467f9612-istiod-ca-cert\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.078750 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.078723 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-credential-socket\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.078991 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.078758 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-workload-socket\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.078991 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.078776 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-workload-certs\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.078991 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.078809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-data\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.078991 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.078842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qllfq\" (UniqueName: \"kubernetes.io/projected/51463a3c-3c66-43fd-80b3-9bbb467f9612-kube-api-access-qllfq\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.078991 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.078861 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-token\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.078991 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.078904 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-podinfo\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.078991 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.078958 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-envoy\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.079394 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.079205 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-workload-socket\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.079394 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.079285 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-workload-certs\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.079394 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.079341 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-data\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.079557 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.079505 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51463a3c-3c66-43fd-80b3-9bbb467f9612-istiod-ca-cert\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.079557 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.079519 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-credential-socket\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.081273 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.081253 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-envoy\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.081520 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.081497 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-podinfo\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.088826 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.088795 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-token\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.089185 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.089163 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qllfq\" (UniqueName: \"kubernetes.io/projected/51463a3c-3c66-43fd-80b3-9bbb467f9612-kube-api-access-qllfq\") pod \"e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.141846 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.141800 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:09.281184 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.281152 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5"] Jul 09 02:10:09.283299 ip-10-0-130-184 kubenswrapper[2565]: W0709 02:10:09.283273 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51463a3c_3c66_43fd_80b3_9bbb467f9612.slice/crio-2672ea720964bea8acc8f40db95d2ca7b3c06121be222c3025fb72b75c915dbe WatchSource:0}: Error finding container 2672ea720964bea8acc8f40db95d2ca7b3c06121be222c3025fb72b75c915dbe: Status 404 returned error can't find the container with id 2672ea720964bea8acc8f40db95d2ca7b3c06121be222c3025fb72b75c915dbe Jul 09 02:10:09.285405 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.285375 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:09.285483 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.285439 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:09.285483 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.285469 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:09.664263 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.664167 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" event={"ID":"51463a3c-3c66-43fd-80b3-9bbb467f9612","Type":"ContainerStarted","Data":"e4430665d000a1f06f119152677039ca254740fbc33c2a07cbfd2a6689df217d"} Jul 09 02:10:09.664263 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.664226 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" event={"ID":"51463a3c-3c66-43fd-80b3-9bbb467f9612","Type":"ContainerStarted","Data":"2672ea720964bea8acc8f40db95d2ca7b3c06121be222c3025fb72b75c915dbe"} Jul 09 02:10:09.688029 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:09.687979 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" podStartSLOduration=1.687963349 podStartE2EDuration="1.687963349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:10:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:10:09.685930946 +0000 UTC m=+1930.659403567" watchObservedRunningTime="2026-07-09 02:10:09.687963349 +0000 UTC m=+1930.661436047" Jul 09 02:10:10.142914 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:10.142873 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:10.147788 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:10.147761 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:10.668114 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:10.668078 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:10.669080 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:10.669059 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:11.533126 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:11.533077 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:10:11.632838 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:11.632799 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:11.729753 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:11.729723 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:11.858917 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:11.858811 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:12.372582 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:12.372540 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:12.467316 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:12.467273 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:12.568896 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:12.568861 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:16.111177 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:16.111119 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:18.675348 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:18.675308 2565 patch_prober.go:28] interesting pod/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 02:10:18.675841 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:18.675387 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" podUID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 02:10:20.716772 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:20.716724 2565 generic.go:356] "Generic (PLEG): container finished" podID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerID="02b74b9da7f49c3fcab2a322278e7f5630693bc775fb266b42f5f0c3db4d0bd9" exitCode=0 Jul 09 02:10:20.717345 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:20.716875 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" event={"ID":"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0","Type":"ContainerDied","Data":"02b74b9da7f49c3fcab2a322278e7f5630693bc775fb266b42f5f0c3db4d0bd9"} Jul 09 02:10:20.717418 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:20.717381 2565 scope.go:117] "RemoveContainer" containerID="02b74b9da7f49c3fcab2a322278e7f5630693bc775fb266b42f5f0c3db4d0bd9" Jul 09 02:10:20.718675 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:20.718630 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:20.718774 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:20.718727 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:20.718839 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:20.718776 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:21.725709 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:21.725672 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" event={"ID":"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0","Type":"ContainerStarted","Data":"2872f64abfdd0359cd34785f17f65a6341a9075d52fe3053bcbf7d4a2993db15"} Jul 09 02:10:22.149921 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:22.149893 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:22.250429 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:22.250387 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:22.619930 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:22.619897 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:22.620356 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:22.620256 2565 patch_prober.go:28] interesting pod/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 09 02:10:22.620536 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:22.620513 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" podUID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 09 02:10:23.619454 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:23.619408 2565 patch_prober.go:28] interesting pod/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 09 02:10:23.620052 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:23.620020 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" podUID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 09 02:10:24.196099 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:24.196058 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:24.598540 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:24.598456 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:24.620160 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:24.619718 2565 patch_prober.go:28] interesting pod/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 09 02:10:24.620160 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:24.619792 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" podUID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 09 02:10:24.703885 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:24.703812 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:24.804356 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:24.804316 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:24.932978 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:24.932849 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:25.619864 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:25.619826 2565 patch_prober.go:28] interesting pod/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 09 02:10:25.620186 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:25.620153 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" podUID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 09 02:10:26.323476 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:26.323431 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:10:26.622740 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:26.622645 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:26.623169 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:26.622936 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:26.623766 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:26.623746 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:26.709380 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:26.709342 2565 patch_prober.go:28] interesting pod/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 02:10:26.709544 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:26.709411 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" podUID="51463a3c-3c66-43fd-80b3-9bbb467f9612" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 02:10:27.761297 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:27.761264 2565 generic.go:356] "Generic (PLEG): container finished" podID="51463a3c-3c66-43fd-80b3-9bbb467f9612" containerID="e4430665d000a1f06f119152677039ca254740fbc33c2a07cbfd2a6689df217d" exitCode=0 Jul 09 02:10:27.761712 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:27.761334 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" event={"ID":"51463a3c-3c66-43fd-80b3-9bbb467f9612","Type":"ContainerDied","Data":"e4430665d000a1f06f119152677039ca254740fbc33c2a07cbfd2a6689df217d"} Jul 09 02:10:27.761826 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:27.761806 2565 scope.go:117] "RemoveContainer" containerID="e4430665d000a1f06f119152677039ca254740fbc33c2a07cbfd2a6689df217d" Jul 09 02:10:27.762810 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:27.762784 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:27.762865 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:27.762850 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:27.762902 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:27.762886 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:28.767981 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:28.767946 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" event={"ID":"51463a3c-3c66-43fd-80b3-9bbb467f9612","Type":"ContainerStarted","Data":"f1a0cef024b60a0560174b45f85ee11d21f4a17736d45f27034c5d6a33d5e16d"} Jul 09 02:10:29.142233 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:29.142146 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:29.142403 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:29.142375 2565 patch_prober.go:28] interesting pod/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 09 02:10:29.142497 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:29.142473 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" podUID="51463a3c-3c66-43fd-80b3-9bbb467f9612" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 09 02:10:30.142816 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:30.142774 2565 patch_prober.go:28] interesting pod/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 09 02:10:30.143273 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:30.142847 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" podUID="51463a3c-3c66-43fd-80b3-9bbb467f9612" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 09 02:10:30.834772 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:30.834738 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:30.936186 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:30.936121 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:31.143246 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:31.143164 2565 patch_prober.go:28] interesting pod/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 09 02:10:31.143246 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:31.143217 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" podUID="51463a3c-3c66-43fd-80b3-9bbb467f9612" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 09 02:10:31.147556 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:31.147529 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp"] Jul 09 02:10:31.147717 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:31.147698 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" podUID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerName="istio-proxy" containerID="cri-o://2872f64abfdd0359cd34785f17f65a6341a9075d52fe3053bcbf7d4a2993db15" gracePeriod=30 Jul 09 02:10:31.228887 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:31.228851 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:31.524070 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:31.524030 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:31.944729 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:31.944640 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:32.088245 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:32.088203 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:32.142413 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:32.142374 2565 patch_prober.go:28] interesting pod/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 09 02:10:32.142595 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:32.142431 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" podUID="51463a3c-3c66-43fd-80b3-9bbb467f9612" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 09 02:10:32.187820 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:32.187782 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:32.388481 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:32.388450 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:33.146440 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:33.146408 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:33.146692 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:33.146664 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:33.147332 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:33.147313 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:36.329639 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.329597 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:10:36.408521 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.408454 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:36.536124 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536085 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-envoy\") pod \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " Jul 09 02:10:36.536321 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536135 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istiod-ca-cert\") pod \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " Jul 09 02:10:36.536321 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536175 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-token\") pod \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " Jul 09 02:10:36.536321 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536204 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-credential-socket\") pod \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " Jul 09 02:10:36.536321 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536230 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-podinfo\") pod \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " Jul 09 02:10:36.536321 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536253 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-data\") pod \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " Jul 09 02:10:36.536321 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536278 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-workload-certs\") pod \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " Jul 09 02:10:36.536630 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536354 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28w8q\" (UniqueName: \"kubernetes.io/projected/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-kube-api-access-28w8q\") pod \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " Jul 09 02:10:36.536630 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536399 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-workload-socket\") pod \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\" (UID: \"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0\") " Jul 09 02:10:36.536630 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536553 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" (UID: "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:36.536780 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536704 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" (UID: "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:36.536780 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536732 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-credential-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:36.536891 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536777 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" (UID: "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:36.536953 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.536905 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" (UID: "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:10:36.537442 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.537411 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" (UID: "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:36.538508 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.538487 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" (UID: "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:10:36.538508 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.538499 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" (UID: "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:36.538620 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.538550 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" (UID: "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 02:10:36.538757 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.538727 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-kube-api-access-28w8q" (OuterVolumeSpecName: "kube-api-access-28w8q") pod "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" (UID: "087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0"). InnerVolumeSpecName "kube-api-access-28w8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:10:36.638096 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.638057 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istiod-ca-cert\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:36.638096 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.638091 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-token\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:36.638096 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.638100 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-podinfo\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:36.638353 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.638107 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-data\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:36.638353 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.638118 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-workload-certs\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:36.638353 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.638127 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28w8q\" (UniqueName: \"kubernetes.io/projected/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-kube-api-access-28w8q\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:36.638353 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.638162 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-workload-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:36.638353 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.638176 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0-istio-envoy\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:36.804806 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.804768 2565 generic.go:356] "Generic (PLEG): container finished" podID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerID="2872f64abfdd0359cd34785f17f65a6341a9075d52fe3053bcbf7d4a2993db15" exitCode=0 Jul 09 02:10:36.804977 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.804819 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" Jul 09 02:10:36.804977 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.804831 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" event={"ID":"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0","Type":"ContainerDied","Data":"2872f64abfdd0359cd34785f17f65a6341a9075d52fe3053bcbf7d4a2993db15"} Jul 09 02:10:36.804977 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.804886 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp" event={"ID":"087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0","Type":"ContainerDied","Data":"23538f9b295d49426c86285ecf68fa2190d6ff99666e9157ec9d57bcf6d573d5"} Jul 09 02:10:36.804977 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.804919 2565 scope.go:117] "RemoveContainer" containerID="2872f64abfdd0359cd34785f17f65a6341a9075d52fe3053bcbf7d4a2993db15" Jul 09 02:10:36.813575 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.813555 2565 scope.go:117] "RemoveContainer" containerID="02b74b9da7f49c3fcab2a322278e7f5630693bc775fb266b42f5f0c3db4d0bd9" Jul 09 02:10:36.821156 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.821119 2565 scope.go:117] "RemoveContainer" containerID="2872f64abfdd0359cd34785f17f65a6341a9075d52fe3053bcbf7d4a2993db15" Jul 09 02:10:36.821419 ip-10-0-130-184 kubenswrapper[2565]: E0709 02:10:36.821396 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2872f64abfdd0359cd34785f17f65a6341a9075d52fe3053bcbf7d4a2993db15\": container with ID starting with 2872f64abfdd0359cd34785f17f65a6341a9075d52fe3053bcbf7d4a2993db15 not found: ID does not exist" containerID="2872f64abfdd0359cd34785f17f65a6341a9075d52fe3053bcbf7d4a2993db15" Jul 09 02:10:36.821503 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.821432 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2872f64abfdd0359cd34785f17f65a6341a9075d52fe3053bcbf7d4a2993db15"} err="failed to get container status \"2872f64abfdd0359cd34785f17f65a6341a9075d52fe3053bcbf7d4a2993db15\": rpc error: code = NotFound desc = could not find container \"2872f64abfdd0359cd34785f17f65a6341a9075d52fe3053bcbf7d4a2993db15\": container with ID starting with 2872f64abfdd0359cd34785f17f65a6341a9075d52fe3053bcbf7d4a2993db15 not found: ID does not exist" Jul 09 02:10:36.821503 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.821457 2565 scope.go:117] "RemoveContainer" containerID="02b74b9da7f49c3fcab2a322278e7f5630693bc775fb266b42f5f0c3db4d0bd9" Jul 09 02:10:36.821684 ip-10-0-130-184 kubenswrapper[2565]: E0709 02:10:36.821666 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02b74b9da7f49c3fcab2a322278e7f5630693bc775fb266b42f5f0c3db4d0bd9\": container with ID starting with 02b74b9da7f49c3fcab2a322278e7f5630693bc775fb266b42f5f0c3db4d0bd9 not found: ID does not exist" containerID="02b74b9da7f49c3fcab2a322278e7f5630693bc775fb266b42f5f0c3db4d0bd9" Jul 09 02:10:36.821722 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.821690 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02b74b9da7f49c3fcab2a322278e7f5630693bc775fb266b42f5f0c3db4d0bd9"} err="failed to get container status \"02b74b9da7f49c3fcab2a322278e7f5630693bc775fb266b42f5f0c3db4d0bd9\": rpc error: code = NotFound desc = could not find container \"02b74b9da7f49c3fcab2a322278e7f5630693bc775fb266b42f5f0c3db4d0bd9\": container with ID starting with 02b74b9da7f49c3fcab2a322278e7f5630693bc775fb266b42f5f0c3db4d0bd9 not found: ID does not exist" Jul 09 02:10:36.826615 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.826590 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp"] Jul 09 02:10:36.832840 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:36.832816 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-fbb202-openshift-default-5c76ffc55-n84xp"] Jul 09 02:10:37.563269 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:37.563237 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" path="/var/lib/kubelet/pods/087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0/volumes" Jul 09 02:10:37.835430 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:37.835333 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:37.935727 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:37.935689 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:38.081027 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:38.080992 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5"] Jul 09 02:10:38.081294 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:38.081268 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" podUID="51463a3c-3c66-43fd-80b3-9bbb467f9612" containerName="istio-proxy" containerID="cri-o://f1a0cef024b60a0560174b45f85ee11d21f4a17736d45f27034c5d6a33d5e16d" gracePeriod=30 Jul 09 02:10:38.105364 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:38.105250 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:38.687159 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:38.687104 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:38.966962 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:38.966875 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56"] Jul 09 02:10:38.967253 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:38.967238 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerName="istio-proxy" Jul 09 02:10:38.967253 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:38.967254 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerName="istio-proxy" Jul 09 02:10:38.967438 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:38.967319 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerName="istio-proxy" Jul 09 02:10:38.967438 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:38.967329 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerName="istio-proxy" Jul 09 02:10:38.972178 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:38.972160 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:38.974565 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:38.974544 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-77db86-openshift-default-dockercfg-zhklf\"" Jul 09 02:10:38.986461 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:38.986432 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56"] Jul 09 02:10:38.997122 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:38.997098 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:39.060498 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.060446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-data\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.060498 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.060508 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istiod-ca-cert\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.060774 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.060577 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-workload-socket\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.060774 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.060651 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-podinfo\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.060774 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.060719 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvsb6\" (UniqueName: \"kubernetes.io/projected/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-kube-api-access-wvsb6\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.060950 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.060786 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-envoy\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.060950 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.060815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-workload-certs\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.060950 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.060870 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-token\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.060950 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.060896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-credential-socket\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.162211 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.162173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-workload-certs\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.162399 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.162220 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-token\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.162399 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.162241 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-credential-socket\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.162399 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.162274 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-data\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.162399 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.162290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istiod-ca-cert\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.162399 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.162324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-workload-socket\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.162399 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.162353 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-podinfo\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.162399 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.162378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvsb6\" (UniqueName: \"kubernetes.io/projected/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-kube-api-access-wvsb6\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.163088 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.162428 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-envoy\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.163088 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.162668 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-workload-certs\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.163088 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.162767 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-credential-socket\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.163088 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.162798 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-workload-socket\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.163088 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.162829 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-data\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.163393 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.163208 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istiod-ca-cert\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.164805 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.164782 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-envoy\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.164940 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.164920 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-podinfo\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.172227 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.172207 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvsb6\" (UniqueName: \"kubernetes.io/projected/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-kube-api-access-wvsb6\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.172381 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.172360 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-token\") pod \"e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.282831 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.282790 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:39.361568 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.361537 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:39.421480 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.421443 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56"] Jul 09 02:10:39.424524 ip-10-0-130-184 kubenswrapper[2565]: W0709 02:10:39.424497 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30bd2c3e_2e90_4524_abf8_d6a0f22623eb.slice/crio-896e488d3ea15daa8553a6fe397552a947ffc11668c2d381209d9d3987bfa77a WatchSource:0}: Error finding container 896e488d3ea15daa8553a6fe397552a947ffc11668c2d381209d9d3987bfa77a: Status 404 returned error can't find the container with id 896e488d3ea15daa8553a6fe397552a947ffc11668c2d381209d9d3987bfa77a Jul 09 02:10:39.426697 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.426666 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:39.426765 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.426732 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:39.426802 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.426761 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:39.819747 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.819708 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" event={"ID":"30bd2c3e-2e90-4524-abf8-d6a0f22623eb","Type":"ContainerStarted","Data":"8a42d57ca138a7ac7a36587b9b93fa826c00a08b1d1c489ac5600907e13d3e6e"} Jul 09 02:10:39.820192 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.819761 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" event={"ID":"30bd2c3e-2e90-4524-abf8-d6a0f22623eb","Type":"ContainerStarted","Data":"896e488d3ea15daa8553a6fe397552a947ffc11668c2d381209d9d3987bfa77a"} Jul 09 02:10:39.856354 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:39.856310 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" podStartSLOduration=1.8562947539999999 podStartE2EDuration="1.856294754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:10:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:10:39.854682098 +0000 UTC m=+1960.828154725" watchObservedRunningTime="2026-07-09 02:10:39.856294754 +0000 UTC m=+1960.829767375" Jul 09 02:10:40.283702 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:40.283670 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:40.288393 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:40.288369 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:40.824074 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:40.824045 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:40.825154 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:40.825121 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:41.810589 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:41.810545 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:41.898778 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:41.898740 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:41.967564 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:41.967506 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:42.217404 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:42.217320 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:42.379651 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:42.379611 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:42.482817 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:42.482786 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:43.321178 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.321151 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:43.402268 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402179 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-podinfo\") pod \"51463a3c-3c66-43fd-80b3-9bbb467f9612\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " Jul 09 02:10:43.402268 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402220 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-envoy\") pod \"51463a3c-3c66-43fd-80b3-9bbb467f9612\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " Jul 09 02:10:43.402268 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402246 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-data\") pod \"51463a3c-3c66-43fd-80b3-9bbb467f9612\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " Jul 09 02:10:43.402568 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402288 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-workload-certs\") pod \"51463a3c-3c66-43fd-80b3-9bbb467f9612\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " Jul 09 02:10:43.402568 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402323 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-workload-socket\") pod \"51463a3c-3c66-43fd-80b3-9bbb467f9612\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " Jul 09 02:10:43.402568 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402353 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51463a3c-3c66-43fd-80b3-9bbb467f9612-istiod-ca-cert\") pod \"51463a3c-3c66-43fd-80b3-9bbb467f9612\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " Jul 09 02:10:43.402568 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402406 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qllfq\" (UniqueName: \"kubernetes.io/projected/51463a3c-3c66-43fd-80b3-9bbb467f9612-kube-api-access-qllfq\") pod \"51463a3c-3c66-43fd-80b3-9bbb467f9612\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " Jul 09 02:10:43.402568 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402442 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-credential-socket\") pod \"51463a3c-3c66-43fd-80b3-9bbb467f9612\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " Jul 09 02:10:43.402568 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402465 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-token\") pod \"51463a3c-3c66-43fd-80b3-9bbb467f9612\" (UID: \"51463a3c-3c66-43fd-80b3-9bbb467f9612\") " Jul 09 02:10:43.403281 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402620 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51463a3c-3c66-43fd-80b3-9bbb467f9612" (UID: "51463a3c-3c66-43fd-80b3-9bbb467f9612"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:43.403281 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402650 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51463a3c-3c66-43fd-80b3-9bbb467f9612" (UID: "51463a3c-3c66-43fd-80b3-9bbb467f9612"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:43.403281 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402767 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51463a3c-3c66-43fd-80b3-9bbb467f9612-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51463a3c-3c66-43fd-80b3-9bbb467f9612" (UID: "51463a3c-3c66-43fd-80b3-9bbb467f9612"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:10:43.403281 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402865 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51463a3c-3c66-43fd-80b3-9bbb467f9612" (UID: "51463a3c-3c66-43fd-80b3-9bbb467f9612"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:43.403281 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402912 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-workload-certs\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:43.403281 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.402934 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-workload-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:43.403513 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.403312 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-data" (OuterVolumeSpecName: "istio-data") pod "51463a3c-3c66-43fd-80b3-9bbb467f9612" (UID: "51463a3c-3c66-43fd-80b3-9bbb467f9612"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:43.404539 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.404511 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51463a3c-3c66-43fd-80b3-9bbb467f9612" (UID: "51463a3c-3c66-43fd-80b3-9bbb467f9612"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:43.404678 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.404658 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-token" (OuterVolumeSpecName: "istio-token") pod "51463a3c-3c66-43fd-80b3-9bbb467f9612" (UID: "51463a3c-3c66-43fd-80b3-9bbb467f9612"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:10:43.404810 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.404795 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51463a3c-3c66-43fd-80b3-9bbb467f9612" (UID: "51463a3c-3c66-43fd-80b3-9bbb467f9612"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 02:10:43.405009 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.404991 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51463a3c-3c66-43fd-80b3-9bbb467f9612-kube-api-access-qllfq" (OuterVolumeSpecName: "kube-api-access-qllfq") pod "51463a3c-3c66-43fd-80b3-9bbb467f9612" (UID: "51463a3c-3c66-43fd-80b3-9bbb467f9612"). InnerVolumeSpecName "kube-api-access-qllfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:10:43.504304 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.504268 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51463a3c-3c66-43fd-80b3-9bbb467f9612-istiod-ca-cert\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:43.504304 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.504297 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qllfq\" (UniqueName: \"kubernetes.io/projected/51463a3c-3c66-43fd-80b3-9bbb467f9612-kube-api-access-qllfq\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:43.504304 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.504310 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-credential-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:43.504533 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.504319 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-token\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:43.504533 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.504328 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-podinfo\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:43.504533 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.504336 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-envoy\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:43.504533 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.504343 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51463a3c-3c66-43fd-80b3-9bbb467f9612-istio-data\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:10:43.837362 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.837327 2565 generic.go:356] "Generic (PLEG): container finished" podID="51463a3c-3c66-43fd-80b3-9bbb467f9612" containerID="f1a0cef024b60a0560174b45f85ee11d21f4a17736d45f27034c5d6a33d5e16d" exitCode=0 Jul 09 02:10:43.837531 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.837376 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" Jul 09 02:10:43.837531 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.837378 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" event={"ID":"51463a3c-3c66-43fd-80b3-9bbb467f9612","Type":"ContainerDied","Data":"f1a0cef024b60a0560174b45f85ee11d21f4a17736d45f27034c5d6a33d5e16d"} Jul 09 02:10:43.837531 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.837500 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5" event={"ID":"51463a3c-3c66-43fd-80b3-9bbb467f9612","Type":"ContainerDied","Data":"2672ea720964bea8acc8f40db95d2ca7b3c06121be222c3025fb72b75c915dbe"} Jul 09 02:10:43.837531 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.837529 2565 scope.go:117] "RemoveContainer" containerID="f1a0cef024b60a0560174b45f85ee11d21f4a17736d45f27034c5d6a33d5e16d" Jul 09 02:10:43.845864 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.845818 2565 scope.go:117] "RemoveContainer" containerID="e4430665d000a1f06f119152677039ca254740fbc33c2a07cbfd2a6689df217d" Jul 09 02:10:43.853277 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.853251 2565 scope.go:117] "RemoveContainer" containerID="f1a0cef024b60a0560174b45f85ee11d21f4a17736d45f27034c5d6a33d5e16d" Jul 09 02:10:43.853638 ip-10-0-130-184 kubenswrapper[2565]: E0709 02:10:43.853600 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1a0cef024b60a0560174b45f85ee11d21f4a17736d45f27034c5d6a33d5e16d\": container with ID starting with f1a0cef024b60a0560174b45f85ee11d21f4a17736d45f27034c5d6a33d5e16d not found: ID does not exist" containerID="f1a0cef024b60a0560174b45f85ee11d21f4a17736d45f27034c5d6a33d5e16d" Jul 09 02:10:43.853729 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.853639 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1a0cef024b60a0560174b45f85ee11d21f4a17736d45f27034c5d6a33d5e16d"} err="failed to get container status \"f1a0cef024b60a0560174b45f85ee11d21f4a17736d45f27034c5d6a33d5e16d\": rpc error: code = NotFound desc = could not find container \"f1a0cef024b60a0560174b45f85ee11d21f4a17736d45f27034c5d6a33d5e16d\": container with ID starting with f1a0cef024b60a0560174b45f85ee11d21f4a17736d45f27034c5d6a33d5e16d not found: ID does not exist" Jul 09 02:10:43.853729 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.853666 2565 scope.go:117] "RemoveContainer" containerID="e4430665d000a1f06f119152677039ca254740fbc33c2a07cbfd2a6689df217d" Jul 09 02:10:43.853977 ip-10-0-130-184 kubenswrapper[2565]: E0709 02:10:43.853956 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4430665d000a1f06f119152677039ca254740fbc33c2a07cbfd2a6689df217d\": container with ID starting with e4430665d000a1f06f119152677039ca254740fbc33c2a07cbfd2a6689df217d not found: ID does not exist" containerID="e4430665d000a1f06f119152677039ca254740fbc33c2a07cbfd2a6689df217d" Jul 09 02:10:43.854077 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.853983 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4430665d000a1f06f119152677039ca254740fbc33c2a07cbfd2a6689df217d"} err="failed to get container status \"e4430665d000a1f06f119152677039ca254740fbc33c2a07cbfd2a6689df217d\": rpc error: code = NotFound desc = could not find container \"e4430665d000a1f06f119152677039ca254740fbc33c2a07cbfd2a6689df217d\": container with ID starting with e4430665d000a1f06f119152677039ca254740fbc33c2a07cbfd2a6689df217d not found: ID does not exist" Jul 09 02:10:43.855498 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.855478 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5"] Jul 09 02:10:43.859985 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:43.859958 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-8d3ee6-openshift-default-9cbd77cd7-xcvw5"] Jul 09 02:10:45.563102 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:45.563068 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51463a3c-3c66-43fd-80b3-9bbb467f9612" path="/var/lib/kubelet/pods/51463a3c-3c66-43fd-80b3-9bbb467f9612/volumes" Jul 09 02:10:46.283401 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:46.283371 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:46.635799 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:46.635687 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:46.941876 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:46.941779 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:47.196319 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:47.196234 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:49.324674 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:49.324637 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:10:49.704630 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:49.704538 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:49.803977 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:49.803937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:50.058262 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:50.058226 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:50.404076 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:50.403966 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:50.508800 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:50.508706 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:50.607870 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:50.607822 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:54.179548 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:54.179492 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:10:56.817323 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:56.816222 2565 patch_prober.go:28] interesting pod/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": read tcp 10.133.0.2:55094->10.133.0.35:15021: read: connection reset by peer" start-of-body= Jul 09 02:10:56.817323 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:56.816295 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" podUID="30bd2c3e-2e90-4524-abf8-d6a0f22623eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": read tcp 10.133.0.2:55094->10.133.0.35:15021: read: connection reset by peer" Jul 09 02:10:56.895870 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:56.895836 2565 generic.go:356] "Generic (PLEG): container finished" podID="30bd2c3e-2e90-4524-abf8-d6a0f22623eb" containerID="8a42d57ca138a7ac7a36587b9b93fa826c00a08b1d1c489ac5600907e13d3e6e" exitCode=0 Jul 09 02:10:56.896022 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:56.895908 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" event={"ID":"30bd2c3e-2e90-4524-abf8-d6a0f22623eb","Type":"ContainerDied","Data":"8a42d57ca138a7ac7a36587b9b93fa826c00a08b1d1c489ac5600907e13d3e6e"} Jul 09 02:10:56.896330 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:56.896315 2565 scope.go:117] "RemoveContainer" containerID="8a42d57ca138a7ac7a36587b9b93fa826c00a08b1d1c489ac5600907e13d3e6e" Jul 09 02:10:56.897409 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:56.897381 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:56.897477 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:56.897450 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:56.897519 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:56.897483 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:57.904243 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:57.904196 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" event={"ID":"30bd2c3e-2e90-4524-abf8-d6a0f22623eb","Type":"ContainerStarted","Data":"5f8e7229a90efde3847617c6e01e66475d1429948e504f7617b0bccbdacaa73b"} Jul 09 02:10:58.283933 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:58.283892 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:10:58.284194 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:58.284172 2565 patch_prober.go:28] interesting pod/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 09 02:10:58.284248 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:58.284222 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" podUID="30bd2c3e-2e90-4524-abf8-d6a0f22623eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 09 02:10:59.283428 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:59.283388 2565 patch_prober.go:28] interesting pod/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 09 02:10:59.283831 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:10:59.283446 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" podUID="30bd2c3e-2e90-4524-abf8-d6a0f22623eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 09 02:11:00.284305 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:11:00.284263 2565 patch_prober.go:28] interesting pod/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 09 02:11:00.284704 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:11:00.284328 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" podUID="30bd2c3e-2e90-4524-abf8-d6a0f22623eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 09 02:11:01.283505 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:11:01.283469 2565 patch_prober.go:28] interesting pod/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 09 02:11:01.283716 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:11:01.283524 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" podUID="30bd2c3e-2e90-4524-abf8-d6a0f22623eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 09 02:11:01.837676 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:11:01.837634 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:11:02.287209 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:11:02.287176 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:11:02.287568 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:11:02.287543 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:11:02.288244 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:11:02.288221 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:11:03.236778 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:11:03.236746 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:11:03.337710 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:11:03.337674 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:11:11.266463 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:11:11.266423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:11:11.366780 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:11:11.366741 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:12:59.613203 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:12:59.613168 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 02:12:59.614167 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:12:59.614128 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w4rwf_dd4dd34d-7366-480d-9861-b222d7d68539/ovn-acl-logging/0.log" Jul 09 02:13:59.036492 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:13:59.036407 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:13:59.412584 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:13:59.412498 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:13:59.509861 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:13:59.509814 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:13:59.610701 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:13:59.610651 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:13:59.714692 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:13:59.714599 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:02.926089 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:02.926050 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:14:05.519812 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:05.519772 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:05.618895 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:05.618859 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:05.772648 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:05.772562 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56"] Jul 09 02:14:05.772870 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:05.772829 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" podUID="30bd2c3e-2e90-4524-abf8-d6a0f22623eb" containerName="istio-proxy" containerID="cri-o://5f8e7229a90efde3847617c6e01e66475d1429948e504f7617b0bccbdacaa73b" gracePeriod=30 Jul 09 02:14:05.783560 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:05.783532 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:06.218357 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:06.218260 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:06.653615 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:06.653575 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:06.802359 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:06.802318 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:06.902052 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:06.902021 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:07.092462 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:07.092428 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:11.024486 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.024460 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:14:11.058670 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.058597 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-envoy\") pod \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " Jul 09 02:14:11.058670 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.058635 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-workload-socket\") pod \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " Jul 09 02:14:11.058670 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.058657 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-workload-certs\") pod \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " Jul 09 02:14:11.058934 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.058700 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istiod-ca-cert\") pod \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " Jul 09 02:14:11.058934 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.058731 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-podinfo\") pod \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " Jul 09 02:14:11.058934 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.058779 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-data\") pod \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " Jul 09 02:14:11.058934 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.058802 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-credential-socket\") pod \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " Jul 09 02:14:11.058934 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.058836 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-token\") pod \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " Jul 09 02:14:11.058934 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.058862 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvsb6\" (UniqueName: \"kubernetes.io/projected/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-kube-api-access-wvsb6\") pod \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\" (UID: \"30bd2c3e-2e90-4524-abf8-d6a0f22623eb\") " Jul 09 02:14:11.059271 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.058926 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "30bd2c3e-2e90-4524-abf8-d6a0f22623eb" (UID: "30bd2c3e-2e90-4524-abf8-d6a0f22623eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:14:11.059271 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.059030 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "30bd2c3e-2e90-4524-abf8-d6a0f22623eb" (UID: "30bd2c3e-2e90-4524-abf8-d6a0f22623eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:14:11.059271 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.059168 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "30bd2c3e-2e90-4524-abf8-d6a0f22623eb" (UID: "30bd2c3e-2e90-4524-abf8-d6a0f22623eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:14:11.059409 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.059302 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-workload-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:14:11.059409 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.059328 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-workload-certs\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:14:11.059707 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.059679 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "30bd2c3e-2e90-4524-abf8-d6a0f22623eb" (UID: "30bd2c3e-2e90-4524-abf8-d6a0f22623eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:14:11.059895 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.059868 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "30bd2c3e-2e90-4524-abf8-d6a0f22623eb" (UID: "30bd2c3e-2e90-4524-abf8-d6a0f22623eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:14:11.061093 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.061071 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "30bd2c3e-2e90-4524-abf8-d6a0f22623eb" (UID: "30bd2c3e-2e90-4524-abf8-d6a0f22623eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:14:11.061404 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.061387 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "30bd2c3e-2e90-4524-abf8-d6a0f22623eb" (UID: "30bd2c3e-2e90-4524-abf8-d6a0f22623eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:14:11.061529 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.061506 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "30bd2c3e-2e90-4524-abf8-d6a0f22623eb" (UID: "30bd2c3e-2e90-4524-abf8-d6a0f22623eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 02:14:11.061591 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.061528 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-kube-api-access-wvsb6" (OuterVolumeSpecName: "kube-api-access-wvsb6") pod "30bd2c3e-2e90-4524-abf8-d6a0f22623eb" (UID: "30bd2c3e-2e90-4524-abf8-d6a0f22623eb"). InnerVolumeSpecName "kube-api-access-wvsb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:14:11.160135 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.160094 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-podinfo\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:14:11.160135 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.160129 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-data\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:14:11.160135 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.160162 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-credential-socket\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:14:11.160393 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.160171 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-token\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:14:11.160393 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.160182 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvsb6\" (UniqueName: \"kubernetes.io/projected/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-kube-api-access-wvsb6\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:14:11.160393 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.160190 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istio-envoy\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:14:11.160393 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.160198 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30bd2c3e-2e90-4524-abf8-d6a0f22623eb-istiod-ca-cert\") on node \"ip-10-0-130-184.ec2.internal\" DevicePath \"\"" Jul 09 02:14:11.716355 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.716319 2565 generic.go:356] "Generic (PLEG): container finished" podID="30bd2c3e-2e90-4524-abf8-d6a0f22623eb" containerID="5f8e7229a90efde3847617c6e01e66475d1429948e504f7617b0bccbdacaa73b" exitCode=0 Jul 09 02:14:11.716514 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.716361 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" Jul 09 02:14:11.716514 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.716375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" event={"ID":"30bd2c3e-2e90-4524-abf8-d6a0f22623eb","Type":"ContainerDied","Data":"5f8e7229a90efde3847617c6e01e66475d1429948e504f7617b0bccbdacaa73b"} Jul 09 02:14:11.716514 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.716429 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56" event={"ID":"30bd2c3e-2e90-4524-abf8-d6a0f22623eb","Type":"ContainerDied","Data":"896e488d3ea15daa8553a6fe397552a947ffc11668c2d381209d9d3987bfa77a"} Jul 09 02:14:11.716514 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.716453 2565 scope.go:117] "RemoveContainer" containerID="5f8e7229a90efde3847617c6e01e66475d1429948e504f7617b0bccbdacaa73b" Jul 09 02:14:11.724880 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.724863 2565 scope.go:117] "RemoveContainer" containerID="8a42d57ca138a7ac7a36587b9b93fa826c00a08b1d1c489ac5600907e13d3e6e" Jul 09 02:14:11.732338 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.732319 2565 scope.go:117] "RemoveContainer" containerID="5f8e7229a90efde3847617c6e01e66475d1429948e504f7617b0bccbdacaa73b" Jul 09 02:14:11.732643 ip-10-0-130-184 kubenswrapper[2565]: E0709 02:14:11.732610 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8e7229a90efde3847617c6e01e66475d1429948e504f7617b0bccbdacaa73b\": container with ID starting with 5f8e7229a90efde3847617c6e01e66475d1429948e504f7617b0bccbdacaa73b not found: ID does not exist" containerID="5f8e7229a90efde3847617c6e01e66475d1429948e504f7617b0bccbdacaa73b" Jul 09 02:14:11.732860 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.732654 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8e7229a90efde3847617c6e01e66475d1429948e504f7617b0bccbdacaa73b"} err="failed to get container status \"5f8e7229a90efde3847617c6e01e66475d1429948e504f7617b0bccbdacaa73b\": rpc error: code = NotFound desc = could not find container \"5f8e7229a90efde3847617c6e01e66475d1429948e504f7617b0bccbdacaa73b\": container with ID starting with 5f8e7229a90efde3847617c6e01e66475d1429948e504f7617b0bccbdacaa73b not found: ID does not exist" Jul 09 02:14:11.732860 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.732676 2565 scope.go:117] "RemoveContainer" containerID="8a42d57ca138a7ac7a36587b9b93fa826c00a08b1d1c489ac5600907e13d3e6e" Jul 09 02:14:11.733055 ip-10-0-130-184 kubenswrapper[2565]: E0709 02:14:11.733022 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a42d57ca138a7ac7a36587b9b93fa826c00a08b1d1c489ac5600907e13d3e6e\": container with ID starting with 8a42d57ca138a7ac7a36587b9b93fa826c00a08b1d1c489ac5600907e13d3e6e not found: ID does not exist" containerID="8a42d57ca138a7ac7a36587b9b93fa826c00a08b1d1c489ac5600907e13d3e6e" Jul 09 02:14:11.733165 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.733055 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a42d57ca138a7ac7a36587b9b93fa826c00a08b1d1c489ac5600907e13d3e6e"} err="failed to get container status \"8a42d57ca138a7ac7a36587b9b93fa826c00a08b1d1c489ac5600907e13d3e6e\": rpc error: code = NotFound desc = could not find container \"8a42d57ca138a7ac7a36587b9b93fa826c00a08b1d1c489ac5600907e13d3e6e\": container with ID starting with 8a42d57ca138a7ac7a36587b9b93fa826c00a08b1d1c489ac5600907e13d3e6e not found: ID does not exist" Jul 09 02:14:11.734723 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.734704 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56"] Jul 09 02:14:11.739961 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:11.739936 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-77db86-openshift-default-5bfd8cb587-9wt56"] Jul 09 02:14:12.481750 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:12.481718 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:12.581378 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:12.581346 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:12.730490 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:12.730457 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:13.440035 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:13.439999 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6swvj"] Jul 09 02:14:13.566054 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:13.566008 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30bd2c3e-2e90-4524-abf8-d6a0f22623eb" path="/var/lib/kubelet/pods/30bd2c3e-2e90-4524-abf8-d6a0f22623eb/volumes" Jul 09 02:14:17.954871 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:17.954844 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bxlzc_e3108506-1e77-4960-ac7c-3574868bc47f/manager/0.log" Jul 09 02:14:18.071826 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:18.071800 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5swkp_1fa97358-a112-4926-80c9-94c7d839fdac/manager/0.log" Jul 09 02:14:18.595998 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:18.595965 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4b98c894-4wgwq_93be9941-f0d5-4c7a-a3a4-f1dd819cf63b/copy-manifests/0.log" Jul 09 02:14:18.604013 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:18.603988 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4b98c894-4wgwq_93be9941-f0d5-4c7a-a3a4-f1dd819cf63b/manager/0.log" Jul 09 02:14:20.498472 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:20.498444 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-64hzz_9ce999b4-5620-477f-96e6-67983d20593e/kuadrant-console-plugin/0.log" Jul 09 02:14:20.874685 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:20.874604 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6swvj_3585a98d-9332-453d-a248-fbc5c3db777c/limitador/0.log" Jul 09 02:14:21.365813 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:21.365778 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42s2tc_6d6e7a59-f5f9-435b-911b-0cd22c3d9424/istio-proxy/0.log" Jul 09 02:14:21.819104 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:21.819073 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zxv5c_9c83a710-22c1-41ac-9ac7-79aabc1a11b8/istio-proxy/1.log" Jul 09 02:14:22.717448 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:22.717418 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-lmvpc_fe3e4380-d62b-42c3-a906-9aa385d2abfb/main/0.log" Jul 09 02:14:22.938539 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:22.938509 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-7th2s_50a3376e-dd40-4b99-bb64-13951d4e6c91/main/0.log" Jul 09 02:14:27.537873 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:27.537834 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:27.637100 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:27.637065 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:30.346404 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:30.346373 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nd79x_5982d2fd-d322-47cf-a233-c41afb3ff1fd/global-pull-secret-syncer/0.log" Jul 09 02:14:30.437093 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:30.437058 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" Jul 09 02:14:30.548714 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:30.548688 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-184.ec2.internal_81d8756a43625938ca8b36e75b20e52a/haproxy/0.log" Jul 09 02:14:33.307352 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:33.307318 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:35.366802 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:35.366700 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-64hzz_9ce999b4-5620-477f-96e6-67983d20593e/kuadrant-console-plugin/0.log" Jul 09 02:14:35.542443 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:35.542411 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6swvj_3585a98d-9332-453d-a248-fbc5c3db777c/limitador/0.log" Jul 09 02:14:37.726487 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:37.726456 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkv4w_607b83e6-1b31-4565-8f25-5ae4b8b5369e/node-exporter/0.log" Jul 09 02:14:37.752406 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:37.752383 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkv4w_607b83e6-1b31-4565-8f25-5ae4b8b5369e/kube-rbac-proxy/0.log" Jul 09 02:14:37.774470 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:37.774446 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkv4w_607b83e6-1b31-4565-8f25-5ae4b8b5369e/init-textfile/0.log" Jul 09 02:14:41.656912 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.656875 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2"] Jul 09 02:14:41.657302 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.657194 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30bd2c3e-2e90-4524-abf8-d6a0f22623eb" containerName="istio-proxy" Jul 09 02:14:41.657302 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.657205 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="30bd2c3e-2e90-4524-abf8-d6a0f22623eb" containerName="istio-proxy" Jul 09 02:14:41.657302 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.657215 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51463a3c-3c66-43fd-80b3-9bbb467f9612" containerName="istio-proxy" Jul 09 02:14:41.657302 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.657221 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="51463a3c-3c66-43fd-80b3-9bbb467f9612" containerName="istio-proxy" Jul 09 02:14:41.657302 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.657235 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerName="istio-proxy" Jul 09 02:14:41.657302 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.657241 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="087d2675-9bbb-424a-a6a2-ba2bdc9fd8b0" containerName="istio-proxy" Jul 09 02:14:41.657302 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.657287 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="30bd2c3e-2e90-4524-abf8-d6a0f22623eb" containerName="istio-proxy" Jul 09 02:14:41.657302 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.657295 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="30bd2c3e-2e90-4524-abf8-d6a0f22623eb" containerName="istio-proxy" Jul 09 02:14:41.657302 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.657303 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="51463a3c-3c66-43fd-80b3-9bbb467f9612" containerName="istio-proxy" Jul 09 02:14:41.657595 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.657309 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="51463a3c-3c66-43fd-80b3-9bbb467f9612" containerName="istio-proxy" Jul 09 02:14:41.660215 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.660195 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.662384 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.662361 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k9hbz\"/\"openshift-service-ca.crt\"" Jul 09 02:14:41.662508 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.662395 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k9hbz\"/\"default-dockercfg-txlpg\"" Jul 09 02:14:41.663234 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.663218 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k9hbz\"/\"kube-root-ca.crt\"" Jul 09 02:14:41.669268 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.669241 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2"] Jul 09 02:14:41.824617 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.824562 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7261ed26-73e1-4d1d-8715-a5448a25a267-podres\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.824617 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.824620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7261ed26-73e1-4d1d-8715-a5448a25a267-sys\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.824816 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.824651 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7261ed26-73e1-4d1d-8715-a5448a25a267-lib-modules\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.824816 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.824675 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppzlz\" (UniqueName: \"kubernetes.io/projected/7261ed26-73e1-4d1d-8715-a5448a25a267-kube-api-access-ppzlz\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.824816 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.824699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7261ed26-73e1-4d1d-8715-a5448a25a267-proc\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.925763 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.925684 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppzlz\" (UniqueName: \"kubernetes.io/projected/7261ed26-73e1-4d1d-8715-a5448a25a267-kube-api-access-ppzlz\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.925763 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.925729 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7261ed26-73e1-4d1d-8715-a5448a25a267-proc\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.925964 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.925794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7261ed26-73e1-4d1d-8715-a5448a25a267-podres\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.925964 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.925821 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7261ed26-73e1-4d1d-8715-a5448a25a267-sys\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.925964 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.925855 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7261ed26-73e1-4d1d-8715-a5448a25a267-lib-modules\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.925964 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.925885 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7261ed26-73e1-4d1d-8715-a5448a25a267-proc\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.925964 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.925912 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7261ed26-73e1-4d1d-8715-a5448a25a267-sys\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.925964 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.925922 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7261ed26-73e1-4d1d-8715-a5448a25a267-podres\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.925964 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.925962 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7261ed26-73e1-4d1d-8715-a5448a25a267-lib-modules\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.933815 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.933785 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppzlz\" (UniqueName: \"kubernetes.io/projected/7261ed26-73e1-4d1d-8715-a5448a25a267-kube-api-access-ppzlz\") pod \"perf-node-gather-daemonset-cchv2\" (UID: \"7261ed26-73e1-4d1d-8715-a5448a25a267\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:41.970196 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:41.970166 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:42.097866 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:42.097826 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2"] Jul 09 02:14:42.101448 ip-10-0-130-184 kubenswrapper[2565]: W0709 02:14:42.101422 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7261ed26_73e1_4d1d_8715_a5448a25a267.slice/crio-9576d7770407f5bd47dae0bc459a04feced337f43e5e0a901b12fcd66d33318f WatchSource:0}: Error finding container 9576d7770407f5bd47dae0bc459a04feced337f43e5e0a901b12fcd66d33318f: Status 404 returned error can't find the container with id 9576d7770407f5bd47dae0bc459a04feced337f43e5e0a901b12fcd66d33318f Jul 09 02:14:42.702742 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:42.702717 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wgknd_4ca68c46-c396-43fa-8692-74a84e9ea975/dns/0.log" Jul 09 02:14:42.725641 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:42.725617 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wgknd_4ca68c46-c396-43fa-8692-74a84e9ea975/kube-rbac-proxy/0.log" Jul 09 02:14:42.750704 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:42.750671 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lvjrf_a4b12f0c-9647-466d-9823-a5273d80b153/dns-node-resolver/0.log" Jul 09 02:14:42.847031 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:42.846995 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" event={"ID":"7261ed26-73e1-4d1d-8715-a5448a25a267","Type":"ContainerStarted","Data":"702132c4f332163c09c444daceb5f63229b047c9550877d27bcda233c030274d"} Jul 09 02:14:42.847284 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:42.847048 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" event={"ID":"7261ed26-73e1-4d1d-8715-a5448a25a267","Type":"ContainerStarted","Data":"9576d7770407f5bd47dae0bc459a04feced337f43e5e0a901b12fcd66d33318f"} Jul 09 02:14:42.847284 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:42.847077 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:42.863998 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:42.863955 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" podStartSLOduration=1.8639412 podStartE2EDuration="1.8639412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:14:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:14:42.863177848 +0000 UTC m=+2203.836650470" watchObservedRunningTime="2026-07-09 02:14:42.8639412 +0000 UTC m=+2203.837413820" Jul 09 02:14:43.326447 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:43.326418 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-dd879d8c8-k9255_69cc01a4-5f86-4786-84d2-ff8362989963/registry/0.log" Jul 09 02:14:43.391949 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:43.391925 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zktpv_66008bdf-c7e5-43e0-a569-61692022b688/node-ca/0.log" Jul 09 02:14:44.342223 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:44.342195 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42s2tc_6d6e7a59-f5f9-435b-911b-0cd22c3d9424/istio-proxy/0.log" Jul 09 02:14:44.603704 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:44.603625 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zxv5c_9c83a710-22c1-41ac-9ac7-79aabc1a11b8/istio-proxy/0.log" Jul 09 02:14:44.629574 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:44.629542 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zxv5c_9c83a710-22c1-41ac-9ac7-79aabc1a11b8/istio-proxy/1.log" Jul 09 02:14:45.498359 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:45.498326 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gx9tv_6201c81f-af43-46f5-8136-f4900c38f899/serve-healthcheck-canary/0.log" Jul 09 02:14:46.150980 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:46.150950 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tj77z_4f07e0cc-3728-49de-911f-d96e7bcb9693/kube-rbac-proxy/0.log" Jul 09 02:14:46.172737 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:46.172713 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tj77z_4f07e0cc-3728-49de-911f-d96e7bcb9693/exporter/0.log" Jul 09 02:14:46.195665 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:46.195642 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tj77z_4f07e0cc-3728-49de-911f-d96e7bcb9693/extractor/0.log" Jul 09 02:14:48.549925 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:48.549894 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bxlzc_e3108506-1e77-4960-ac7c-3574868bc47f/manager/0.log" Jul 09 02:14:48.658949 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:48.658919 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5swkp_1fa97358-a112-4926-80c9-94c7d839fdac/manager/0.log" Jul 09 02:14:48.860177 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:48.860083 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-cchv2" Jul 09 02:14:48.947111 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:48.947080 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4b98c894-4wgwq_93be9941-f0d5-4c7a-a3a4-f1dd819cf63b/manager/0.log" Jul 09 02:14:48.973398 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:48.973372 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4b98c894-4wgwq_93be9941-f0d5-4c7a-a3a4-f1dd819cf63b/copy-manifests/0.log" Jul 09 02:14:50.245109 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:50.245082 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42s2tc_6d6e7a59-f5f9-435b-911b-0cd22c3d9424/istio-proxy/0.log" Jul 09 02:14:50.360478 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:50.360449 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6489dc67d-ghjvn_e9b0569b-9cb4-46bb-9252-bbbab6073536/manager/0.log" Jul 09 02:14:50.465054 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:50.465023 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zxv5c_9c83a710-22c1-41ac-9ac7-79aabc1a11b8/istio-proxy/0.log" Jul 09 02:14:50.496975 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:50.496899 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zxv5c_9c83a710-22c1-41ac-9ac7-79aabc1a11b8/istio-proxy/1.log" Jul 09 02:14:51.965840 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:51.965806 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42s2tc_6d6e7a59-f5f9-435b-911b-0cd22c3d9424/istio-proxy/0.log" Jul 09 02:14:52.187670 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:52.187641 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zxv5c_9c83a710-22c1-41ac-9ac7-79aabc1a11b8/istio-proxy/0.log" Jul 09 02:14:52.214498 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:52.214468 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zxv5c_9c83a710-22c1-41ac-9ac7-79aabc1a11b8/istio-proxy/1.log" Jul 09 02:14:53.119041 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:53.119007 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:53.219937 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:53.219904 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d2pm_f756d1de-5c46-4697-afb8-126ef3e9569e/konnectivity-agent/0.log" limit=1024 Jul 09 02:14:55.526464 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:55.526435 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-h6zsq_ca60759d-723c-4312-b7af-04ac90dc2b8b/migrator/0.log" Jul 09 02:14:55.548666 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:55.548639 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-h6zsq_ca60759d-723c-4312-b7af-04ac90dc2b8b/graceful-termination/0.log" Jul 09 02:14:57.078203 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:57.078176 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5dkk_703c3024-5208-43d1-829e-bc840655bf9c/kube-multus-additional-cni-plugins/0.log" Jul 09 02:14:57.102977 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:57.102946 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5dkk_703c3024-5208-43d1-829e-bc840655bf9c/egress-router-binary-copy/0.log" Jul 09 02:14:57.126762 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:57.126735 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5dkk_703c3024-5208-43d1-829e-bc840655bf9c/cni-plugins/0.log" Jul 09 02:14:57.149957 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:57.149931 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5dkk_703c3024-5208-43d1-829e-bc840655bf9c/bond-cni-plugin/0.log" Jul 09 02:14:57.179959 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:57.179928 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5dkk_703c3024-5208-43d1-829e-bc840655bf9c/routeoverride-cni/0.log" Jul 09 02:14:57.202911 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:57.202886 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5dkk_703c3024-5208-43d1-829e-bc840655bf9c/whereabouts-cni-bincopy/0.log" Jul 09 02:14:57.227157 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:57.227112 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f5dkk_703c3024-5208-43d1-829e-bc840655bf9c/whereabouts-cni/0.log" Jul 09 02:14:57.578496 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:57.578464 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d6hhc_5a01e5f3-7f8f-41cc-803b-ed84c815bae3/kube-multus/0.log" Jul 09 02:14:57.785260 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:57.785230 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s7zrq_c975edec-2157-4f50-85fc-102b756da42b/network-metrics-daemon/0.log" Jul 09 02:14:57.806046 ip-10-0-130-184 kubenswrapper[2565]: I0709 02:14:57.806022 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s7zrq_c975edec-2157-4f50-85fc-102b756da42b/kube-rbac-proxy/0.log"