Jul 08 19:03:08.131096 ip-10-0-138-105 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 19:03:08.131108 ip-10-0-138-105 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 19:03:08.131115 ip-10-0-138-105 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 19:03:08.131361 ip-10-0-138-105 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 19:03:18.151504 ip-10-0-138-105 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 19:03:18.151524 ip-10-0-138-105 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 53aceb2861aa45fb966d050af4c713ca -- Jul 08 19:05:16.939706 ip-10-0-138-105 systemd[1]: Starting Kubernetes Kubelet... Jul 08 19:05:17.299220 ip-10-0-138-105 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:05:17.299220 ip-10-0-138-105 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 19:05:17.299220 ip-10-0-138-105 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:05:17.299220 ip-10-0-138-105 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 19:05:17.299220 ip-10-0-138-105 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:05:17.300837 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.300700 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 19:05:17.304457 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304441 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:05:17.304457 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304455 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304460 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304463 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304467 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304470 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304473 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304475 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304478 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304480 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304483 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304485 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304488 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304490 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304493 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304498 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304502 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304505 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304508 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304511 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304518 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:05:17.304517 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304521 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304524 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304527 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304530 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304533 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304535 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304537 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304540 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304542 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304545 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304547 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304550 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304553 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304555 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304558 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304560 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304563 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304565 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304568 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304570 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:05:17.304981 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304573 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304576 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304578 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304581 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304583 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304585 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304588 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304592 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304596 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304598 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304601 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304603 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304606 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304608 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304611 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304614 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304617 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304619 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304622 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:05:17.305505 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304624 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304627 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304630 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304632 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304635 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304638 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304640 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304643 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304645 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304648 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304651 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304654 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304657 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304659 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304662 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304665 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304669 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304672 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304674 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:05:17.305987 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304677 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304680 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304682 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304685 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304688 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304690 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304693 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304696 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304700 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304703 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304707 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304710 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304712 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304715 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304717 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304720 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304722 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304725 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304727 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.304730 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:05:17.306476 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305409 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305415 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305418 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305420 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305423 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305426 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305429 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305432 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305434 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305437 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305440 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305442 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305446 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305449 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305451 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305454 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305457 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305459 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305462 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305467 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:05:17.306990 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305471 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305474 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305477 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305480 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305483 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305486 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305488 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305491 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305493 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305496 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305499 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305501 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305504 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305506 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305509 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305512 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305514 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305517 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305521 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305523 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:05:17.307494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305526 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305528 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305531 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305533 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305536 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305539 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305543 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305545 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305548 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305550 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305553 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305555 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305558 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305561 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305564 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305566 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305570 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305573 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305575 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305578 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:05:17.308002 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305580 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305583 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305585 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305588 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305591 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305594 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305596 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305599 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305601 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305604 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305607 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305610 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305612 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305615 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305617 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305620 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305622 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305625 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305628 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:05:17.308516 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305630 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305632 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305635 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305638 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305642 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305644 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305647 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305650 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305652 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305656 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305660 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305663 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305666 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305669 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305672 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305675 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305677 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305680 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305682 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:05:17.308979 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.305685 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306037 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306041 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306044 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306047 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306051 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306053 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306056 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306058 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306061 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306063 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306074 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306078 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306081 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306084 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306086 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306089 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306092 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306094 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:05:17.309532 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306097 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306099 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306102 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306104 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306107 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306109 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306112 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306114 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306117 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306119 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306122 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306124 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306127 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306129 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306132 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306134 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306137 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306139 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306142 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306146 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:05:17.309993 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306148 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306151 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306153 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306155 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306158 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306161 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306163 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306165 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306168 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306170 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306173 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306175 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306178 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306180 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306183 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306186 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306188 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306190 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306193 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306195 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:05:17.310494 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306197 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306200 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306202 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306205 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306207 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306210 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306212 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306217 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306220 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306222 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306225 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306227 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306230 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306233 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306235 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306239 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306242 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306245 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306247 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:05:17.310970 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306250 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306252 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306255 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306257 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306260 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306263 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306265 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306268 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306270 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306272 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306275 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306280 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306283 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306286 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306289 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306292 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306295 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306298 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306302 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:05:17.311443 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306305 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306309 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.306312 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306377 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306397 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306403 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306408 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306415 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306419 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306423 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306427 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306430 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306433 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306437 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306440 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306443 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306446 2554 flags.go:64] FLAG: --cgroup-root="" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306449 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306452 2554 flags.go:64] FLAG: --client-ca-file="" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306455 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306458 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306463 2554 flags.go:64] FLAG: --cluster-domain="" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306466 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306469 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 19:05:17.311891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306472 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306475 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306479 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306482 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306485 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306489 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306492 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306495 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306498 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306503 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306506 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306510 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306514 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306516 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306519 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306522 2554 flags.go:64] FLAG: --enable-server="true" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306525 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306532 2554 flags.go:64] FLAG: --event-burst="100" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306536 2554 flags.go:64] FLAG: --event-qps="50" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306541 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306547 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306550 2554 flags.go:64] FLAG: --eviction-hard="" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306554 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306556 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306559 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 19:05:17.312491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306562 2554 flags.go:64] FLAG: --eviction-soft="" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306565 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306568 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306571 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306574 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306576 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306579 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306582 2554 flags.go:64] FLAG: --feature-gates="" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306585 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306588 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306591 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306594 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306597 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306600 2554 flags.go:64] FLAG: --help="false" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306603 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-138-105.ec2.internal" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306606 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306611 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306614 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306617 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306620 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306623 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306626 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306628 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 19:05:17.313110 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306631 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306635 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306638 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306643 2554 flags.go:64] FLAG: --kube-reserved="" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306646 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306648 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306651 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306654 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306657 2554 flags.go:64] FLAG: --lock-file="" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306660 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306663 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306665 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306670 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306673 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306676 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306679 2554 flags.go:64] FLAG: --logging-format="text" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306681 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306684 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306687 2554 flags.go:64] FLAG: --manifest-url="" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306690 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306694 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306697 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306701 2554 flags.go:64] FLAG: --max-pods="110" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306704 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306706 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 19:05:17.313728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306710 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306713 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306716 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306719 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306722 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306729 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306731 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306734 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306737 2554 flags.go:64] FLAG: --pod-cidr="" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306740 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306745 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306749 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306752 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306755 2554 flags.go:64] FLAG: --port="10250" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306758 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306761 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05506bfa24a8a9275" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306764 2554 flags.go:64] FLAG: --qos-reserved="" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306767 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306770 2554 flags.go:64] FLAG: --register-node="true" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306772 2554 flags.go:64] FLAG: --register-with-taints="" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306776 2554 flags.go:64] FLAG: --registry-burst="10" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306779 2554 flags.go:64] FLAG: --registry-qps="5" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306781 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306784 2554 flags.go:64] FLAG: --reserved-memory="" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306787 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 19:05:17.314339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306790 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306793 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306796 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306799 2554 flags.go:64] FLAG: --runonce="false" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306801 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306804 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306807 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306812 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306814 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306817 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306820 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306823 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306826 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306829 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306831 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306834 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306837 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306840 2554 flags.go:64] FLAG: --system-cgroups="" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306845 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306850 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306852 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306855 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306859 2554 flags.go:64] FLAG: --tls-min-version="" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306862 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306865 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 19:05:17.315341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306867 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306870 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306873 2554 flags.go:64] FLAG: --v="2" Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306877 2554 flags.go:64] FLAG: --version="false" Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306880 2554 flags.go:64] FLAG: --vmodule="" Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306890 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.306893 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307011 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307015 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307019 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307021 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307024 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307028 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307030 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307034 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307037 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307041 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307044 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307047 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307050 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307052 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307055 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:05:17.316076 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307058 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307060 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307063 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307073 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307076 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307079 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307081 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307084 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307086 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307089 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307091 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307094 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307096 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307099 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307101 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307104 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307106 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307109 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307113 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307116 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:05:17.316679 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307119 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307121 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307124 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307127 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307130 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307133 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307135 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307138 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307140 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307143 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307145 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307148 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307150 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307153 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307156 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307159 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307167 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307170 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307173 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:05:17.317232 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307175 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307178 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307180 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307183 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307185 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307188 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307190 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307194 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307198 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307201 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307203 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307206 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307209 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307211 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307214 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307217 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307219 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307225 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307229 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:05:17.317743 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307232 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307235 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307237 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307240 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307242 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307245 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307247 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307250 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307252 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307256 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307259 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307262 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307264 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307267 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307269 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307272 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307274 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307277 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307279 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307281 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:05:17.318224 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307284 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307286 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307289 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307292 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307294 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.307297 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.307302 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.315842 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.315857 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.316538 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.316546 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316624 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316629 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316633 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316637 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:05:17.318729 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316639 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316642 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316645 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316647 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316650 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316652 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316655 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316658 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316660 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316663 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316665 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316668 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316671 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316674 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316676 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316679 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316682 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316685 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316688 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:05:17.319105 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316690 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316695 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316699 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316702 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316705 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316711 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316713 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316716 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316718 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316721 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316724 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316726 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316730 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316733 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316737 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316739 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316742 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316744 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316747 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:05:17.319593 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316749 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316752 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316754 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316757 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316760 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316763 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316765 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316768 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316770 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316773 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316775 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316778 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316780 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316783 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316786 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316788 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316791 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316793 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316796 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316798 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316801 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:05:17.320034 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316804 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316806 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316809 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316811 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316815 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316818 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316821 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316824 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316827 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316830 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316832 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316835 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316838 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316841 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316844 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316846 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316850 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316852 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316855 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:05:17.320556 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316857 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316860 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316862 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316865 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316867 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316870 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316873 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316876 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316878 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316881 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316883 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316886 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316888 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316891 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316893 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316896 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:05:17.321016 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.316898 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.316903 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317026 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317031 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317033 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317036 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317039 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317042 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317044 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317047 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317050 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317052 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317055 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317057 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317060 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:05:17.321478 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317063 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317066 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317068 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317071 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317073 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317076 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317078 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317081 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317083 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317085 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317088 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317090 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317092 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317095 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317097 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317101 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317105 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317108 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317111 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317113 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:05:17.321864 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317117 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317120 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317123 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317126 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317129 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317132 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317135 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317137 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317140 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317143 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317148 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317152 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317155 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317159 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317163 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317166 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317169 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317172 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317175 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317177 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:05:17.322340 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317180 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317182 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317185 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317187 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317190 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317192 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317194 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317197 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317199 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317202 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317204 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317207 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317210 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317212 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317215 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317217 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317220 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317222 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317225 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:05:17.322834 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317227 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317230 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317232 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317236 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317239 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317241 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317244 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317247 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317249 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317252 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317254 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317257 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317259 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317262 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317264 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317267 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317269 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317272 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317274 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317276 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:05:17.323279 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317279 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:05:17.323775 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317281 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:05:17.323775 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317284 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:05:17.323775 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317286 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:05:17.323775 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317289 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:05:17.323775 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317291 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:05:17.323775 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:17.317295 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:05:17.323775 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.317300 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:05:17.323775 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.317418 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 19:05:17.323775 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.320350 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 19:05:17.323775 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.321655 2554 server.go:1019] "Starting client certificate rotation" Jul 08 19:05:17.323775 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.321757 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 19:05:17.323775 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.321785 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 19:05:17.324890 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.324877 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 19:05:17.328135 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.328120 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 19:05:17.337073 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.337055 2554 log.go:25] "Validated CRI v1 runtime API" Jul 08 19:05:17.340295 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.340278 2554 log.go:25] "Validated CRI v1 image API" Jul 08 19:05:17.341248 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.341236 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 19:05:17.344709 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.344684 2554 fs.go:135] Filesystem UUIDs: map[39eb77fd-dd72-469c-b4aa-36064155dee5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dcd4c48e-1f40-4e40-8562-bc09e18aec46:/dev/nvme0n1p4] Jul 08 19:05:17.344772 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.344709 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 19:05:17.350733 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.350634 2554 manager.go:216] Machine: {Timestamp:2026-07-08 19:05:17.349365922 +0000 UTC m=+0.298635939 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3085843 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2de0986b134ecc35d4795fe583b812 SystemUUID:ec2de098-6b13-4ecc-35d4-795fe583b812 BootID:53aceb28-61aa-45fb-966d-050af4c713ca Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:48:b8:51:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:48:b8:51:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:56:30:c5:ef:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 19:05:17.350733 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.350733 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 19:05:17.350833 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.350803 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 19:05:17.353879 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.353861 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 19:05:17.354530 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.354208 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 19:05:17.354983 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.354560 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 19:05:17.355622 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.355603 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 19:05:17.355716 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.355668 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 19:05:17.355771 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.355726 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 19:05:17.356440 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.356411 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 19:05:17.358244 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.358233 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 19:05:17.362517 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.362506 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 08 19:05:17.362634 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.362624 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 19:05:17.362664 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.362654 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 08 19:05:17.362691 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.362668 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 19:05:17.362691 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.362682 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 19:05:17.362691 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.362690 2554 kubelet.go:398] "Adding apiserver pod source" Jul 08 19:05:17.362785 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.362702 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 19:05:17.363100 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.363089 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 19:05:17.363151 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.363107 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 19:05:17.365035 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.365020 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 19:05:17.367146 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.367134 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 19:05:17.367187 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.367164 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 19:05:17.368525 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.368511 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 19:05:17.368588 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.368533 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 19:05:17.368588 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.368542 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 19:05:17.368588 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.368547 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 19:05:17.368588 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.368556 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 19:05:17.368588 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.368561 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 19:05:17.368588 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.368570 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 19:05:17.368588 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.368576 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 19:05:17.368588 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.368583 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 19:05:17.368588 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.368591 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 19:05:17.368810 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.368603 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 19:05:17.368810 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.368609 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 19:05:17.369930 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.369918 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 19:05:17.369964 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.369932 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 19:05:17.372659 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.372644 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 19:05:17.372793 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:17.372770 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 19:05:17.373023 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:17.373000 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 19:05:17.373236 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.373216 2554 server.go:1268] "Started kubelet" Jul 08 19:05:17.373316 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.373292 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 19:05:17.373406 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.373363 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 19:05:17.373465 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.373452 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 19:05:17.374954 ip-10-0-138-105 systemd[1]: Started Kubernetes Kubelet. Jul 08 19:05:17.375412 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.375402 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 19:05:17.376303 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.376286 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 08 19:05:17.378979 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:17.378954 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 19:05:17.382324 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:17.381484 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-105.ec2.internal.18c065ec269c63d4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-105.ec2.internal,UID:ip-10-0-138-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-105.ec2.internal,},FirstTimestamp:2026-07-08 19:05:17.373187028 +0000 UTC m=+0.322457045,LastTimestamp:2026-07-08 19:05:17.373187028 +0000 UTC m=+0.322457045,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-105.ec2.internal,}" Jul 08 19:05:17.384487 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.384468 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 19:05:17.384588 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.384469 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 19:05:17.384645 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:17.384597 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jul 08 19:05:17.385264 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.385233 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 19:05:17.385378 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.385268 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 19:05:17.385484 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.385459 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 19:05:17.385574 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.385283 2554 factory.go:55] Registering systemd factory Jul 08 19:05:17.385574 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.385507 2554 factory.go:223] Registration of the systemd container factory successfully Jul 08 19:05:17.385698 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.385613 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 08 19:05:17.385698 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.385623 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 08 19:05:17.385795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.385774 2554 factory.go:153] Registering CRI-O factory Jul 08 19:05:17.385795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.385790 2554 factory.go:223] Registration of the crio container factory successfully Jul 08 19:05:17.385941 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.385845 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 19:05:17.385941 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.385868 2554 factory.go:103] Registering Raw factory Jul 08 19:05:17.385941 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.385883 2554 manager.go:1196] Started watching for new ooms in manager Jul 08 19:05:17.386696 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.386560 2554 manager.go:349] Starting recovery of all containers Jul 08 19:05:17.387751 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:17.387724 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 19:05:17.387848 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:17.387818 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 19:05:17.399039 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.398933 2554 manager.go:354] Recovery completed Jul 08 19:05:17.402809 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.402797 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:05:17.404858 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.404835 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:05:17.404906 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.404877 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:05:17.404906 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.404892 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:05:17.405438 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.405427 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 19:05:17.405438 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.405437 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 19:05:17.405521 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.405451 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 08 19:05:17.405521 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.405491 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:05:17.406340 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.406325 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:05:17.406451 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.406352 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:05:17.406451 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.406362 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:05:17.407258 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:17.407187 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-105.ec2.internal.18c065ec287fb049 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-105.ec2.internal,UID:ip-10-0-138-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-105.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-105.ec2.internal,},FirstTimestamp:2026-07-08 19:05:17.404860489 +0000 UTC m=+0.354130512,LastTimestamp:2026-07-08 19:05:17.404860489 +0000 UTC m=+0.354130512,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-105.ec2.internal,}" Jul 08 19:05:17.407635 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.407623 2554 policy_none.go:49] "None policy: Start" Jul 08 19:05:17.407683 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.407647 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 19:05:17.407683 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.407660 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 19:05:17.409565 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.409554 2554 policy_none.go:47] "Start" Jul 08 19:05:17.412234 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.412217 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cc78r" Jul 08 19:05:17.417758 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:17.417697 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-105.ec2.internal.18c065ec28800c0f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-105.ec2.internal,UID:ip-10-0-138-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-105.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-105.ec2.internal,},FirstTimestamp:2026-07-08 19:05:17.404883983 +0000 UTC m=+0.354154002,LastTimestamp:2026-07-08 19:05:17.404883983 +0000 UTC m=+0.354154002,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-105.ec2.internal,}" Jul 08 19:05:17.420711 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.420687 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cc78r" Jul 08 19:05:17.454998 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.454976 2554 manager.go:337] "Starting Device Plugin manager" Jul 08 19:05:17.455088 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:17.455009 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 19:05:17.455088 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.455019 2554 server.go:87] "Starting device plugin registration server" Jul 08 19:05:17.455332 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.455321 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 19:05:17.455377 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.455338 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 19:05:17.455585 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.455566 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 19:05:17.455705 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.455656 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 19:05:17.455705 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:17.455665 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 19:05:17.456075 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:17.456058 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 19:05:17.456146 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:17.456109 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-105.ec2.internal\" not found" Jul 08 19:05:18.791993 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.791925 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:05:18.792935 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.792915 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:05:18.793049 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.792947 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:05:18.793049 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.792960 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:05:18.793049 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.792990 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-105.ec2.internal" Jul 08 19:05:18.802195 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.802178 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-105.ec2.internal" Jul 08 19:05:18.802252 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:18.802202 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-105.ec2.internal\": node \"ip-10-0-138-105.ec2.internal\" not found" Jul 08 19:05:18.818520 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.818488 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 19:05:18.819796 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.819779 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 19:05:18.819895 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.819815 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 19:05:18.819895 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.819834 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 19:05:18.819895 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:18.819864 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 19:05:18.821958 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.821937 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:05:18.829271 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:18.829257 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jul 08 19:05:18.920429 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.920359 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal"] Jul 08 19:05:18.920629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.920493 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:05:18.921494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.921479 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:05:18.921557 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.921510 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:05:18.921557 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.921521 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:05:18.923681 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.923652 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a57e44e756b562997884ccffffa463c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal\" (UID: \"a57e44e756b562997884ccffffa463c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jul 08 19:05:18.923760 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.923687 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a57e44e756b562997884ccffffa463c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal\" (UID: \"a57e44e756b562997884ccffffa463c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jul 08 19:05:18.923954 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.923943 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:05:18.924068 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.924051 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jul 08 19:05:18.924103 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.924094 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:05:18.924647 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.924632 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:05:18.924647 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.924645 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:05:18.924771 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.924657 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:05:18.924771 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.924663 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:05:18.924771 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.924669 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:05:18.924771 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.924674 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:05:18.926948 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.926935 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" Jul 08 19:05:18.927022 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.926956 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:05:18.927641 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.927622 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:05:18.927715 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.927653 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:05:18.927715 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:18.927668 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:05:18.929309 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:18.929289 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jul 08 19:05:18.951200 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:18.951179 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-105.ec2.internal\" not found" node="ip-10-0-138-105.ec2.internal" Jul 08 19:05:18.955714 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:18.955698 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-105.ec2.internal\" not found" node="ip-10-0-138-105.ec2.internal" Jul 08 19:05:19.024582 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.024555 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a57e44e756b562997884ccffffa463c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal\" (UID: \"a57e44e756b562997884ccffffa463c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jul 08 19:05:19.024582 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.024576 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a57e44e756b562997884ccffffa463c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal\" (UID: \"a57e44e756b562997884ccffffa463c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jul 08 19:05:19.024750 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.024610 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a57e44e756b562997884ccffffa463c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal\" (UID: \"a57e44e756b562997884ccffffa463c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jul 08 19:05:19.024750 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.024632 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cde45a1e31fbf44904a4c0d935863798-config\") pod \"kube-apiserver-proxy-ip-10-0-138-105.ec2.internal\" (UID: \"cde45a1e31fbf44904a4c0d935863798\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" Jul 08 19:05:19.024750 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.024648 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a57e44e756b562997884ccffffa463c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal\" (UID: \"a57e44e756b562997884ccffffa463c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jul 08 19:05:19.029636 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:19.029621 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jul 08 19:05:19.125007 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.124925 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cde45a1e31fbf44904a4c0d935863798-config\") pod \"kube-apiserver-proxy-ip-10-0-138-105.ec2.internal\" (UID: \"cde45a1e31fbf44904a4c0d935863798\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" Jul 08 19:05:19.125007 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.124980 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cde45a1e31fbf44904a4c0d935863798-config\") pod \"kube-apiserver-proxy-ip-10-0-138-105.ec2.internal\" (UID: \"cde45a1e31fbf44904a4c0d935863798\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" Jul 08 19:05:19.130013 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:19.129993 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jul 08 19:05:19.230620 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:19.230571 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jul 08 19:05:19.254762 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.254736 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jul 08 19:05:19.260106 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.259969 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" Jul 08 19:05:19.331464 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:19.331430 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jul 08 19:05:19.432015 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:19.431934 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jul 08 19:05:19.501914 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.501891 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:05:19.532385 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:19.532356 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jul 08 19:05:19.557513 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.557491 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 19:05:19.558001 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.557672 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 19:05:19.558001 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.557672 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 19:05:19.633188 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:19.633160 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-105.ec2.internal\" not found" Jul 08 19:05:19.646570 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.646552 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:05:19.660294 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.660263 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 19:00:18 +0000 UTC" deadline="2028-03-27 03:09:37.652713368 +0000 UTC" Jul 08 19:05:19.660349 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.660295 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15056h4m17.992422383s" Jul 08 19:05:19.721678 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.721584 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" Jul 08 19:05:19.737348 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.737327 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 19:05:19.738237 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.738224 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" Jul 08 19:05:19.745922 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.745905 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 19:05:19.918078 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:19.918056 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:05:20.050728 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:20.050672 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde45a1e31fbf44904a4c0d935863798.slice/crio-c8e4be60e0894114dca4f7b6177edb13dc99129cb1b1bb5628cb63f38129e213 WatchSource:0}: Error finding container c8e4be60e0894114dca4f7b6177edb13dc99129cb1b1bb5628cb63f38129e213: Status 404 returned error can't find the container with id c8e4be60e0894114dca4f7b6177edb13dc99129cb1b1bb5628cb63f38129e213 Jul 08 19:05:20.053068 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:20.053042 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57e44e756b562997884ccffffa463c2.slice/crio-965b997fec1992c150043eb8436cec380967ab034175f76d062d1c1e6c0fe2a3 WatchSource:0}: Error finding container 965b997fec1992c150043eb8436cec380967ab034175f76d062d1c1e6c0fe2a3: Status 404 returned error can't find the container with id 965b997fec1992c150043eb8436cec380967ab034175f76d062d1c1e6c0fe2a3 Jul 08 19:05:20.056734 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.056715 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:05:20.600669 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.600643 2554 apiserver.go:52] "Watching apiserver" Jul 08 19:05:20.609034 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.609013 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 19:05:20.609365 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.609347 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-8k58p","openshift-multus/multus-additional-cni-plugins-zghgb","openshift-ovn-kubernetes/ovnkube-node-l49h6","kube-system/konnectivity-agent-8bbxh","kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal","openshift-multus/network-metrics-daemon-n9cvr","openshift-network-diagnostics/network-check-target-clvfv","openshift-network-operator/iptables-alerter-6m9k7","kube-system/global-pull-secret-syncer-s5ld2","openshift-cluster-node-tuning-operator/tuned-snczq","openshift-dns/node-resolver-hrtph","openshift-image-registry/node-ca-hcvlp"] Jul 08 19:05:20.612973 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.612952 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.615080 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.615059 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.615788 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.615770 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 19:05:20.615880 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.615837 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 19:05:20.615880 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.615845 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cphpk\"" Jul 08 19:05:20.615989 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.615883 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 19:05:20.615989 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.615900 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 19:05:20.617131 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.617118 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:20.617192 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:20.617170 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:20.620252 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.619107 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 19:05:20.620252 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.619173 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z47mx\"" Jul 08 19:05:20.620252 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.619855 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 19:05:20.620252 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.620245 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8bbxh" Jul 08 19:05:20.621680 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.621661 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 19:05:20.623308 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.623289 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 19:05:20.623375 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.623297 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v6c9m\"" Jul 08 19:05:20.623375 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.623348 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 19:05:20.623552 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.623537 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:20.623636 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:20.623618 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:20.625577 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.625560 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.627882 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.627861 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 19:05:20.627988 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.627890 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 19:05:20.627988 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.627933 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 19:05:20.627988 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.627892 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.628190 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.628009 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rb4bk\"" Jul 08 19:05:20.630270 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.630248 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 19:05:20.630464 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.630452 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6m9k7" Jul 08 19:05:20.631475 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631454 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 19:05:20.631567 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631486 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 19:05:20.631567 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631519 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 19:05:20.631567 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631537 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qm5c\" (UniqueName: \"kubernetes.io/projected/f8410cd6-d550-4965-b769-0e74878b627c-kube-api-access-5qm5c\") pod \"network-metrics-daemon-n9cvr\" (UID: \"f8410cd6-d550-4965-b769-0e74878b627c\") " pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:20.631736 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631490 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 19:05:20.631736 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631570 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-system-cni-dir\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.631736 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631454 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z7dcr\"" Jul 08 19:05:20.631736 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631643 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-os-release\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.631736 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631666 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0f41c78-6dd9-4703-a789-2e8b8588dd34-cni-binary-copy\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.631736 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631704 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0f41c78-6dd9-4703-a789-2e8b8588dd34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.631736 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfpwn\" (UniqueName: \"kubernetes.io/projected/b0f41c78-6dd9-4703-a789-2e8b8588dd34-kube-api-access-jfpwn\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.632014 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631755 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-multus-cni-dir\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632014 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-run-k8s-cni-cncf-io\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632014 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631796 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-run-netns\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632014 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631810 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-var-lib-kubelet\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632014 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631827 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0f41c78-6dd9-4703-a789-2e8b8588dd34-os-release\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.632014 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631866 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnsfs\" (UniqueName: \"kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs\") pod \"network-check-target-clvfv\" (UID: \"23ec8c0f-09a1-4ea4-8999-e4378d4938ff\") " pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:20.632014 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631879 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 19:05:20.632014 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631903 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0f41c78-6dd9-4703-a789-2e8b8588dd34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.632014 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631954 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-cnibin\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632014 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.631978 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b121dd4-c5ff-4d04-9599-aad1ff354619-cni-binary-copy\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632014 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632001 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-multus-socket-dir-parent\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632025 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-hostroot\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632048 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-multus-conf-dir\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632071 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0f41c78-6dd9-4703-a789-2e8b8588dd34-system-cni-dir\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632094 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-run-multus-certs\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632118 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d95c\" (UniqueName: \"kubernetes.io/projected/2b121dd4-c5ff-4d04-9599-aad1ff354619-kube-api-access-6d95c\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632141 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0f41c78-6dd9-4703-a789-2e8b8588dd34-cnibin\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632166 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c448e581-9ca2-401c-a035-4452fda297b2-agent-certs\") pod \"konnectivity-agent-8bbxh\" (UID: \"c448e581-9ca2-401c-a035-4452fda297b2\") " pod="kube-system/konnectivity-agent-8bbxh" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632189 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs\") pod \"network-metrics-daemon-n9cvr\" (UID: \"f8410cd6-d550-4965-b769-0e74878b627c\") " pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-etc-kubernetes\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632241 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0f41c78-6dd9-4703-a789-2e8b8588dd34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632267 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-var-lib-cni-multus\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632308 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b121dd4-c5ff-4d04-9599-aad1ff354619-multus-daemon-config\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632333 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c448e581-9ca2-401c-a035-4452fda297b2-konnectivity-ca\") pod \"konnectivity-agent-8bbxh\" (UID: \"c448e581-9ca2-401c-a035-4452fda297b2\") " pod="kube-system/konnectivity-agent-8bbxh" Jul 08 19:05:20.632494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632358 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-var-lib-cni-bin\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.632946 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632859 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:20.632996 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:20.632960 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:20.633052 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.632993 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 19:05:20.633100 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.633063 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 19:05:20.633100 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.633089 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tt58w\"" Jul 08 19:05:20.633197 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.633138 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:05:20.633806 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.633790 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 19:05:20.635153 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.635139 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.637534 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.637501 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hrtph" Jul 08 19:05:20.637778 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.637759 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 19:05:20.637871 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.637795 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:05:20.637871 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.637810 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sw7t4\"" Jul 08 19:05:20.639790 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.639773 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hcvlp" Jul 08 19:05:20.639932 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.639914 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 19:05:20.640282 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.640259 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k5nx8\"" Jul 08 19:05:20.640489 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.640476 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 19:05:20.642716 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.642699 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 19:05:20.642818 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.642707 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 19:05:20.642818 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.642762 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 19:05:20.643279 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.643265 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6g28z\"" Jul 08 19:05:20.667929 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.667911 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g2p78" Jul 08 19:05:20.676102 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.676081 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g2p78" Jul 08 19:05:20.705885 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.705863 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:05:20.722617 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.722582 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 19:05:20.732981 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.732954 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-systemd-units\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.733070 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.732982 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21e49c4f-5d7e-44ac-b90f-827735dab602-host-slash\") pod \"iptables-alerter-6m9k7\" (UID: \"21e49c4f-5d7e-44ac-b90f-827735dab602\") " pod="openshift-network-operator/iptables-alerter-6m9k7" Jul 08 19:05:20.733070 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733002 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.733070 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733031 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfpwn\" (UniqueName: \"kubernetes.io/projected/b0f41c78-6dd9-4703-a789-2e8b8588dd34-kube-api-access-jfpwn\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.733070 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733065 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-multus-cni-dir\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.733192 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733082 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-run-netns\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.733192 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733098 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-run-openvswitch\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.733253 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733206 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-log-socket\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.733253 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733213 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-run-netns\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.733253 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733226 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-multus-cni-dir\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.733339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733262 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-device-dir\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.733339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733279 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc77x\" (UniqueName: \"kubernetes.io/projected/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-kube-api-access-gc77x\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.733339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733295 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0f41c78-6dd9-4703-a789-2e8b8588dd34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.733339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733322 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-cnibin\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.733461 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733345 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b121dd4-c5ff-4d04-9599-aad1ff354619-cni-binary-copy\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.733461 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733367 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0f41c78-6dd9-4703-a789-2e8b8588dd34-system-cni-dir\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.733461 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733388 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0f41c78-6dd9-4703-a789-2e8b8588dd34-cnibin\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.733461 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733409 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c448e581-9ca2-401c-a035-4452fda297b2-agent-certs\") pod \"konnectivity-agent-8bbxh\" (UID: \"c448e581-9ca2-401c-a035-4452fda297b2\") " pod="kube-system/konnectivity-agent-8bbxh" Jul 08 19:05:20.733461 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733431 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9fc4fdec-4266-4d3f-84f2-d8af4e5b6088-hosts-file\") pod \"node-resolver-hrtph\" (UID: \"9fc4fdec-4266-4d3f-84f2-d8af4e5b6088\") " pod="openshift-dns/node-resolver-hrtph" Jul 08 19:05:20.733763 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733446 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-cnibin\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.733763 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733466 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0f41c78-6dd9-4703-a789-2e8b8588dd34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.733763 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733459 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0f41c78-6dd9-4703-a789-2e8b8588dd34-system-cni-dir\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.733763 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733569 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs\") pod \"network-metrics-daemon-n9cvr\" (UID: \"f8410cd6-d550-4965-b769-0e74878b627c\") " pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:20.733763 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733610 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-var-lib-kubelet\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.733763 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733632 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-run-netns\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.733763 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733653 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-run-ovn\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.733763 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:20.733663 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:20.733763 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-ovnkube-script-lib\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.733763 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733700 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-socket-dir\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.733763 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733570 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0f41c78-6dd9-4703-a789-2e8b8588dd34-cnibin\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.733763 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:20.733739 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs podName:f8410cd6-d550-4965-b769-0e74878b627c nodeName:}" failed. No retries permitted until 2026-07-08 19:05:21.233703918 +0000 UTC m=+2.946765919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs") pod "network-metrics-daemon-n9cvr" (UID: "f8410cd6-d550-4965-b769-0e74878b627c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733772 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0f41c78-6dd9-4703-a789-2e8b8588dd34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733797 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-modprobe-d\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733812 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fc4fdec-4266-4d3f-84f2-d8af4e5b6088-tmp-dir\") pod \"node-resolver-hrtph\" (UID: \"9fc4fdec-4266-4d3f-84f2-d8af4e5b6088\") " pod="openshift-dns/node-resolver-hrtph" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733832 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-run-systemd\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733848 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733901 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-env-overrides\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733930 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-var-lib-cni-multus\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733957 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b121dd4-c5ff-4d04-9599-aad1ff354619-multus-daemon-config\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-systemd\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.733985 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b121dd4-c5ff-4d04-9599-aad1ff354619-cni-binary-copy\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734007 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-var-lib-cni-multus\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734021 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-lib-modules\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734042 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-496x9\" (UniqueName: \"kubernetes.io/projected/9fc4fdec-4266-4d3f-84f2-d8af4e5b6088-kube-api-access-496x9\") pod \"node-resolver-hrtph\" (UID: \"9fc4fdec-4266-4d3f-84f2-d8af4e5b6088\") " pod="openshift-dns/node-resolver-hrtph" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734058 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-etc-openvswitch\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734081 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-registration-dir\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-var-lib-cni-bin\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.734317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734120 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734142 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-ovnkube-config\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734166 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-os-release\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734186 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-var-lib-cni-bin\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0f41c78-6dd9-4703-a789-2e8b8588dd34-cni-binary-copy\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734259 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-sysconfig\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734291 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-os-release\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734341 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0f41c78-6dd9-4703-a789-2e8b8588dd34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734381 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-sys\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734410 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7tss\" (UniqueName: \"kubernetes.io/projected/21e49c4f-5d7e-44ac-b90f-827735dab602-kube-api-access-l7tss\") pod \"iptables-alerter-6m9k7\" (UID: \"21e49c4f-5d7e-44ac-b90f-827735dab602\") " pod="openshift-network-operator/iptables-alerter-6m9k7" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734420 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2b121dd4-c5ff-4d04-9599-aad1ff354619-multus-daemon-config\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734443 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734469 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-run\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734496 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0f41c78-6dd9-4703-a789-2e8b8588dd34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734520 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-run-k8s-cni-cncf-io\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734560 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-var-lib-kubelet\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734585 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0f41c78-6dd9-4703-a789-2e8b8588dd34-os-release\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.735005 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734617 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-run-k8s-cni-cncf-io\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734627 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnsfs\" (UniqueName: \"kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs\") pod \"network-check-target-clvfv\" (UID: \"23ec8c0f-09a1-4ea4-8999-e4378d4938ff\") " pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734648 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-var-lib-kubelet\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734685 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0f41c78-6dd9-4703-a789-2e8b8588dd34-os-release\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734689 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0f41c78-6dd9-4703-a789-2e8b8588dd34-cni-binary-copy\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734712 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734737 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb47w\" (UniqueName: \"kubernetes.io/projected/089b8029-8358-46ca-8f97-6d0299bbc0fe-kube-api-access-hb47w\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734761 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-multus-socket-dir-parent\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734792 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-hostroot\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734815 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-multus-conf-dir\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734823 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-multus-socket-dir-parent\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734838 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-sysctl-d\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734857 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-hostroot\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734861 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-ovn-node-metrics-cert\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734884 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a7e5565-004d-4074-afba-446e2b1aa5bb-host\") pod \"node-ca-hcvlp\" (UID: \"9a7e5565-004d-4074-afba-446e2b1aa5bb\") " pod="openshift-image-registry/node-ca-hcvlp" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734901 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-run-multus-certs\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734900 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-multus-conf-dir\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.735795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734917 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d95c\" (UniqueName: \"kubernetes.io/projected/2b121dd4-c5ff-4d04-9599-aad1ff354619-kube-api-access-6d95c\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734933 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-tmp\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-sys-fs\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.734989 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-host-run-multus-certs\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735032 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0f41c78-6dd9-4703-a789-2e8b8588dd34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-etc-kubernetes\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735073 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2687d3bc-3cc1-44ef-8da4-be808f0e005b-dbus\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735082 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-etc-kubernetes\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735100 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735123 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-host\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735145 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-node-log\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735165 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c448e581-9ca2-401c-a035-4452fda297b2-konnectivity-ca\") pod \"konnectivity-agent-8bbxh\" (UID: \"c448e581-9ca2-401c-a035-4452fda297b2\") " pod="kube-system/konnectivity-agent-8bbxh" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735179 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-slash\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735195 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-var-lib-openvswitch\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735300 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qm5c\" (UniqueName: \"kubernetes.io/projected/f8410cd6-d550-4965-b769-0e74878b627c-kube-api-access-5qm5c\") pod \"network-metrics-daemon-n9cvr\" (UID: \"f8410cd6-d550-4965-b769-0e74878b627c\") " pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735335 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-kubernetes\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735441 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h9jl\" (UniqueName: \"kubernetes.io/projected/9a7e5565-004d-4074-afba-446e2b1aa5bb-kube-api-access-2h9jl\") pod \"node-ca-hcvlp\" (UID: \"9a7e5565-004d-4074-afba-446e2b1aa5bb\") " pod="openshift-image-registry/node-ca-hcvlp" Jul 08 19:05:20.736336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735469 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-system-cni-dir\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.736881 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735491 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-tuned\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.736881 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735505 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a7e5565-004d-4074-afba-446e2b1aa5bb-serviceca\") pod \"node-ca-hcvlp\" (UID: \"9a7e5565-004d-4074-afba-446e2b1aa5bb\") " pod="openshift-image-registry/node-ca-hcvlp" Jul 08 19:05:20.736881 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735510 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b121dd4-c5ff-4d04-9599-aad1ff354619-system-cni-dir\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.736881 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735519 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-cni-bin\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.736881 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735540 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-cni-netd\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.736881 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735566 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkmhf\" (UniqueName: \"kubernetes.io/projected/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-kube-api-access-vkmhf\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.736881 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735603 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21e49c4f-5d7e-44ac-b90f-827735dab602-iptables-alerter-script\") pod \"iptables-alerter-6m9k7\" (UID: \"21e49c4f-5d7e-44ac-b90f-827735dab602\") " pod="openshift-network-operator/iptables-alerter-6m9k7" Jul 08 19:05:20.736881 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735621 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2687d3bc-3cc1-44ef-8da4-be808f0e005b-kubelet-config\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:20.736881 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735635 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-sysctl-conf\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.736881 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735649 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-kubelet\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.736881 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.735691 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c448e581-9ca2-401c-a035-4452fda297b2-konnectivity-ca\") pod \"konnectivity-agent-8bbxh\" (UID: \"c448e581-9ca2-401c-a035-4452fda297b2\") " pod="kube-system/konnectivity-agent-8bbxh" Jul 08 19:05:20.737345 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.737228 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c448e581-9ca2-401c-a035-4452fda297b2-agent-certs\") pod \"konnectivity-agent-8bbxh\" (UID: \"c448e581-9ca2-401c-a035-4452fda297b2\") " pod="kube-system/konnectivity-agent-8bbxh" Jul 08 19:05:20.740881 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:20.740864 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:05:20.740970 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:20.740887 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:05:20.740970 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:20.740900 2554 projected.go:196] Error preparing data for projected volume kube-api-access-cnsfs for pod openshift-network-diagnostics/network-check-target-clvfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:20.740970 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:20.740962 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs podName:23ec8c0f-09a1-4ea4-8999-e4378d4938ff nodeName:}" failed. No retries permitted until 2026-07-08 19:05:21.240946683 +0000 UTC m=+2.954008691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cnsfs" (UniqueName: "kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs") pod "network-check-target-clvfv" (UID: "23ec8c0f-09a1-4ea4-8999-e4378d4938ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:20.742027 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.742002 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfpwn\" (UniqueName: \"kubernetes.io/projected/b0f41c78-6dd9-4703-a789-2e8b8588dd34-kube-api-access-jfpwn\") pod \"multus-additional-cni-plugins-zghgb\" (UID: \"b0f41c78-6dd9-4703-a789-2e8b8588dd34\") " pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.743013 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.742995 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qm5c\" (UniqueName: \"kubernetes.io/projected/f8410cd6-d550-4965-b769-0e74878b627c-kube-api-access-5qm5c\") pod \"network-metrics-daemon-n9cvr\" (UID: \"f8410cd6-d550-4965-b769-0e74878b627c\") " pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:20.743172 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.743156 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d95c\" (UniqueName: \"kubernetes.io/projected/2b121dd4-c5ff-4d04-9599-aad1ff354619-kube-api-access-6d95c\") pod \"multus-8k58p\" (UID: \"2b121dd4-c5ff-4d04-9599-aad1ff354619\") " pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.824497 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.824443 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" event={"ID":"a57e44e756b562997884ccffffa463c2","Type":"ContainerStarted","Data":"965b997fec1992c150043eb8436cec380967ab034175f76d062d1c1e6c0fe2a3"} Jul 08 19:05:20.825424 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.825402 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" event={"ID":"cde45a1e31fbf44904a4c0d935863798","Type":"ContainerStarted","Data":"c8e4be60e0894114dca4f7b6177edb13dc99129cb1b1bb5628cb63f38129e213"} Jul 08 19:05:20.836026 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836009 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb47w\" (UniqueName: \"kubernetes.io/projected/089b8029-8358-46ca-8f97-6d0299bbc0fe-kube-api-access-hb47w\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.836085 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836036 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-sysctl-d\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.836085 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836051 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-ovn-node-metrics-cert\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.836085 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836065 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a7e5565-004d-4074-afba-446e2b1aa5bb-host\") pod \"node-ca-hcvlp\" (UID: \"9a7e5565-004d-4074-afba-446e2b1aa5bb\") " pod="openshift-image-registry/node-ca-hcvlp" Jul 08 19:05:20.836198 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836085 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-tmp\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.836198 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836150 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a7e5565-004d-4074-afba-446e2b1aa5bb-host\") pod \"node-ca-hcvlp\" (UID: \"9a7e5565-004d-4074-afba-446e2b1aa5bb\") " pod="openshift-image-registry/node-ca-hcvlp" Jul 08 19:05:20.836272 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836196 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-sys-fs\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.836272 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836228 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2687d3bc-3cc1-44ef-8da4-be808f0e005b-dbus\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:20.836272 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836240 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-sys-fs\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.836272 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836196 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-sysctl-d\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.836420 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836254 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:20.836420 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836312 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-host\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.836420 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-node-log\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.836420 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836343 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2687d3bc-3cc1-44ef-8da4-be808f0e005b-dbus\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:20.836420 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836352 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-host\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.836420 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:20.836315 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:20.836420 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836365 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-slash\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.836420 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836388 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-node-log\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.836420 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836391 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-var-lib-openvswitch\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:20.836424 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret podName:2687d3bc-3cc1-44ef-8da4-be808f0e005b nodeName:}" failed. No retries permitted until 2026-07-08 19:05:21.336389173 +0000 UTC m=+3.049451176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret") pod "global-pull-secret-syncer-s5ld2" (UID: "2687d3bc-3cc1-44ef-8da4-be808f0e005b") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836430 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-slash\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836438 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-var-lib-openvswitch\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836487 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-kubernetes\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836515 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h9jl\" (UniqueName: \"kubernetes.io/projected/9a7e5565-004d-4074-afba-446e2b1aa5bb-kube-api-access-2h9jl\") pod \"node-ca-hcvlp\" (UID: \"9a7e5565-004d-4074-afba-446e2b1aa5bb\") " pod="openshift-image-registry/node-ca-hcvlp" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836539 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-tuned\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836559 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a7e5565-004d-4074-afba-446e2b1aa5bb-serviceca\") pod \"node-ca-hcvlp\" (UID: \"9a7e5565-004d-4074-afba-446e2b1aa5bb\") " pod="openshift-image-registry/node-ca-hcvlp" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836567 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-kubernetes\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-cni-bin\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836618 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-cni-netd\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836644 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkmhf\" (UniqueName: \"kubernetes.io/projected/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-kube-api-access-vkmhf\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836670 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21e49c4f-5d7e-44ac-b90f-827735dab602-iptables-alerter-script\") pod \"iptables-alerter-6m9k7\" (UID: \"21e49c4f-5d7e-44ac-b90f-827735dab602\") " pod="openshift-network-operator/iptables-alerter-6m9k7" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836673 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-cni-netd\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836695 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2687d3bc-3cc1-44ef-8da4-be808f0e005b-kubelet-config\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836645 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-cni-bin\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.836870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836726 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-sysctl-conf\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836743 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2687d3bc-3cc1-44ef-8da4-be808f0e005b-kubelet-config\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836751 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-kubelet\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836809 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-systemd-units\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836833 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21e49c4f-5d7e-44ac-b90f-827735dab602-host-slash\") pod \"iptables-alerter-6m9k7\" (UID: \"21e49c4f-5d7e-44ac-b90f-827735dab602\") " pod="openshift-network-operator/iptables-alerter-6m9k7" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836881 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-kubelet\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836900 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-sysctl-conf\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836905 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-systemd-units\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836911 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836931 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21e49c4f-5d7e-44ac-b90f-827735dab602-host-slash\") pod \"iptables-alerter-6m9k7\" (UID: \"21e49c4f-5d7e-44ac-b90f-827735dab602\") " pod="openshift-network-operator/iptables-alerter-6m9k7" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836952 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-run-openvswitch\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836969 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.836978 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-log-socket\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837002 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-device-dir\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837020 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-run-openvswitch\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc77x\" (UniqueName: \"kubernetes.io/projected/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-kube-api-access-gc77x\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837039 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-log-socket\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.837629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837068 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9fc4fdec-4266-4d3f-84f2-d8af4e5b6088-hosts-file\") pod \"node-resolver-hrtph\" (UID: \"9fc4fdec-4266-4d3f-84f2-d8af4e5b6088\") " pod="openshift-dns/node-resolver-hrtph" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837080 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-device-dir\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-var-lib-kubelet\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837156 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-run-netns\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837190 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-run-ovn\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837199 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-run-netns\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837218 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-ovnkube-script-lib\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837237 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9fc4fdec-4266-4d3f-84f2-d8af4e5b6088-hosts-file\") pod \"node-resolver-hrtph\" (UID: \"9fc4fdec-4266-4d3f-84f2-d8af4e5b6088\") " pod="openshift-dns/node-resolver-hrtph" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837245 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-socket-dir\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837278 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21e49c4f-5d7e-44ac-b90f-827735dab602-iptables-alerter-script\") pod \"iptables-alerter-6m9k7\" (UID: \"21e49c4f-5d7e-44ac-b90f-827735dab602\") " pod="openshift-network-operator/iptables-alerter-6m9k7" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837288 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-run-ovn\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837295 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-var-lib-kubelet\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837312 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a7e5565-004d-4074-afba-446e2b1aa5bb-serviceca\") pod \"node-ca-hcvlp\" (UID: \"9a7e5565-004d-4074-afba-446e2b1aa5bb\") " pod="openshift-image-registry/node-ca-hcvlp" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837330 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-modprobe-d\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837358 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fc4fdec-4266-4d3f-84f2-d8af4e5b6088-tmp-dir\") pod \"node-resolver-hrtph\" (UID: \"9fc4fdec-4266-4d3f-84f2-d8af4e5b6088\") " pod="openshift-dns/node-resolver-hrtph" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837383 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-run-systemd\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837395 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-socket-dir\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837406 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-env-overrides\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.838512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837437 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-systemd\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837463 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-lib-modules\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837473 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-modprobe-d\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837490 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-496x9\" (UniqueName: \"kubernetes.io/projected/9fc4fdec-4266-4d3f-84f2-d8af4e5b6088-kube-api-access-496x9\") pod \"node-resolver-hrtph\" (UID: \"9fc4fdec-4266-4d3f-84f2-d8af4e5b6088\") " pod="openshift-dns/node-resolver-hrtph" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837514 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-etc-openvswitch\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837520 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-systemd\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837537 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-registration-dir\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837557 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-run-systemd\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837564 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837634 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837641 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-etc-openvswitch\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837671 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fc4fdec-4266-4d3f-84f2-d8af4e5b6088-tmp-dir\") pod \"node-resolver-hrtph\" (UID: \"9fc4fdec-4266-4d3f-84f2-d8af4e5b6088\") " pod="openshift-dns/node-resolver-hrtph" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837688 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-registration-dir\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837753 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-lib-modules\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837781 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-ovnkube-config\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837810 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-sysconfig\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837823 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-ovnkube-script-lib\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.839390 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837832 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-sys\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837780 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-env-overrides\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837857 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7tss\" (UniqueName: \"kubernetes.io/projected/21e49c4f-5d7e-44ac-b90f-827735dab602-kube-api-access-l7tss\") pod \"iptables-alerter-6m9k7\" (UID: \"21e49c4f-5d7e-44ac-b90f-827735dab602\") " pod="openshift-network-operator/iptables-alerter-6m9k7" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837882 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837902 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-run\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837916 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-sysconfig\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837945 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.837963 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-sys\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.838015 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-run\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.838016 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.838083 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/089b8029-8358-46ca-8f97-6d0299bbc0fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.838314 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-ovnkube-config\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.838573 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-ovn-node-metrics-cert\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.838620 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-tmp\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.839944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.839608 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-etc-tuned\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.845340 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.845311 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h9jl\" (UniqueName: \"kubernetes.io/projected/9a7e5565-004d-4074-afba-446e2b1aa5bb-kube-api-access-2h9jl\") pod \"node-ca-hcvlp\" (UID: \"9a7e5565-004d-4074-afba-446e2b1aa5bb\") " pod="openshift-image-registry/node-ca-hcvlp" Jul 08 19:05:20.845546 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.845528 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb47w\" (UniqueName: \"kubernetes.io/projected/089b8029-8358-46ca-8f97-6d0299bbc0fe-kube-api-access-hb47w\") pod \"aws-ebs-csi-driver-node-d9mkd\" (UID: \"089b8029-8358-46ca-8f97-6d0299bbc0fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.845656 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.845626 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc77x\" (UniqueName: \"kubernetes.io/projected/448c84fb-dbfd-47f1-9de7-0432bcfd3c5d-kube-api-access-gc77x\") pod \"tuned-snczq\" (UID: \"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d\") " pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.846078 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.846056 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkmhf\" (UniqueName: \"kubernetes.io/projected/8a93ffa9-7327-4a99-b3ba-bff5597b10f7-kube-api-access-vkmhf\") pod \"ovnkube-node-l49h6\" (UID: \"8a93ffa9-7327-4a99-b3ba-bff5597b10f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.846631 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.846613 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-496x9\" (UniqueName: \"kubernetes.io/projected/9fc4fdec-4266-4d3f-84f2-d8af4e5b6088-kube-api-access-496x9\") pod \"node-resolver-hrtph\" (UID: \"9fc4fdec-4266-4d3f-84f2-d8af4e5b6088\") " pod="openshift-dns/node-resolver-hrtph" Jul 08 19:05:20.847405 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.847389 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7tss\" (UniqueName: \"kubernetes.io/projected/21e49c4f-5d7e-44ac-b90f-827735dab602-kube-api-access-l7tss\") pod \"iptables-alerter-6m9k7\" (UID: \"21e49c4f-5d7e-44ac-b90f-827735dab602\") " pod="openshift-network-operator/iptables-alerter-6m9k7" Jul 08 19:05:20.923354 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.923293 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8k58p" Jul 08 19:05:20.929517 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.929497 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zghgb" Jul 08 19:05:20.933385 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:20.933367 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b121dd4_c5ff_4d04_9599_aad1ff354619.slice/crio-36d09605282468f014b6550f7b0783f554e6ccd1ccb15564f29b2b05a2216f76 WatchSource:0}: Error finding container 36d09605282468f014b6550f7b0783f554e6ccd1ccb15564f29b2b05a2216f76: Status 404 returned error can't find the container with id 36d09605282468f014b6550f7b0783f554e6ccd1ccb15564f29b2b05a2216f76 Jul 08 19:05:20.936353 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.936339 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8bbxh" Jul 08 19:05:20.940247 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:20.939915 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f41c78_6dd9_4703_a789_2e8b8588dd34.slice/crio-fd9cc618f33730b1de24973452270830f7303fb261ea4dd69af188b82eb1f310 WatchSource:0}: Error finding container fd9cc618f33730b1de24973452270830f7303fb261ea4dd69af188b82eb1f310: Status 404 returned error can't find the container with id fd9cc618f33730b1de24973452270830f7303fb261ea4dd69af188b82eb1f310 Jul 08 19:05:20.940966 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.940943 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" Jul 08 19:05:20.947090 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.947071 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:20.947543 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:20.947520 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc448e581_9ca2_401c_a035_4452fda297b2.slice/crio-ca2ecd74df5b6e18b954c1a916ffc0665ce38f1fdcef28cc79d518a1701c1371 WatchSource:0}: Error finding container ca2ecd74df5b6e18b954c1a916ffc0665ce38f1fdcef28cc79d518a1701c1371: Status 404 returned error can't find the container with id ca2ecd74df5b6e18b954c1a916ffc0665ce38f1fdcef28cc79d518a1701c1371 Jul 08 19:05:20.950514 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:20.950488 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod089b8029_8358_46ca_8f97_6d0299bbc0fe.slice/crio-600268ae31b20d9d9ad64952d0c452a5109a545c212731b65e8061f6f794662e WatchSource:0}: Error finding container 600268ae31b20d9d9ad64952d0c452a5109a545c212731b65e8061f6f794662e: Status 404 returned error can't find the container with id 600268ae31b20d9d9ad64952d0c452a5109a545c212731b65e8061f6f794662e Jul 08 19:05:20.952295 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.952275 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6m9k7" Jul 08 19:05:20.956870 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:20.956849 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a93ffa9_7327_4a99_b3ba_bff5597b10f7.slice/crio-23c01434d036206beb573f743cf83855dcdebceddb1cb5ab9475ada29eaefe57 WatchSource:0}: Error finding container 23c01434d036206beb573f743cf83855dcdebceddb1cb5ab9475ada29eaefe57: Status 404 returned error can't find the container with id 23c01434d036206beb573f743cf83855dcdebceddb1cb5ab9475ada29eaefe57 Jul 08 19:05:20.958401 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.958155 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-snczq" Jul 08 19:05:20.963540 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.963478 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hrtph" Jul 08 19:05:20.965652 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:20.965628 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e49c4f_5d7e_44ac_b90f_827735dab602.slice/crio-b76cad933ad868ca676c510ac6a0dea3091ee29a75917900bc8dab434bbc8a08 WatchSource:0}: Error finding container b76cad933ad868ca676c510ac6a0dea3091ee29a75917900bc8dab434bbc8a08: Status 404 returned error can't find the container with id b76cad933ad868ca676c510ac6a0dea3091ee29a75917900bc8dab434bbc8a08 Jul 08 19:05:20.967469 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:20.967315 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod448c84fb_dbfd_47f1_9de7_0432bcfd3c5d.slice/crio-3c042fdf453e2309a7927b2a928169515c5dce5905d7b33023d28b3d9b84fff8 WatchSource:0}: Error finding container 3c042fdf453e2309a7927b2a928169515c5dce5905d7b33023d28b3d9b84fff8: Status 404 returned error can't find the container with id 3c042fdf453e2309a7927b2a928169515c5dce5905d7b33023d28b3d9b84fff8 Jul 08 19:05:20.967728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:20.967634 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hcvlp" Jul 08 19:05:20.975344 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:20.975320 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc4fdec_4266_4d3f_84f2_d8af4e5b6088.slice/crio-4ba8949d012333a699547aa99636b16992605fe5e41655e92b66d55b833c20a8 WatchSource:0}: Error finding container 4ba8949d012333a699547aa99636b16992605fe5e41655e92b66d55b833c20a8: Status 404 returned error can't find the container with id 4ba8949d012333a699547aa99636b16992605fe5e41655e92b66d55b833c20a8 Jul 08 19:05:20.978353 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:20.978331 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7e5565_004d_4074_afba_446e2b1aa5bb.slice/crio-8fe8dd809acb2e1bc1d0aaa3b122cb2f2d40482a78ad274d20ceae518795b58f WatchSource:0}: Error finding container 8fe8dd809acb2e1bc1d0aaa3b122cb2f2d40482a78ad274d20ceae518795b58f: Status 404 returned error can't find the container with id 8fe8dd809acb2e1bc1d0aaa3b122cb2f2d40482a78ad274d20ceae518795b58f Jul 08 19:05:21.241065 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.240976 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnsfs\" (UniqueName: \"kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs\") pod \"network-check-target-clvfv\" (UID: \"23ec8c0f-09a1-4ea4-8999-e4378d4938ff\") " pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:21.241214 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.241076 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs\") pod \"network-metrics-daemon-n9cvr\" (UID: \"f8410cd6-d550-4965-b769-0e74878b627c\") " pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:21.241214 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:21.241176 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:05:21.241214 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:21.241203 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:05:21.241214 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:21.241208 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:21.241404 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:21.241218 2554 projected.go:196] Error preparing data for projected volume kube-api-access-cnsfs for pod openshift-network-diagnostics/network-check-target-clvfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:21.241404 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:21.241274 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs podName:f8410cd6-d550-4965-b769-0e74878b627c nodeName:}" failed. No retries permitted until 2026-07-08 19:05:22.241255349 +0000 UTC m=+3.954317341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs") pod "network-metrics-daemon-n9cvr" (UID: "f8410cd6-d550-4965-b769-0e74878b627c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:21.241404 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:21.241292 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs podName:23ec8c0f-09a1-4ea4-8999-e4378d4938ff nodeName:}" failed. No retries permitted until 2026-07-08 19:05:22.241282203 +0000 UTC m=+3.954344194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnsfs" (UniqueName: "kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs") pod "network-check-target-clvfv" (UID: "23ec8c0f-09a1-4ea4-8999-e4378d4938ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:21.342094 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.342057 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:21.342260 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:21.342233 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:21.342321 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:21.342315 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret podName:2687d3bc-3cc1-44ef-8da4-be808f0e005b nodeName:}" failed. No retries permitted until 2026-07-08 19:05:22.342292961 +0000 UTC m=+4.055354948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret") pod "global-pull-secret-syncer-s5ld2" (UID: "2687d3bc-3cc1-44ef-8da4-be808f0e005b") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:21.679642 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.679534 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 19:00:20 +0000 UTC" deadline="2028-04-20 18:29:57.401682184 +0000 UTC" Jul 08 19:05:21.679642 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.679573 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15647h24m35.722113631s" Jul 08 19:05:21.830392 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.830350 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" event={"ID":"8a93ffa9-7327-4a99-b3ba-bff5597b10f7","Type":"ContainerStarted","Data":"23c01434d036206beb573f743cf83855dcdebceddb1cb5ab9475ada29eaefe57"} Jul 08 19:05:21.838736 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.838661 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zghgb" event={"ID":"b0f41c78-6dd9-4703-a789-2e8b8588dd34","Type":"ContainerStarted","Data":"fd9cc618f33730b1de24973452270830f7303fb261ea4dd69af188b82eb1f310"} Jul 08 19:05:21.842083 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.841927 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8k58p" event={"ID":"2b121dd4-c5ff-4d04-9599-aad1ff354619","Type":"ContainerStarted","Data":"36d09605282468f014b6550f7b0783f554e6ccd1ccb15564f29b2b05a2216f76"} Jul 08 19:05:21.850750 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.850725 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hcvlp" event={"ID":"9a7e5565-004d-4074-afba-446e2b1aa5bb","Type":"ContainerStarted","Data":"8fe8dd809acb2e1bc1d0aaa3b122cb2f2d40482a78ad274d20ceae518795b58f"} Jul 08 19:05:21.854733 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.854708 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hrtph" event={"ID":"9fc4fdec-4266-4d3f-84f2-d8af4e5b6088","Type":"ContainerStarted","Data":"4ba8949d012333a699547aa99636b16992605fe5e41655e92b66d55b833c20a8"} Jul 08 19:05:21.859076 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.859011 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-snczq" event={"ID":"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d","Type":"ContainerStarted","Data":"3c042fdf453e2309a7927b2a928169515c5dce5905d7b33023d28b3d9b84fff8"} Jul 08 19:05:21.864850 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.864829 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6m9k7" event={"ID":"21e49c4f-5d7e-44ac-b90f-827735dab602","Type":"ContainerStarted","Data":"b76cad933ad868ca676c510ac6a0dea3091ee29a75917900bc8dab434bbc8a08"} Jul 08 19:05:21.867465 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.867390 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" event={"ID":"089b8029-8358-46ca-8f97-6d0299bbc0fe","Type":"ContainerStarted","Data":"600268ae31b20d9d9ad64952d0c452a5109a545c212731b65e8061f6f794662e"} Jul 08 19:05:21.874461 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:21.874411 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8bbxh" event={"ID":"c448e581-9ca2-401c-a035-4452fda297b2","Type":"ContainerStarted","Data":"ca2ecd74df5b6e18b954c1a916ffc0665ce38f1fdcef28cc79d518a1701c1371"} Jul 08 19:05:22.128091 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:22.128010 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:05:22.249498 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:22.249463 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnsfs\" (UniqueName: \"kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs\") pod \"network-check-target-clvfv\" (UID: \"23ec8c0f-09a1-4ea4-8999-e4378d4938ff\") " pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:22.249701 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:22.249550 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs\") pod \"network-metrics-daemon-n9cvr\" (UID: \"f8410cd6-d550-4965-b769-0e74878b627c\") " pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:22.249701 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:22.249691 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:22.249817 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:22.249753 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs podName:f8410cd6-d550-4965-b769-0e74878b627c nodeName:}" failed. No retries permitted until 2026-07-08 19:05:24.249734726 +0000 UTC m=+5.962796715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs") pod "network-metrics-daemon-n9cvr" (UID: "f8410cd6-d550-4965-b769-0e74878b627c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:22.250176 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:22.250159 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:05:22.250257 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:22.250181 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:05:22.250257 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:22.250195 2554 projected.go:196] Error preparing data for projected volume kube-api-access-cnsfs for pod openshift-network-diagnostics/network-check-target-clvfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:22.250257 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:22.250246 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs podName:23ec8c0f-09a1-4ea4-8999-e4378d4938ff nodeName:}" failed. No retries permitted until 2026-07-08 19:05:24.250232306 +0000 UTC m=+5.963294297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnsfs" (UniqueName: "kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs") pod "network-check-target-clvfv" (UID: "23ec8c0f-09a1-4ea4-8999-e4378d4938ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:22.353320 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:22.352525 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:22.353320 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:22.352752 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:22.353320 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:22.352818 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret podName:2687d3bc-3cc1-44ef-8da4-be808f0e005b nodeName:}" failed. No retries permitted until 2026-07-08 19:05:24.352799867 +0000 UTC m=+6.065861859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret") pod "global-pull-secret-syncer-s5ld2" (UID: "2687d3bc-3cc1-44ef-8da4-be808f0e005b") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:22.680107 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:22.680061 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 19:00:20 +0000 UTC" deadline="2028-02-22 14:22:12.121051913 +0000 UTC" Jul 08 19:05:22.680107 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:22.680104 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14251h16m49.440952623s" Jul 08 19:05:22.823137 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:22.823111 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:22.823250 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:22.823231 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:22.823700 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:22.823656 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:22.823859 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:22.823760 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:22.823859 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:22.823821 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:22.824083 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:22.823890 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:24.273114 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:24.273074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs\") pod \"network-metrics-daemon-n9cvr\" (UID: \"f8410cd6-d550-4965-b769-0e74878b627c\") " pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:24.273580 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:24.273141 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnsfs\" (UniqueName: \"kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs\") pod \"network-check-target-clvfv\" (UID: \"23ec8c0f-09a1-4ea4-8999-e4378d4938ff\") " pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:24.273580 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:24.273296 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:05:24.273580 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:24.273312 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:05:24.273580 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:24.273325 2554 projected.go:196] Error preparing data for projected volume kube-api-access-cnsfs for pod openshift-network-diagnostics/network-check-target-clvfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:24.273580 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:24.273381 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs podName:23ec8c0f-09a1-4ea4-8999-e4378d4938ff nodeName:}" failed. No retries permitted until 2026-07-08 19:05:28.273363892 +0000 UTC m=+9.986425902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnsfs" (UniqueName: "kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs") pod "network-check-target-clvfv" (UID: "23ec8c0f-09a1-4ea4-8999-e4378d4938ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:24.273892 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:24.273851 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:24.273941 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:24.273899 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs podName:f8410cd6-d550-4965-b769-0e74878b627c nodeName:}" failed. No retries permitted until 2026-07-08 19:05:28.273883855 +0000 UTC m=+9.986945847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs") pod "network-metrics-daemon-n9cvr" (UID: "f8410cd6-d550-4965-b769-0e74878b627c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:24.374524 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:24.373942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:24.374524 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:24.374122 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:24.374524 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:24.374182 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret podName:2687d3bc-3cc1-44ef-8da4-be808f0e005b nodeName:}" failed. No retries permitted until 2026-07-08 19:05:28.37416511 +0000 UTC m=+10.087227101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret") pod "global-pull-secret-syncer-s5ld2" (UID: "2687d3bc-3cc1-44ef-8da4-be808f0e005b") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:24.820824 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:24.820788 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:24.820992 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:24.820790 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:24.820992 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:24.820938 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:24.820992 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:24.820943 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:24.821161 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:24.821043 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:24.821161 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:24.821127 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:26.821100 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:26.820880 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:26.821543 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:26.820880 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:26.821543 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:26.821228 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:26.821543 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:26.820880 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:26.821543 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:26.821263 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:26.821543 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:26.821350 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:28.302246 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:28.302203 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs\") pod \"network-metrics-daemon-n9cvr\" (UID: \"f8410cd6-d550-4965-b769-0e74878b627c\") " pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:28.302710 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:28.302270 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnsfs\" (UniqueName: \"kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs\") pod \"network-check-target-clvfv\" (UID: \"23ec8c0f-09a1-4ea4-8999-e4378d4938ff\") " pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:28.302710 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:28.302379 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:28.302710 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:28.302405 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:05:28.302710 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:28.302422 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:05:28.302710 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:28.302435 2554 projected.go:196] Error preparing data for projected volume kube-api-access-cnsfs for pod openshift-network-diagnostics/network-check-target-clvfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:28.302710 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:28.302460 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs podName:f8410cd6-d550-4965-b769-0e74878b627c nodeName:}" failed. No retries permitted until 2026-07-08 19:05:36.302438351 +0000 UTC m=+18.015500343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs") pod "network-metrics-daemon-n9cvr" (UID: "f8410cd6-d550-4965-b769-0e74878b627c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:28.302710 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:28.302485 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs podName:23ec8c0f-09a1-4ea4-8999-e4378d4938ff nodeName:}" failed. No retries permitted until 2026-07-08 19:05:36.302470092 +0000 UTC m=+18.015532099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnsfs" (UniqueName: "kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs") pod "network-check-target-clvfv" (UID: "23ec8c0f-09a1-4ea4-8999-e4378d4938ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:28.403718 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:28.403611 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:28.403906 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:28.403795 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:28.403906 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:28.403878 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret podName:2687d3bc-3cc1-44ef-8da4-be808f0e005b nodeName:}" failed. No retries permitted until 2026-07-08 19:05:36.403856715 +0000 UTC m=+18.116918708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret") pod "global-pull-secret-syncer-s5ld2" (UID: "2687d3bc-3cc1-44ef-8da4-be808f0e005b") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:28.821455 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:28.821139 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:28.821455 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:28.821258 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:28.821455 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:28.821377 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:28.821742 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:28.821492 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:28.821742 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:28.821555 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:28.821742 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:28.821643 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:30.820502 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:30.820467 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:30.821009 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:30.820480 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:30.821009 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:30.820634 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:30.821009 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:30.820717 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:30.821009 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:30.820766 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:30.821009 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:30.820832 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:32.822397 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:32.821909 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:32.822397 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:32.822037 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:32.822397 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:32.822376 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:32.822880 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:32.822464 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:32.822880 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:32.822508 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:32.822880 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:32.822555 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:32.909419 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:32.909357 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" event={"ID":"cde45a1e31fbf44904a4c0d935863798","Type":"ContainerStarted","Data":"d6b56e76e16ebed751c83617ca1d432e3af3e643eba8f4d1d6e67b473d03c7d5"} Jul 08 19:05:32.911165 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:32.911127 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-snczq" event={"ID":"448c84fb-dbfd-47f1-9de7-0432bcfd3c5d","Type":"ContainerStarted","Data":"f0b8f8d3b0e9e8a7df74c4b3543bc6dfb22e101e5b824a9bf9c60d496b6eac48"} Jul 08 19:05:32.943139 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:32.943084 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-105.ec2.internal" podStartSLOduration=13.943069115 podStartE2EDuration="13.943069115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:32.925617481 +0000 UTC m=+14.638679487" watchObservedRunningTime="2026-07-08 19:05:32.943069115 +0000 UTC m=+14.656131120" Jul 08 19:05:32.943429 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:32.943407 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-snczq" podStartSLOduration=2.677191509 podStartE2EDuration="13.943399978s" totalImagesPullingTime="11.266208469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:32.942953208 +0000 UTC m=+14.656015219" watchObservedRunningTime="2026-07-08 19:05:32.943399978 +0000 UTC m=+14.656461999" Jul 08 19:05:33.915786 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:33.915464 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" event={"ID":"a57e44e756b562997884ccffffa463c2","Type":"ContainerStarted","Data":"192c01eeb1d46ed37ab04f91355e8055a0b5478cb1f6319fc984e41d4c673c49"} Jul 08 19:05:33.917228 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:33.917196 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hcvlp" event={"ID":"9a7e5565-004d-4074-afba-446e2b1aa5bb","Type":"ContainerStarted","Data":"27573fc1d84b3711059483a9a95f766fa0c0eb4b6d7ec996a1690671b92d74df"} Jul 08 19:05:33.918855 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:33.918834 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hrtph" event={"ID":"9fc4fdec-4266-4d3f-84f2-d8af4e5b6088","Type":"ContainerStarted","Data":"081a05622e5aff18a6099690d91340d73e8e6f9ec62d0e1219c659c8a3b88545"} Jul 08 19:05:33.920655 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:33.920623 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" event={"ID":"089b8029-8358-46ca-8f97-6d0299bbc0fe","Type":"ContainerStarted","Data":"ec566988045fee846050534b0ae1b63e23190fe42a9ddaed2a1c79e427b72307"} Jul 08 19:05:33.922255 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:33.922211 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8bbxh" event={"ID":"c448e581-9ca2-401c-a035-4452fda297b2","Type":"ContainerStarted","Data":"79f52e05666cd50e3906d7473182ba03fd946bc1027492199db54241e80c8504"} Jul 08 19:05:33.923813 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:33.923785 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zghgb" event={"ID":"b0f41c78-6dd9-4703-a789-2e8b8588dd34","Type":"ContainerStarted","Data":"5d7a958b81f544d9d0c45b3723fe64e74ff5b0bab1f56a47323c7aa657cb31f1"} Jul 08 19:05:33.949118 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:33.949072 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hcvlp" podStartSLOduration=3.695154333 podStartE2EDuration="14.949054624s" totalImagesPullingTime="11.253900291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:33.948508982 +0000 UTC m=+15.661570992" watchObservedRunningTime="2026-07-08 19:05:33.949054624 +0000 UTC m=+15.662116634" Jul 08 19:05:34.002082 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:34.002035 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hrtph" podStartSLOduration=3.790939787 podStartE2EDuration="15.002019388s" totalImagesPullingTime="11.211079601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:34.001791757 +0000 UTC m=+15.714853768" watchObservedRunningTime="2026-07-08 19:05:34.002019388 +0000 UTC m=+15.715081396" Jul 08 19:05:34.002542 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:34.002513 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8bbxh" podStartSLOduration=4.763523072 podStartE2EDuration="16.002503208s" totalImagesPullingTime="11.238980136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:33.986659276 +0000 UTC m=+15.699721287" watchObservedRunningTime="2026-07-08 19:05:34.002503208 +0000 UTC m=+15.715565216" Jul 08 19:05:34.396500 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:34.396456 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8bbxh" Jul 08 19:05:34.397072 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:34.397053 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8bbxh" Jul 08 19:05:34.820723 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:34.820690 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:34.820888 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:34.820691 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:34.820888 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:34.820817 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:34.821015 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:34.820697 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:34.821015 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:34.820947 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:34.821103 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:34.821065 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:34.927757 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:34.927719 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6m9k7" event={"ID":"21e49c4f-5d7e-44ac-b90f-827735dab602","Type":"ContainerStarted","Data":"cb2fe8ef9ed178695065bece8f96c79d46a39707514bd1f1c3aa756fc79877a8"} Jul 08 19:05:34.944537 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:34.944489 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6m9k7" podStartSLOduration=4.671477214 podStartE2EDuration="15.944468893s" totalImagesPullingTime="11.272991679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:34.943389017 +0000 UTC m=+16.656451030" watchObservedRunningTime="2026-07-08 19:05:34.944468893 +0000 UTC m=+16.657530903" Jul 08 19:05:35.929606 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:35.929565 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 19:05:36.360821 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:36.360788 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnsfs\" (UniqueName: \"kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs\") pod \"network-check-target-clvfv\" (UID: \"23ec8c0f-09a1-4ea4-8999-e4378d4938ff\") " pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:36.360996 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:36.360870 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs\") pod \"network-metrics-daemon-n9cvr\" (UID: \"f8410cd6-d550-4965-b769-0e74878b627c\") " pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:36.360996 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:36.360949 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:05:36.360996 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:36.360966 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:05:36.360996 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:36.360976 2554 projected.go:196] Error preparing data for projected volume kube-api-access-cnsfs for pod openshift-network-diagnostics/network-check-target-clvfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:36.360996 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:36.360984 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:36.361251 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:36.361031 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs podName:23ec8c0f-09a1-4ea4-8999-e4378d4938ff nodeName:}" failed. No retries permitted until 2026-07-08 19:05:52.361011185 +0000 UTC m=+34.074073180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnsfs" (UniqueName: "kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs") pod "network-check-target-clvfv" (UID: "23ec8c0f-09a1-4ea4-8999-e4378d4938ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:36.361251 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:36.361051 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs podName:f8410cd6-d550-4965-b769-0e74878b627c nodeName:}" failed. No retries permitted until 2026-07-08 19:05:52.361041677 +0000 UTC m=+34.074103684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs") pod "network-metrics-daemon-n9cvr" (UID: "f8410cd6-d550-4965-b769-0e74878b627c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:36.461727 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:36.461701 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:36.461893 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:36.461861 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:36.461958 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:36.461925 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret podName:2687d3bc-3cc1-44ef-8da4-be808f0e005b nodeName:}" failed. No retries permitted until 2026-07-08 19:05:52.461905515 +0000 UTC m=+34.174967504 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret") pod "global-pull-secret-syncer-s5ld2" (UID: "2687d3bc-3cc1-44ef-8da4-be808f0e005b") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:36.820193 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:36.820158 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:36.820366 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:36.820156 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:36.820366 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:36.820287 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:36.820366 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:36.820171 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:36.820541 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:36.820403 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:36.820541 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:36.820491 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:37.892512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:37.892484 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8bbxh" Jul 08 19:05:37.893190 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:37.892608 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 19:05:37.893304 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:37.893272 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8bbxh" Jul 08 19:05:37.935468 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:37.935442 2554 generic.go:356] "Generic (PLEG): container finished" podID="a57e44e756b562997884ccffffa463c2" containerID="192c01eeb1d46ed37ab04f91355e8055a0b5478cb1f6319fc984e41d4c673c49" exitCode=0 Jul 08 19:05:37.935627 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:37.935527 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" event={"ID":"a57e44e756b562997884ccffffa463c2","Type":"ContainerDied","Data":"192c01eeb1d46ed37ab04f91355e8055a0b5478cb1f6319fc984e41d4c673c49"} Jul 08 19:05:38.821922 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:38.821886 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:38.822099 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:38.822025 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:38.822190 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:38.822022 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:38.822190 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:38.822134 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:38.822302 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:38.822202 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:38.822302 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:38.822131 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:40.820601 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:40.820562 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:40.820601 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:40.820581 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:40.821037 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:40.820699 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:40.821037 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:40.820791 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:40.821037 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:40.820857 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:40.821037 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:40.820948 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:41.946115 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:41.945935 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" event={"ID":"8a93ffa9-7327-4a99-b3ba-bff5597b10f7","Type":"ContainerStarted","Data":"ef9bf6d426e0a0e5b438969a5eaf86bb185afc70fbff70204c7907b2ff1ed9d3"} Jul 08 19:05:41.948204 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:41.948180 2554 generic.go:356] "Generic (PLEG): container finished" podID="b0f41c78-6dd9-4703-a789-2e8b8588dd34" containerID="5d7a958b81f544d9d0c45b3723fe64e74ff5b0bab1f56a47323c7aa657cb31f1" exitCode=0 Jul 08 19:05:41.948311 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:41.948246 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zghgb" event={"ID":"b0f41c78-6dd9-4703-a789-2e8b8588dd34","Type":"ContainerDied","Data":"5d7a958b81f544d9d0c45b3723fe64e74ff5b0bab1f56a47323c7aa657cb31f1"} Jul 08 19:05:41.950021 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:41.949994 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8k58p" event={"ID":"2b121dd4-c5ff-4d04-9599-aad1ff354619","Type":"ContainerStarted","Data":"48ccf15c8bfdfcfbc8357e30c42cf62ca30ad3175ba45857803cc71a8b7368c3"} Jul 08 19:05:41.953164 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:41.952902 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" event={"ID":"a57e44e756b562997884ccffffa463c2","Type":"ContainerStarted","Data":"3c03bd587105b1af396d117a0e792ed7ad226436a390db6109ef746c8649aed8"} Jul 08 19:05:41.996684 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:41.996578 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8k58p" podStartSLOduration=3.355842441 podStartE2EDuration="23.996560372s" totalImagesPullingTime="20.640717931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:41.996146775 +0000 UTC m=+23.709208784" watchObservedRunningTime="2026-07-08 19:05:41.996560372 +0000 UTC m=+23.709622380" Jul 08 19:05:42.013699 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.012321 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-105.ec2.internal" podStartSLOduration=23.012299263 podStartE2EDuration="23.012299263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:42.011529187 +0000 UTC m=+23.724591217" watchObservedRunningTime="2026-07-08 19:05:42.012299263 +0000 UTC m=+23.725361274" Jul 08 19:05:42.015778 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.015753 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 19:05:42.705177 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.705013 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T19:05:42.015769715Z","UUID":"242da676-607b-4256-bc49-6e37207591ab","Handler":null,"Name":"","Endpoint":""} Jul 08 19:05:42.706665 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.706644 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 19:05:42.706779 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.706680 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 19:05:42.820287 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.820254 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:42.820287 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.820287 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:42.820632 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.820257 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:42.820632 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:42.820381 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:42.820632 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:42.820483 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:42.820632 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:42.820608 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:42.957143 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.957075 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" event={"ID":"089b8029-8358-46ca-8f97-6d0299bbc0fe","Type":"ContainerStarted","Data":"388581f737cfaba3218de023af70578c886b71da1e2a6818d1884dcb0e73917c"} Jul 08 19:05:42.960021 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.959987 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" event={"ID":"8a93ffa9-7327-4a99-b3ba-bff5597b10f7","Type":"ContainerStarted","Data":"077e308ea77259401a9b16eb609f47f880526004f6f912a399cd55c3166bbca8"} Jul 08 19:05:42.960123 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.960062 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" event={"ID":"8a93ffa9-7327-4a99-b3ba-bff5597b10f7","Type":"ContainerStarted","Data":"83a380fe7d01fa8b931709539a05da8bd92d0a51727ab4645a465b9a1386719f"} Jul 08 19:05:42.960123 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.960114 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" event={"ID":"8a93ffa9-7327-4a99-b3ba-bff5597b10f7","Type":"ContainerStarted","Data":"d8f428293d99eb4d70194eb34f33f79c14c76074f73e75da340407ddd48749f5"} Jul 08 19:05:42.960189 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.960162 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" event={"ID":"8a93ffa9-7327-4a99-b3ba-bff5597b10f7","Type":"ContainerStarted","Data":"260064164b48239f28a0e2527f21baf3b5fba7befc83b945e1a98ad66294109a"} Jul 08 19:05:42.960222 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:42.960194 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" event={"ID":"8a93ffa9-7327-4a99-b3ba-bff5597b10f7","Type":"ContainerStarted","Data":"31441d45f3ba49cf9fc07728670922b516835f76d32c7a46b67676e3cc1055a2"} Jul 08 19:05:43.964238 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:43.964209 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" event={"ID":"089b8029-8358-46ca-8f97-6d0299bbc0fe","Type":"ContainerStarted","Data":"82b96c6db2811d115951c6227d69ddc28e84ccfdee8c90133d46a752e0a12f25"} Jul 08 19:05:43.983314 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:43.983273 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9mkd" podStartSLOduration=3.899676194 podStartE2EDuration="24.983260158s" totalImagesPullingTime="21.083583964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:05:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:43.982058479 +0000 UTC m=+25.695120488" watchObservedRunningTime="2026-07-08 19:05:43.983260158 +0000 UTC m=+25.696322192" Jul 08 19:05:44.821075 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:44.821036 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:44.821075 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:44.821054 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:44.821331 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:44.821036 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:44.821331 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:44.821162 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:44.821331 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:44.821227 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:44.821331 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:44.821307 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:44.969450 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:44.969416 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" event={"ID":"8a93ffa9-7327-4a99-b3ba-bff5597b10f7","Type":"ContainerStarted","Data":"02547cfd05459faf893b5463069f7f78380d81785f6803a7af9b0c2dc6598067"} Jul 08 19:05:46.820328 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:46.820147 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:46.820961 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:46.820152 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:46.820961 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:46.820429 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:46.820961 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:46.820483 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:46.820961 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:46.820152 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:46.820961 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:46.820542 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:46.978545 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:46.978505 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" event={"ID":"8a93ffa9-7327-4a99-b3ba-bff5597b10f7","Type":"ContainerStarted","Data":"c5a49b7ba30ddd2ecaa2f69a0389a99c3b588775226f027f851b32bd19e90f24"} Jul 08 19:05:46.978843 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:46.978824 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:46.997114 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:46.997078 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:47.014105 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:47.014057 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" podStartSLOduration=7.399893276 podStartE2EDuration="28.014037268s" totalImagesPullingTime="20.614143992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:47.013476967 +0000 UTC m=+28.726538989" watchObservedRunningTime="2026-07-08 19:05:47.014037268 +0000 UTC m=+28.727099278" Jul 08 19:05:47.982244 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:47.982211 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:47.982699 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:47.982325 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:48.004145 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:48.003826 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:05:48.695926 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:48.695893 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-clvfv"] Jul 08 19:05:48.696118 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:48.696049 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:48.696283 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:48.696150 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:48.697876 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:48.697819 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s5ld2"] Jul 08 19:05:48.697988 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:48.697932 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:48.698050 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:48.698029 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:48.698533 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:48.698510 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n9cvr"] Jul 08 19:05:48.698654 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:48.698629 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:48.698751 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:48.698728 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:49.820606 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:49.820563 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:49.820995 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:49.820695 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:49.988425 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:49.988393 2554 generic.go:356] "Generic (PLEG): container finished" podID="b0f41c78-6dd9-4703-a789-2e8b8588dd34" containerID="c91cedc908456d5d4574898aff95d9386a83be4f2e9db759a9b3258744101ff2" exitCode=0 Jul 08 19:05:49.988585 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:49.988460 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zghgb" event={"ID":"b0f41c78-6dd9-4703-a789-2e8b8588dd34","Type":"ContainerDied","Data":"c91cedc908456d5d4574898aff95d9386a83be4f2e9db759a9b3258744101ff2"} Jul 08 19:05:50.820625 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:50.820579 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:50.820919 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:50.820722 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:50.820919 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:50.820771 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:50.820919 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:50.820864 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:51.820981 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:51.820805 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:51.821429 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:51.821058 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:51.995482 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:51.995449 2554 generic.go:356] "Generic (PLEG): container finished" podID="b0f41c78-6dd9-4703-a789-2e8b8588dd34" containerID="67f2024df27df0b82de51437f47abefcea67a525ae95522de3767ac30c3613b5" exitCode=0 Jul 08 19:05:51.995654 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:51.995488 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zghgb" event={"ID":"b0f41c78-6dd9-4703-a789-2e8b8588dd34","Type":"ContainerDied","Data":"67f2024df27df0b82de51437f47abefcea67a525ae95522de3767ac30c3613b5"} Jul 08 19:05:52.379347 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:52.379314 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs\") pod \"network-metrics-daemon-n9cvr\" (UID: \"f8410cd6-d550-4965-b769-0e74878b627c\") " pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:52.379498 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:52.379358 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnsfs\" (UniqueName: \"kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs\") pod \"network-check-target-clvfv\" (UID: \"23ec8c0f-09a1-4ea4-8999-e4378d4938ff\") " pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:52.379498 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:52.379455 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:52.379607 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:52.379521 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs podName:f8410cd6-d550-4965-b769-0e74878b627c nodeName:}" failed. No retries permitted until 2026-07-08 19:06:24.379504865 +0000 UTC m=+66.092566869 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs") pod "network-metrics-daemon-n9cvr" (UID: "f8410cd6-d550-4965-b769-0e74878b627c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:05:52.379607 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:52.379460 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:05:52.379607 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:52.379560 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:05:52.379607 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:52.379571 2554 projected.go:196] Error preparing data for projected volume kube-api-access-cnsfs for pod openshift-network-diagnostics/network-check-target-clvfv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:52.379759 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:52.379630 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs podName:23ec8c0f-09a1-4ea4-8999-e4378d4938ff nodeName:}" failed. No retries permitted until 2026-07-08 19:06:24.379619662 +0000 UTC m=+66.092681648 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnsfs" (UniqueName: "kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs") pod "network-check-target-clvfv" (UID: "23ec8c0f-09a1-4ea4-8999-e4378d4938ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:05:52.480092 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:52.480059 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:52.480239 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:52.480195 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:52.480294 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:52.480253 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret podName:2687d3bc-3cc1-44ef-8da4-be808f0e005b nodeName:}" failed. No retries permitted until 2026-07-08 19:06:24.480239367 +0000 UTC m=+66.193301357 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret") pod "global-pull-secret-syncer-s5ld2" (UID: "2687d3bc-3cc1-44ef-8da4-be808f0e005b") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:05:52.820497 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:52.820461 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:52.820497 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:52.820489 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:52.820740 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:52.820568 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:52.820740 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:52.820676 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:53.820219 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:53.820188 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:53.820762 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:53.820287 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n9cvr" podUID="f8410cd6-d550-4965-b769-0e74878b627c" Jul 08 19:05:54.002852 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:54.002819 2554 generic.go:356] "Generic (PLEG): container finished" podID="b0f41c78-6dd9-4703-a789-2e8b8588dd34" containerID="b6d10fdd1132437e7c239952076600cd91c0ac2b8a149e87f5a458256442f73c" exitCode=0 Jul 08 19:05:54.003004 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:54.002860 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zghgb" event={"ID":"b0f41c78-6dd9-4703-a789-2e8b8588dd34","Type":"ContainerDied","Data":"b6d10fdd1132437e7c239952076600cd91c0ac2b8a149e87f5a458256442f73c"} Jul 08 19:05:54.820367 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:54.820333 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:54.820804 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:54.820334 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:54.820804 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:54.820442 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5ld2" podUID="2687d3bc-3cc1-44ef-8da4-be808f0e005b" Jul 08 19:05:54.820804 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:54.820539 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-clvfv" podUID="23ec8c0f-09a1-4ea4-8999-e4378d4938ff" Jul 08 19:05:55.131270 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.131191 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-105.ec2.internal" event="NodeReady" Jul 08 19:05:55.131433 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.131348 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 19:05:55.168472 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.168433 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5476666885-nm2rb"] Jul 08 19:05:55.184166 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.184141 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-848485689f-bcs5k"] Jul 08 19:05:55.184316 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.184253 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.186787 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.186764 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 19:05:55.188375 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.188346 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 19:05:55.188375 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.188367 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mxm59\"" Jul 08 19:05:55.188531 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.188422 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 19:05:55.198154 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.198058 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzg7d"] Jul 08 19:05:55.198615 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.198318 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 19:05:55.198729 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.198707 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.202792 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.202770 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xc4bf\"" Jul 08 19:05:55.203663 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.203642 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 08 19:05:55.203844 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.203756 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 08 19:05:55.203948 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.203860 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 19:05:55.214149 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.213885 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 08 19:05:55.214149 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.213973 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 19:05:55.214149 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.214022 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 08 19:05:55.216565 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.216340 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr"] Jul 08 19:05:55.216933 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.216894 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzg7d" Jul 08 19:05:55.220268 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.219786 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:05:55.220268 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.219799 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 08 19:05:55.220268 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.220094 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mphkh\"" Jul 08 19:05:55.240471 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.240445 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-dt7sg"] Jul 08 19:05:55.240633 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.240565 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:05:55.243562 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.243539 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d5pht\"" Jul 08 19:05:55.243908 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.243889 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 19:05:55.245116 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.245053 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 19:05:55.245334 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.245316 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 19:05:55.245608 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.245572 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 19:05:55.260515 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.260495 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x"] Jul 08 19:05:55.260665 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.260644 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.264704 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.264683 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ltd7w\"" Jul 08 19:05:55.264925 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.264911 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 08 19:05:55.265014 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.264944 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 19:05:55.265090 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.265072 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 08 19:05:55.265179 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.265167 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 19:05:55.270340 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.270319 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 08 19:05:55.272546 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.272530 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8rx2k"] Jul 08 19:05:55.272720 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.272702 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" Jul 08 19:05:55.275206 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.275188 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 19:05:55.275206 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.275197 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:05:55.275363 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.275329 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 19:05:55.275543 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.275528 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-c8pfr\"" Jul 08 19:05:55.275629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.275559 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 19:05:55.284677 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.284658 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn"] Jul 08 19:05:55.284797 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.284780 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.287357 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.287340 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:05:55.287683 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.287662 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 19:05:55.287784 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.287692 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bbjdr\"" Jul 08 19:05:55.288056 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.288039 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 19:05:55.288655 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.288639 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 19:05:55.296151 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.295403 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 19:05:55.298868 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.298847 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7"] Jul 08 19:05:55.298994 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.298972 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" Jul 08 19:05:55.301274 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301251 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-default-certificate\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.301364 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301284 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-stats-auth\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.301364 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301311 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-trusted-ca\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.301451 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301362 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.301451 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301421 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-installation-pull-secrets\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.301543 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301453 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z78dd\" (UniqueName: \"kubernetes.io/projected/a99ba669-fe7c-4d86-b082-4fb33c727b3b-kube-api-access-z78dd\") pod \"volume-data-source-validator-5d456fdbcd-hzg7d\" (UID: \"a99ba669-fe7c-4d86-b082-4fb33c727b3b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzg7d" Jul 08 19:05:55.301543 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301478 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.301543 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301504 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-bound-sa-token\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.301689 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301543 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-ca-trust-extracted\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.301689 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301571 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjbzx\" (UniqueName: \"kubernetes.io/projected/67ff27b3-847a-430f-ba0a-c598ea1f84b7-kube-api-access-fjbzx\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.301689 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301662 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.301822 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301705 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-certificates\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.301872 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301854 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-image-registry-private-configuration\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.301936 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.301890 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdt4b\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-kube-api-access-wdt4b\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.304682 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.304664 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wcw66\"" Jul 08 19:05:55.304880 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.304676 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 08 19:05:55.304958 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.304900 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:05:55.304958 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.304860 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 08 19:05:55.304958 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.304950 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 08 19:05:55.312833 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.312817 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr"] Jul 08 19:05:55.312913 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.312843 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x"] Jul 08 19:05:55.312913 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.312864 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5476666885-nm2rb"] Jul 08 19:05:55.312913 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.312884 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8rx2k"] Jul 08 19:05:55.312913 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.312902 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-848485689f-bcs5k"] Jul 08 19:05:55.313111 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.312923 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-s2fhk"] Jul 08 19:05:55.313111 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.312925 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:05:55.318573 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.318555 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 19:05:55.319298 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.319233 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 19:05:55.319298 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.319238 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:05:55.319985 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.319968 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pqqlw\"" Jul 08 19:05:55.323061 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.323044 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7"] Jul 08 19:05:55.323227 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.323209 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d7qds"] Jul 08 19:05:55.323227 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.323123 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s2fhk" Jul 08 19:05:55.326602 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.326573 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5vrgc\"" Jul 08 19:05:55.327010 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.326993 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 19:05:55.327100 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.327011 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 19:05:55.339384 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.339366 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn"] Jul 08 19:05:55.339481 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.339397 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jdbfs"] Jul 08 19:05:55.339578 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.339563 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:55.342454 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.342436 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 19:05:55.342992 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.342973 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 19:05:55.343124 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.343102 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cxdf4\"" Jul 08 19:05:55.353227 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.353211 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzg7d"] Jul 08 19:05:55.353323 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.353246 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-dt7sg"] Jul 08 19:05:55.353323 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.353266 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-s2fhk"] Jul 08 19:05:55.353323 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.353293 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d7qds"] Jul 08 19:05:55.353445 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.353327 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jdbfs" Jul 08 19:05:55.353547 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.353334 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jdbfs"] Jul 08 19:05:55.357295 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.357277 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 19:05:55.357398 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.357310 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 19:05:55.357558 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.357538 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qnk2b\"" Jul 08 19:05:55.357832 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.357816 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 19:05:55.403230 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403159 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-ca-trust-extracted\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.403230 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403194 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbzx\" (UniqueName: \"kubernetes.io/projected/67ff27b3-847a-430f-ba0a-c598ea1f84b7-kube-api-access-fjbzx\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.403445 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403258 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8dqb7\" (UID: \"02594f62-8818-41f7-95dd-22615e301661\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:05:55.403445 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403290 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b69a250-2ddf-4409-a5d6-d32e1930554f-serving-cert\") pod \"console-operator-68b757fb67-8rx2k\" (UID: \"7b69a250-2ddf-4409-a5d6-d32e1930554f\") " pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.403445 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403321 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpjm6\" (UniqueName: \"kubernetes.io/projected/c4c20110-58e2-40d1-8740-de379ef5108a-kube-api-access-xpjm6\") pod \"kube-storage-version-migrator-operator-846bf668f7-ctxkn\" (UID: \"c4c20110-58e2-40d1-8740-de379ef5108a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" Jul 08 19:05:55.403445 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403346 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43812205-6218-459c-9ea3-02fc8c11375f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.403445 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403415 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdt4b\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-kube-api-access-wdt4b\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.403719 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403500 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95ae1488-f214-4927-b45c-ae6b78154a2c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:05:55.403719 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403534 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4c20110-58e2-40d1-8740-de379ef5108a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ctxkn\" (UID: \"c4c20110-58e2-40d1-8740-de379ef5108a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" Jul 08 19:05:55.403719 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43812205-6218-459c-9ea3-02fc8c11375f-tmp\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.403719 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403586 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-stats-auth\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.403719 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403616 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-ca-trust-extracted\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.403719 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403638 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcm6k\" (UniqueName: \"kubernetes.io/projected/7b69a250-2ddf-4409-a5d6-d32e1930554f-kube-api-access-fcm6k\") pod \"console-operator-68b757fb67-8rx2k\" (UID: \"7b69a250-2ddf-4409-a5d6-d32e1930554f\") " pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.403719 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403683 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/43812205-6218-459c-9ea3-02fc8c11375f-snapshots\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.403719 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403716 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.404053 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403742 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43812205-6218-459c-9ea3-02fc8c11375f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.404053 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403767 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xthmp\" (UniqueName: \"kubernetes.io/projected/02594f62-8818-41f7-95dd-22615e301661-kube-api-access-xthmp\") pod \"cluster-samples-operator-56fcf86bf-8dqb7\" (UID: \"02594f62-8818-41f7-95dd-22615e301661\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:05:55.404053 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403809 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fwwl\" (UniqueName: \"kubernetes.io/projected/ca1f8503-54a2-49ad-b93b-06df16afe5ec-kube-api-access-8fwwl\") pod \"service-ca-operator-5d46d9ffd4-5kv9x\" (UID: \"ca1f8503-54a2-49ad-b93b-06df16afe5ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" Jul 08 19:05:55.404053 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.403814 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:05:55.404053 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403856 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z78dd\" (UniqueName: \"kubernetes.io/projected/a99ba669-fe7c-4d86-b082-4fb33c727b3b-kube-api-access-z78dd\") pod \"volume-data-source-validator-5d456fdbcd-hzg7d\" (UID: \"a99ba669-fe7c-4d86-b082-4fb33c727b3b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzg7d" Jul 08 19:05:55.404053 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.404053 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.403896 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs podName:67ff27b3-847a-430f-ba0a-c598ea1f84b7 nodeName:}" failed. No retries permitted until 2026-07-08 19:05:55.903878914 +0000 UTC m=+37.616940911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs") pod "router-default-848485689f-bcs5k" (UID: "67ff27b3-847a-430f-ba0a-c598ea1f84b7") : secret "router-metrics-certs-default" not found Jul 08 19:05:55.404053 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.403964 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:05:55.404053 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.403976 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5476666885-nm2rb: secret "image-registry-tls" not found Jul 08 19:05:55.404053 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.403977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b69a250-2ddf-4409-a5d6-d32e1930554f-config\") pod \"console-operator-68b757fb67-8rx2k\" (UID: \"7b69a250-2ddf-4409-a5d6-d32e1930554f\") " pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.404053 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.404010 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls podName:8e016d9b-4ab7-4d9a-956c-b24a0991e57c nodeName:}" failed. No retries permitted until 2026-07-08 19:05:55.903999247 +0000 UTC m=+37.617061252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls") pod "image-registry-5476666885-nm2rb" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c") : secret "image-registry-tls" not found Jul 08 19:05:55.404053 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404026 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b69a250-2ddf-4409-a5d6-d32e1930554f-trusted-ca\") pod \"console-operator-68b757fb67-8rx2k\" (UID: \"7b69a250-2ddf-4409-a5d6-d32e1930554f\") " pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.404053 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404053 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43812205-6218-459c-9ea3-02fc8c11375f-serving-cert\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404077 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404110 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-certificates\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.404160 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle podName:67ff27b3-847a-430f-ba0a-c598ea1f84b7 nodeName:}" failed. No retries permitted until 2026-07-08 19:05:55.904149232 +0000 UTC m=+37.617211247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle") pod "router-default-848485689f-bcs5k" (UID: "67ff27b3-847a-430f-ba0a-c598ea1f84b7") : configmap references non-existent config key: service-ca.crt Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404252 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-image-registry-private-configuration\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404274 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404294 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4c20110-58e2-40d1-8740-de379ef5108a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ctxkn\" (UID: \"c4c20110-58e2-40d1-8740-de379ef5108a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404324 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-default-certificate\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404350 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-trusted-ca\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404379 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp4pb\" (UniqueName: \"kubernetes.io/projected/95ae1488-f214-4927-b45c-ae6b78154a2c-kube-api-access-pp4pb\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404407 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7xss\" (UniqueName: \"kubernetes.io/projected/43812205-6218-459c-9ea3-02fc8c11375f-kube-api-access-j7xss\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404437 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca1f8503-54a2-49ad-b93b-06df16afe5ec-config\") pod \"service-ca-operator-5d46d9ffd4-5kv9x\" (UID: \"ca1f8503-54a2-49ad-b93b-06df16afe5ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404465 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-installation-pull-secrets\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404490 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-bound-sa-token\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.404725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404513 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca1f8503-54a2-49ad-b93b-06df16afe5ec-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-5kv9x\" (UID: \"ca1f8503-54a2-49ad-b93b-06df16afe5ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" Jul 08 19:05:55.405393 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.404730 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-certificates\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.405450 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.405401 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-trusted-ca\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.408542 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.408479 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-image-registry-private-configuration\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.408542 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.408490 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-installation-pull-secrets\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.408726 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.408627 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-stats-auth\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.408726 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.408644 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-default-certificate\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.412650 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.412627 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjbzx\" (UniqueName: \"kubernetes.io/projected/67ff27b3-847a-430f-ba0a-c598ea1f84b7-kube-api-access-fjbzx\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.412834 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.412812 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdt4b\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-kube-api-access-wdt4b\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.412906 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.412889 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z78dd\" (UniqueName: \"kubernetes.io/projected/a99ba669-fe7c-4d86-b082-4fb33c727b3b-kube-api-access-z78dd\") pod \"volume-data-source-validator-5d456fdbcd-hzg7d\" (UID: \"a99ba669-fe7c-4d86-b082-4fb33c727b3b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzg7d" Jul 08 19:05:55.413227 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.413209 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-bound-sa-token\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.505202 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505171 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca1f8503-54a2-49ad-b93b-06df16afe5ec-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-5kv9x\" (UID: \"ca1f8503-54a2-49ad-b93b-06df16afe5ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" Jul 08 19:05:55.505202 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505204 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8dqb7\" (UID: \"02594f62-8818-41f7-95dd-22615e301661\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:05:55.505400 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b69a250-2ddf-4409-a5d6-d32e1930554f-serving-cert\") pod \"console-operator-68b757fb67-8rx2k\" (UID: \"7b69a250-2ddf-4409-a5d6-d32e1930554f\") " pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.505400 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.505308 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:05:55.505400 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505359 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2679ed35-5fc8-44e5-a711-464cc4147348-config-volume\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:55.505400 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.505363 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls podName:02594f62-8818-41f7-95dd-22615e301661 nodeName:}" failed. No retries permitted until 2026-07-08 19:05:56.005348336 +0000 UTC m=+37.718410323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8dqb7" (UID: "02594f62-8818-41f7-95dd-22615e301661") : secret "samples-operator-tls" not found Jul 08 19:05:55.505628 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505419 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpjm6\" (UniqueName: \"kubernetes.io/projected/c4c20110-58e2-40d1-8740-de379ef5108a-kube-api-access-xpjm6\") pod \"kube-storage-version-migrator-operator-846bf668f7-ctxkn\" (UID: \"c4c20110-58e2-40d1-8740-de379ef5108a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" Jul 08 19:05:55.505628 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505447 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43812205-6218-459c-9ea3-02fc8c11375f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.505628 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505503 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95ae1488-f214-4927-b45c-ae6b78154a2c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:05:55.505628 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505530 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4c20110-58e2-40d1-8740-de379ef5108a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ctxkn\" (UID: \"c4c20110-58e2-40d1-8740-de379ef5108a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" Jul 08 19:05:55.505628 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505559 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43812205-6218-459c-9ea3-02fc8c11375f-tmp\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.505628 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505616 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcm6k\" (UniqueName: \"kubernetes.io/projected/7b69a250-2ddf-4409-a5d6-d32e1930554f-kube-api-access-fcm6k\") pod \"console-operator-68b757fb67-8rx2k\" (UID: \"7b69a250-2ddf-4409-a5d6-d32e1930554f\") " pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.505924 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505653 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/43812205-6218-459c-9ea3-02fc8c11375f-snapshots\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.505924 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505680 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:55.505924 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505722 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43812205-6218-459c-9ea3-02fc8c11375f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.505924 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505747 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xthmp\" (UniqueName: \"kubernetes.io/projected/02594f62-8818-41f7-95dd-22615e301661-kube-api-access-xthmp\") pod \"cluster-samples-operator-56fcf86bf-8dqb7\" (UID: \"02594f62-8818-41f7-95dd-22615e301661\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:05:55.505924 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505785 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f740612f-3c23-4bc5-b121-6066ca21933d-cert\") pod \"ingress-canary-jdbfs\" (UID: \"f740612f-3c23-4bc5-b121-6066ca21933d\") " pod="openshift-ingress-canary/ingress-canary-jdbfs" Jul 08 19:05:55.505924 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505815 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fwwl\" (UniqueName: \"kubernetes.io/projected/ca1f8503-54a2-49ad-b93b-06df16afe5ec-kube-api-access-8fwwl\") pod \"service-ca-operator-5d46d9ffd4-5kv9x\" (UID: \"ca1f8503-54a2-49ad-b93b-06df16afe5ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" Jul 08 19:05:55.505924 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505840 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzwzg\" (UniqueName: \"kubernetes.io/projected/703ee24d-3481-41b5-a46d-19ed9038cd15-kube-api-access-nzwzg\") pod \"network-check-source-989f8b8dc-s2fhk\" (UID: \"703ee24d-3481-41b5-a46d-19ed9038cd15\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s2fhk" Jul 08 19:05:55.505924 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505866 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47w69\" (UniqueName: \"kubernetes.io/projected/2679ed35-5fc8-44e5-a711-464cc4147348-kube-api-access-47w69\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:55.505924 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.505920 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b69a250-2ddf-4409-a5d6-d32e1930554f-config\") pod \"console-operator-68b757fb67-8rx2k\" (UID: \"7b69a250-2ddf-4409-a5d6-d32e1930554f\") " pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.506356 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506037 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43812205-6218-459c-9ea3-02fc8c11375f-tmp\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.506356 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506163 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b69a250-2ddf-4409-a5d6-d32e1930554f-trusted-ca\") pod \"console-operator-68b757fb67-8rx2k\" (UID: \"7b69a250-2ddf-4409-a5d6-d32e1930554f\") " pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.506356 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506208 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43812205-6218-459c-9ea3-02fc8c11375f-serving-cert\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.506356 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506262 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:05:55.506356 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506274 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95ae1488-f214-4927-b45c-ae6b78154a2c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:05:55.506356 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506291 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn4zq\" (UniqueName: \"kubernetes.io/projected/f740612f-3c23-4bc5-b121-6066ca21933d-kube-api-access-cn4zq\") pod \"ingress-canary-jdbfs\" (UID: \"f740612f-3c23-4bc5-b121-6066ca21933d\") " pod="openshift-ingress-canary/ingress-canary-jdbfs" Jul 08 19:05:55.506356 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506329 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4c20110-58e2-40d1-8740-de379ef5108a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ctxkn\" (UID: \"c4c20110-58e2-40d1-8740-de379ef5108a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" Jul 08 19:05:55.506728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506370 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp4pb\" (UniqueName: \"kubernetes.io/projected/95ae1488-f214-4927-b45c-ae6b78154a2c-kube-api-access-pp4pb\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:05:55.506728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506379 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/43812205-6218-459c-9ea3-02fc8c11375f-snapshots\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.506728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506412 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2679ed35-5fc8-44e5-a711-464cc4147348-tmp-dir\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:55.506728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7xss\" (UniqueName: \"kubernetes.io/projected/43812205-6218-459c-9ea3-02fc8c11375f-kube-api-access-j7xss\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.506728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506475 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca1f8503-54a2-49ad-b93b-06df16afe5ec-config\") pod \"service-ca-operator-5d46d9ffd4-5kv9x\" (UID: \"ca1f8503-54a2-49ad-b93b-06df16afe5ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" Jul 08 19:05:55.506728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506669 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b69a250-2ddf-4409-a5d6-d32e1930554f-config\") pod \"console-operator-68b757fb67-8rx2k\" (UID: \"7b69a250-2ddf-4409-a5d6-d32e1930554f\") " pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.506728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.506714 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43812205-6218-459c-9ea3-02fc8c11375f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.508319 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.507583 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca1f8503-54a2-49ad-b93b-06df16afe5ec-config\") pod \"service-ca-operator-5d46d9ffd4-5kv9x\" (UID: \"ca1f8503-54a2-49ad-b93b-06df16afe5ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" Jul 08 19:05:55.508319 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.507699 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43812205-6218-459c-9ea3-02fc8c11375f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.508319 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.508207 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4c20110-58e2-40d1-8740-de379ef5108a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ctxkn\" (UID: \"c4c20110-58e2-40d1-8740-de379ef5108a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" Jul 08 19:05:55.508547 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.508455 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4c20110-58e2-40d1-8740-de379ef5108a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ctxkn\" (UID: \"c4c20110-58e2-40d1-8740-de379ef5108a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" Jul 08 19:05:55.508772 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.508751 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:05:55.508855 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.508823 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls podName:95ae1488-f214-4927-b45c-ae6b78154a2c nodeName:}" failed. No retries permitted until 2026-07-08 19:05:56.0087987 +0000 UTC m=+37.721860692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-m5lfr" (UID: "95ae1488-f214-4927-b45c-ae6b78154a2c") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:05:55.509086 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.509062 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b69a250-2ddf-4409-a5d6-d32e1930554f-serving-cert\") pod \"console-operator-68b757fb67-8rx2k\" (UID: \"7b69a250-2ddf-4409-a5d6-d32e1930554f\") " pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.509255 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.509233 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca1f8503-54a2-49ad-b93b-06df16afe5ec-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-5kv9x\" (UID: \"ca1f8503-54a2-49ad-b93b-06df16afe5ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" Jul 08 19:05:55.509502 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.509480 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b69a250-2ddf-4409-a5d6-d32e1930554f-trusted-ca\") pod \"console-operator-68b757fb67-8rx2k\" (UID: \"7b69a250-2ddf-4409-a5d6-d32e1930554f\") " pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.514911 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.514888 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43812205-6218-459c-9ea3-02fc8c11375f-serving-cert\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.518072 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.517430 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fwwl\" (UniqueName: \"kubernetes.io/projected/ca1f8503-54a2-49ad-b93b-06df16afe5ec-kube-api-access-8fwwl\") pod \"service-ca-operator-5d46d9ffd4-5kv9x\" (UID: \"ca1f8503-54a2-49ad-b93b-06df16afe5ec\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" Jul 08 19:05:55.518072 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.517446 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpjm6\" (UniqueName: \"kubernetes.io/projected/c4c20110-58e2-40d1-8740-de379ef5108a-kube-api-access-xpjm6\") pod \"kube-storage-version-migrator-operator-846bf668f7-ctxkn\" (UID: \"c4c20110-58e2-40d1-8740-de379ef5108a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" Jul 08 19:05:55.518072 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.517973 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp4pb\" (UniqueName: \"kubernetes.io/projected/95ae1488-f214-4927-b45c-ae6b78154a2c-kube-api-access-pp4pb\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:05:55.519676 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.519556 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcm6k\" (UniqueName: \"kubernetes.io/projected/7b69a250-2ddf-4409-a5d6-d32e1930554f-kube-api-access-fcm6k\") pod \"console-operator-68b757fb67-8rx2k\" (UID: \"7b69a250-2ddf-4409-a5d6-d32e1930554f\") " pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.519676 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.519661 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xthmp\" (UniqueName: \"kubernetes.io/projected/02594f62-8818-41f7-95dd-22615e301661-kube-api-access-xthmp\") pod \"cluster-samples-operator-56fcf86bf-8dqb7\" (UID: \"02594f62-8818-41f7-95dd-22615e301661\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:05:55.520311 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.520274 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7xss\" (UniqueName: \"kubernetes.io/projected/43812205-6218-459c-9ea3-02fc8c11375f-kube-api-access-j7xss\") pod \"insights-operator-5c847dcfc4-dt7sg\" (UID: \"43812205-6218-459c-9ea3-02fc8c11375f\") " pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.530644 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.530622 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzg7d" Jul 08 19:05:55.570703 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.570679 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" Jul 08 19:05:55.582972 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.582818 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" Jul 08 19:05:55.595471 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.595450 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:05:55.606990 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.606959 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:55.607096 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.607028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f740612f-3c23-4bc5-b121-6066ca21933d-cert\") pod \"ingress-canary-jdbfs\" (UID: \"f740612f-3c23-4bc5-b121-6066ca21933d\") " pod="openshift-ingress-canary/ingress-canary-jdbfs" Jul 08 19:05:55.607096 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.607058 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzwzg\" (UniqueName: \"kubernetes.io/projected/703ee24d-3481-41b5-a46d-19ed9038cd15-kube-api-access-nzwzg\") pod \"network-check-source-989f8b8dc-s2fhk\" (UID: \"703ee24d-3481-41b5-a46d-19ed9038cd15\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s2fhk" Jul 08 19:05:55.607096 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.607084 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47w69\" (UniqueName: \"kubernetes.io/projected/2679ed35-5fc8-44e5-a711-464cc4147348-kube-api-access-47w69\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:55.607238 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.607139 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:05:55.607238 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.607171 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn4zq\" (UniqueName: \"kubernetes.io/projected/f740612f-3c23-4bc5-b121-6066ca21933d-kube-api-access-cn4zq\") pod \"ingress-canary-jdbfs\" (UID: \"f740612f-3c23-4bc5-b121-6066ca21933d\") " pod="openshift-ingress-canary/ingress-canary-jdbfs" Jul 08 19:05:55.607238 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.607211 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls podName:2679ed35-5fc8-44e5-a711-464cc4147348 nodeName:}" failed. No retries permitted until 2026-07-08 19:05:56.107189766 +0000 UTC m=+37.820251760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls") pod "dns-default-d7qds" (UID: "2679ed35-5fc8-44e5-a711-464cc4147348") : secret "dns-default-metrics-tls" not found Jul 08 19:05:55.607389 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.607254 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2679ed35-5fc8-44e5-a711-464cc4147348-tmp-dir\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:55.607389 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.607325 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2679ed35-5fc8-44e5-a711-464cc4147348-config-volume\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:55.607991 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.607971 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2679ed35-5fc8-44e5-a711-464cc4147348-config-volume\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:55.608086 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.608046 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2679ed35-5fc8-44e5-a711-464cc4147348-tmp-dir\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:55.609077 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.609041 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" Jul 08 19:05:55.611677 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.611656 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f740612f-3c23-4bc5-b121-6066ca21933d-cert\") pod \"ingress-canary-jdbfs\" (UID: \"f740612f-3c23-4bc5-b121-6066ca21933d\") " pod="openshift-ingress-canary/ingress-canary-jdbfs" Jul 08 19:05:55.621714 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.621694 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47w69\" (UniqueName: \"kubernetes.io/projected/2679ed35-5fc8-44e5-a711-464cc4147348-kube-api-access-47w69\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:55.623031 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.623010 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn4zq\" (UniqueName: \"kubernetes.io/projected/f740612f-3c23-4bc5-b121-6066ca21933d-kube-api-access-cn4zq\") pod \"ingress-canary-jdbfs\" (UID: \"f740612f-3c23-4bc5-b121-6066ca21933d\") " pod="openshift-ingress-canary/ingress-canary-jdbfs" Jul 08 19:05:55.623299 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.623278 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzwzg\" (UniqueName: \"kubernetes.io/projected/703ee24d-3481-41b5-a46d-19ed9038cd15-kube-api-access-nzwzg\") pod \"network-check-source-989f8b8dc-s2fhk\" (UID: \"703ee24d-3481-41b5-a46d-19ed9038cd15\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s2fhk" Jul 08 19:05:55.632905 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.632658 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s2fhk" Jul 08 19:05:55.664149 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.663673 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jdbfs" Jul 08 19:05:55.830750 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.823257 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:05:55.830750 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.825675 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzg7d"] Jul 08 19:05:55.830750 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.826103 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 19:05:55.830750 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.826349 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vfh9q\"" Jul 08 19:05:55.830750 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.826435 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x"] Jul 08 19:05:55.841164 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:55.841090 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda99ba669_fe7c_4d86_b082_4fb33c727b3b.slice/crio-3e3699d7b0023f9d576ffb811fe0d997972de0b7058bc0796ff2a484c46fd426 WatchSource:0}: Error finding container 3e3699d7b0023f9d576ffb811fe0d997972de0b7058bc0796ff2a484c46fd426: Status 404 returned error can't find the container with id 3e3699d7b0023f9d576ffb811fe0d997972de0b7058bc0796ff2a484c46fd426 Jul 08 19:05:55.851841 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:55.851807 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca1f8503_54a2_49ad_b93b_06df16afe5ec.slice/crio-4e2090acd83a2bf2ca276b4ea4e53487257707929be1ce4753764bd5157c4bc7 WatchSource:0}: Error finding container 4e2090acd83a2bf2ca276b4ea4e53487257707929be1ce4753764bd5157c4bc7: Status 404 returned error can't find the container with id 4e2090acd83a2bf2ca276b4ea4e53487257707929be1ce4753764bd5157c4bc7 Jul 08 19:05:55.862114 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.861533 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-dt7sg"] Jul 08 19:05:55.862114 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.861613 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8rx2k"] Jul 08 19:05:55.863159 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.863029 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn"] Jul 08 19:05:55.885371 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.885342 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-s2fhk"] Jul 08 19:05:55.888977 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:55.888950 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod703ee24d_3481_41b5_a46d_19ed9038cd15.slice/crio-ebc44d6e2193636df7afd752e871d512e78bf19aa67923286d51117719bb6ea2 WatchSource:0}: Error finding container ebc44d6e2193636df7afd752e871d512e78bf19aa67923286d51117719bb6ea2: Status 404 returned error can't find the container with id ebc44d6e2193636df7afd752e871d512e78bf19aa67923286d51117719bb6ea2 Jul 08 19:05:55.911662 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.911607 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.911662 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.911654 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:55.911878 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.911691 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:55.911878 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.911779 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:05:55.911878 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.911787 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:05:55.911878 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.911808 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5476666885-nm2rb: secret "image-registry-tls" not found Jul 08 19:05:55.911878 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.911842 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs podName:67ff27b3-847a-430f-ba0a-c598ea1f84b7 nodeName:}" failed. No retries permitted until 2026-07-08 19:05:56.911821369 +0000 UTC m=+38.624883373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs") pod "router-default-848485689f-bcs5k" (UID: "67ff27b3-847a-430f-ba0a-c598ea1f84b7") : secret "router-metrics-certs-default" not found Jul 08 19:05:55.911878 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.911862 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle podName:67ff27b3-847a-430f-ba0a-c598ea1f84b7 nodeName:}" failed. No retries permitted until 2026-07-08 19:05:56.911852635 +0000 UTC m=+38.624914624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle") pod "router-default-848485689f-bcs5k" (UID: "67ff27b3-847a-430f-ba0a-c598ea1f84b7") : configmap references non-existent config key: service-ca.crt Jul 08 19:05:55.911878 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:55.911877 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls podName:8e016d9b-4ab7-4d9a-956c-b24a0991e57c nodeName:}" failed. No retries permitted until 2026-07-08 19:05:56.911869496 +0000 UTC m=+38.624931486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls") pod "image-registry-5476666885-nm2rb" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c") : secret "image-registry-tls" not found Jul 08 19:05:55.918296 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:55.918272 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jdbfs"] Jul 08 19:05:55.921778 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:05:55.921753 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf740612f_3c23_4bc5_b121_6066ca21933d.slice/crio-331aae5b2ac3f30b096c025a69ce0a9c62eecaeb2067887f04b8f998b002b9bd WatchSource:0}: Error finding container 331aae5b2ac3f30b096c025a69ce0a9c62eecaeb2067887f04b8f998b002b9bd: Status 404 returned error can't find the container with id 331aae5b2ac3f30b096c025a69ce0a9c62eecaeb2067887f04b8f998b002b9bd Jul 08 19:05:56.009300 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.009270 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" event={"ID":"7b69a250-2ddf-4409-a5d6-d32e1930554f","Type":"ContainerStarted","Data":"fd8d1c750baa5b17848f5ccabb5cb62ee081948d1d6276f896e7bc2fddc799ed"} Jul 08 19:05:56.010502 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.010477 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jdbfs" event={"ID":"f740612f-3c23-4bc5-b121-6066ca21933d","Type":"ContainerStarted","Data":"331aae5b2ac3f30b096c025a69ce0a9c62eecaeb2067887f04b8f998b002b9bd"} Jul 08 19:05:56.011643 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.011618 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" event={"ID":"ca1f8503-54a2-49ad-b93b-06df16afe5ec","Type":"ContainerStarted","Data":"4e2090acd83a2bf2ca276b4ea4e53487257707929be1ce4753764bd5157c4bc7"} Jul 08 19:05:56.012279 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.012259 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:05:56.012378 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.012323 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8dqb7\" (UID: \"02594f62-8818-41f7-95dd-22615e301661\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:05:56.012435 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:56.012418 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:05:56.012435 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:56.012431 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:05:56.012535 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:56.012484 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls podName:02594f62-8818-41f7-95dd-22615e301661 nodeName:}" failed. No retries permitted until 2026-07-08 19:05:57.012466321 +0000 UTC m=+38.725528310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8dqb7" (UID: "02594f62-8818-41f7-95dd-22615e301661") : secret "samples-operator-tls" not found Jul 08 19:05:56.012535 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:56.012503 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls podName:95ae1488-f214-4927-b45c-ae6b78154a2c nodeName:}" failed. No retries permitted until 2026-07-08 19:05:57.012493116 +0000 UTC m=+38.725555105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-m5lfr" (UID: "95ae1488-f214-4927-b45c-ae6b78154a2c") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:05:56.012795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.012773 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s2fhk" event={"ID":"703ee24d-3481-41b5-a46d-19ed9038cd15","Type":"ContainerStarted","Data":"ebc44d6e2193636df7afd752e871d512e78bf19aa67923286d51117719bb6ea2"} Jul 08 19:05:56.013940 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.013916 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" event={"ID":"43812205-6218-459c-9ea3-02fc8c11375f","Type":"ContainerStarted","Data":"34090eb70253af42e0a6433a23d47486eec16acb201ae1ea9d5195349f78026d"} Jul 08 19:05:56.015107 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.015071 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzg7d" event={"ID":"a99ba669-fe7c-4d86-b082-4fb33c727b3b","Type":"ContainerStarted","Data":"3e3699d7b0023f9d576ffb811fe0d997972de0b7058bc0796ff2a484c46fd426"} Jul 08 19:05:56.016291 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.016264 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" event={"ID":"c4c20110-58e2-40d1-8740-de379ef5108a","Type":"ContainerStarted","Data":"81b596539c48cf433c03cafbfcc6e9a4edf64af9a45c8391bb92121a791066d7"} Jul 08 19:05:56.113146 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.113113 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:56.113316 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:56.113278 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:05:56.113382 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:56.113352 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls podName:2679ed35-5fc8-44e5-a711-464cc4147348 nodeName:}" failed. No retries permitted until 2026-07-08 19:05:57.113332396 +0000 UTC m=+38.826394383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls") pod "dns-default-d7qds" (UID: "2679ed35-5fc8-44e5-a711-464cc4147348") : secret "dns-default-metrics-tls" not found Jul 08 19:05:56.821538 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.821507 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:05:56.821734 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.821521 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:05:56.825483 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.825456 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 19:05:56.826076 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.826057 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fsv9h\"" Jul 08 19:05:56.924420 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.923242 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:56.924420 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.923308 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:56.924420 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:56.923443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:56.924420 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:56.923721 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:05:56.924420 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:56.923804 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs podName:67ff27b3-847a-430f-ba0a-c598ea1f84b7 nodeName:}" failed. No retries permitted until 2026-07-08 19:05:58.923785107 +0000 UTC m=+40.636847107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs") pod "router-default-848485689f-bcs5k" (UID: "67ff27b3-847a-430f-ba0a-c598ea1f84b7") : secret "router-metrics-certs-default" not found Jul 08 19:05:56.924420 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:56.924309 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle podName:67ff27b3-847a-430f-ba0a-c598ea1f84b7 nodeName:}" failed. No retries permitted until 2026-07-08 19:05:58.924287974 +0000 UTC m=+40.637349961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle") pod "router-default-848485689f-bcs5k" (UID: "67ff27b3-847a-430f-ba0a-c598ea1f84b7") : configmap references non-existent config key: service-ca.crt Jul 08 19:05:56.924420 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:56.924336 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:05:56.924420 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:56.924352 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5476666885-nm2rb: secret "image-registry-tls" not found Jul 08 19:05:56.924420 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:56.924397 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls podName:8e016d9b-4ab7-4d9a-956c-b24a0991e57c nodeName:}" failed. No retries permitted until 2026-07-08 19:05:58.924382544 +0000 UTC m=+40.637444545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls") pod "image-registry-5476666885-nm2rb" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c") : secret "image-registry-tls" not found Jul 08 19:05:57.024122 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:57.024082 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8dqb7\" (UID: \"02594f62-8818-41f7-95dd-22615e301661\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:05:57.024357 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:57.024312 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:05:57.024694 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:57.024525 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:05:57.024694 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:57.024572 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:05:57.024694 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:57.024617 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls podName:02594f62-8818-41f7-95dd-22615e301661 nodeName:}" failed. No retries permitted until 2026-07-08 19:05:59.024581238 +0000 UTC m=+40.737643229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8dqb7" (UID: "02594f62-8818-41f7-95dd-22615e301661") : secret "samples-operator-tls" not found Jul 08 19:05:57.024694 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:57.024655 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls podName:95ae1488-f214-4927-b45c-ae6b78154a2c nodeName:}" failed. No retries permitted until 2026-07-08 19:05:59.024638269 +0000 UTC m=+40.737700262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-m5lfr" (UID: "95ae1488-f214-4927-b45c-ae6b78154a2c") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:05:57.126427 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:57.125585 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:57.126427 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:57.125902 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:05:57.126427 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:57.125961 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls podName:2679ed35-5fc8-44e5-a711-464cc4147348 nodeName:}" failed. No retries permitted until 2026-07-08 19:05:59.125943287 +0000 UTC m=+40.839005279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls") pod "dns-default-d7qds" (UID: "2679ed35-5fc8-44e5-a711-464cc4147348") : secret "dns-default-metrics-tls" not found Jul 08 19:05:58.944259 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:58.944033 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:58.944259 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:58.944230 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle podName:67ff27b3-847a-430f-ba0a-c598ea1f84b7 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:02.94420529 +0000 UTC m=+44.657267293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle") pod "router-default-848485689f-bcs5k" (UID: "67ff27b3-847a-430f-ba0a-c598ea1f84b7") : configmap references non-existent config key: service-ca.crt Jul 08 19:05:58.944853 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:58.944393 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:05:58.944853 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:58.944446 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:05:58.944853 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:58.944582 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:05:58.944853 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:58.944614 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5476666885-nm2rb: secret "image-registry-tls" not found Jul 08 19:05:58.944853 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:58.944626 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:05:58.944853 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:58.944659 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls podName:8e016d9b-4ab7-4d9a-956c-b24a0991e57c nodeName:}" failed. No retries permitted until 2026-07-08 19:06:02.944644116 +0000 UTC m=+44.657706105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls") pod "image-registry-5476666885-nm2rb" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c") : secret "image-registry-tls" not found Jul 08 19:05:58.944853 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:58.944676 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs podName:67ff27b3-847a-430f-ba0a-c598ea1f84b7 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:02.94466706 +0000 UTC m=+44.657729047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs") pod "router-default-848485689f-bcs5k" (UID: "67ff27b3-847a-430f-ba0a-c598ea1f84b7") : secret "router-metrics-certs-default" not found Jul 08 19:05:59.030291 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:59.030247 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzg7d" event={"ID":"a99ba669-fe7c-4d86-b082-4fb33c727b3b","Type":"ContainerStarted","Data":"12246d5ae11beb398f555040af80f141b384c4c15edb991f680190b667be93df"} Jul 08 19:05:59.045743 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:59.045707 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8dqb7\" (UID: \"02594f62-8818-41f7-95dd-22615e301661\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:05:59.045924 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:59.045902 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:05:59.046075 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:59.046058 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:05:59.046135 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:59.046124 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls podName:95ae1488-f214-4927-b45c-ae6b78154a2c nodeName:}" failed. No retries permitted until 2026-07-08 19:06:03.04610465 +0000 UTC m=+44.759166641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-m5lfr" (UID: "95ae1488-f214-4927-b45c-ae6b78154a2c") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:05:59.046787 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:59.046461 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:05:59.046787 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:59.046515 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls podName:02594f62-8818-41f7-95dd-22615e301661 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:03.046497628 +0000 UTC m=+44.759559632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8dqb7" (UID: "02594f62-8818-41f7-95dd-22615e301661") : secret "samples-operator-tls" not found Jul 08 19:05:59.049831 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:59.049792 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hzg7d" podStartSLOduration=20.837460432 podStartE2EDuration="23.049736942s" totalImagesPullingTime="2.21227651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:59.049039964 +0000 UTC m=+40.762101974" watchObservedRunningTime="2026-07-08 19:05:59.049736942 +0000 UTC m=+40.762798968" Jul 08 19:05:59.146493 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:59.146467 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:05:59.146651 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:59.146635 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:05:59.146711 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:05:59.146700 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls podName:2679ed35-5fc8-44e5-a711-464cc4147348 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:03.146684787 +0000 UTC m=+44.859746786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls") pod "dns-default-d7qds" (UID: "2679ed35-5fc8-44e5-a711-464cc4147348") : secret "dns-default-metrics-tls" not found Jul 08 19:05:59.165487 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:59.165458 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:05:59.254071 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:05:59.254020 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:00.915380 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:00.915344 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:00.961822 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:00.961791 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv"] Jul 08 19:06:00.986633 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:00.986579 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f"] Jul 08 19:06:00.986801 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:00.986701 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" Jul 08 19:06:00.990895 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:00.990863 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 08 19:06:00.992181 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:00.991234 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 19:06:00.992181 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:00.991485 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 19:06:00.992181 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:00.991541 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 19:06:01.011328 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.011298 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:01.012695 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.012676 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz"] Jul 08 19:06:01.012829 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.012814 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f" Jul 08 19:06:01.015684 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.015661 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-kfnm9\"" Jul 08 19:06:01.015806 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.015788 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 08 19:06:01.041906 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.041885 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv"] Jul 08 19:06:01.041906 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.041887 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.042086 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.041948 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f"] Jul 08 19:06:01.042086 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.041967 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz"] Jul 08 19:06:01.044871 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.044845 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 08 19:06:01.044964 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.044939 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 08 19:06:01.045010 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.044983 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 08 19:06:01.045055 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.045017 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 08 19:06:01.064943 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.064919 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8zx6\" (UniqueName: \"kubernetes.io/projected/65eeccc7-92bd-4368-ba14-006f4359eb52-kube-api-access-p8zx6\") pod \"managed-serviceaccount-addon-agent-57cbbb4cd-ln76f\" (UID: \"65eeccc7-92bd-4368-ba14-006f4359eb52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f" Jul 08 19:06:01.065060 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.065045 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/93abe0c3-1967-4154-8ec8-d70f9f8b261a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.065115 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.065077 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mchps\" (UniqueName: \"kubernetes.io/projected/93abe0c3-1967-4154-8ec8-d70f9f8b261a-kube-api-access-mchps\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.065115 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.065099 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a74eb786-74a9-461b-aa6d-7711c79087d9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c75d557cb-gfnjv\" (UID: \"a74eb786-74a9-461b-aa6d-7711c79087d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" Jul 08 19:06:01.065194 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.065155 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a74eb786-74a9-461b-aa6d-7711c79087d9-tmp\") pod \"klusterlet-addon-workmgr-6c75d557cb-gfnjv\" (UID: \"a74eb786-74a9-461b-aa6d-7711c79087d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" Jul 08 19:06:01.065194 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.065179 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65eeccc7-92bd-4368-ba14-006f4359eb52-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57cbbb4cd-ln76f\" (UID: \"65eeccc7-92bd-4368-ba14-006f4359eb52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f" Jul 08 19:06:01.065276 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.065208 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/93abe0c3-1967-4154-8ec8-d70f9f8b261a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.065324 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.065266 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cq8x\" (UniqueName: \"kubernetes.io/projected/a74eb786-74a9-461b-aa6d-7711c79087d9-kube-api-access-9cq8x\") pod \"klusterlet-addon-workmgr-6c75d557cb-gfnjv\" (UID: \"a74eb786-74a9-461b-aa6d-7711c79087d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" Jul 08 19:06:01.065379 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.065334 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/93abe0c3-1967-4154-8ec8-d70f9f8b261a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.065432 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.065389 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/93abe0c3-1967-4154-8ec8-d70f9f8b261a-ca\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.065432 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.065422 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/93abe0c3-1967-4154-8ec8-d70f9f8b261a-hub\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.166502 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.166417 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/93abe0c3-1967-4154-8ec8-d70f9f8b261a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.166502 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.166471 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cq8x\" (UniqueName: \"kubernetes.io/projected/a74eb786-74a9-461b-aa6d-7711c79087d9-kube-api-access-9cq8x\") pod \"klusterlet-addon-workmgr-6c75d557cb-gfnjv\" (UID: \"a74eb786-74a9-461b-aa6d-7711c79087d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" Jul 08 19:06:01.166502 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.166499 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/93abe0c3-1967-4154-8ec8-d70f9f8b261a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.166790 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.166542 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/93abe0c3-1967-4154-8ec8-d70f9f8b261a-ca\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.166790 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.166614 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/93abe0c3-1967-4154-8ec8-d70f9f8b261a-hub\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.166790 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.166666 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8zx6\" (UniqueName: \"kubernetes.io/projected/65eeccc7-92bd-4368-ba14-006f4359eb52-kube-api-access-p8zx6\") pod \"managed-serviceaccount-addon-agent-57cbbb4cd-ln76f\" (UID: \"65eeccc7-92bd-4368-ba14-006f4359eb52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f" Jul 08 19:06:01.166790 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.166764 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/93abe0c3-1967-4154-8ec8-d70f9f8b261a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.166961 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.166800 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mchps\" (UniqueName: \"kubernetes.io/projected/93abe0c3-1967-4154-8ec8-d70f9f8b261a-kube-api-access-mchps\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.166961 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.166831 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a74eb786-74a9-461b-aa6d-7711c79087d9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c75d557cb-gfnjv\" (UID: \"a74eb786-74a9-461b-aa6d-7711c79087d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" Jul 08 19:06:01.166961 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.166910 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a74eb786-74a9-461b-aa6d-7711c79087d9-tmp\") pod \"klusterlet-addon-workmgr-6c75d557cb-gfnjv\" (UID: \"a74eb786-74a9-461b-aa6d-7711c79087d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" Jul 08 19:06:01.167088 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.166959 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65eeccc7-92bd-4368-ba14-006f4359eb52-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57cbbb4cd-ln76f\" (UID: \"65eeccc7-92bd-4368-ba14-006f4359eb52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f" Jul 08 19:06:01.167366 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.167308 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/93abe0c3-1967-4154-8ec8-d70f9f8b261a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.167366 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.167330 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a74eb786-74a9-461b-aa6d-7711c79087d9-tmp\") pod \"klusterlet-addon-workmgr-6c75d557cb-gfnjv\" (UID: \"a74eb786-74a9-461b-aa6d-7711c79087d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" Jul 08 19:06:01.170840 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.170811 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/93abe0c3-1967-4154-8ec8-d70f9f8b261a-ca\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.170840 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.170831 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a74eb786-74a9-461b-aa6d-7711c79087d9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c75d557cb-gfnjv\" (UID: \"a74eb786-74a9-461b-aa6d-7711c79087d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" Jul 08 19:06:01.170840 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.170831 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65eeccc7-92bd-4368-ba14-006f4359eb52-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57cbbb4cd-ln76f\" (UID: \"65eeccc7-92bd-4368-ba14-006f4359eb52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f" Jul 08 19:06:01.171019 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.170862 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/93abe0c3-1967-4154-8ec8-d70f9f8b261a-hub\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.171266 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.171246 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/93abe0c3-1967-4154-8ec8-d70f9f8b261a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.171322 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.171288 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/93abe0c3-1967-4154-8ec8-d70f9f8b261a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.178107 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.178082 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mchps\" (UniqueName: \"kubernetes.io/projected/93abe0c3-1967-4154-8ec8-d70f9f8b261a-kube-api-access-mchps\") pod \"cluster-proxy-proxy-agent-68f758959b-zdptz\" (UID: \"93abe0c3-1967-4154-8ec8-d70f9f8b261a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:01.179519 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.179492 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8zx6\" (UniqueName: \"kubernetes.io/projected/65eeccc7-92bd-4368-ba14-006f4359eb52-kube-api-access-p8zx6\") pod \"managed-serviceaccount-addon-agent-57cbbb4cd-ln76f\" (UID: \"65eeccc7-92bd-4368-ba14-006f4359eb52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f" Jul 08 19:06:01.180061 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.180037 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cq8x\" (UniqueName: \"kubernetes.io/projected/a74eb786-74a9-461b-aa6d-7711c79087d9-kube-api-access-9cq8x\") pod \"klusterlet-addon-workmgr-6c75d557cb-gfnjv\" (UID: \"a74eb786-74a9-461b-aa6d-7711c79087d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" Jul 08 19:06:01.299791 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.299755 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" Jul 08 19:06:01.335012 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.334980 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f" Jul 08 19:06:01.351893 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:01.351869 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:06:02.985611 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:02.985555 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:06:02.986337 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:02.985632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:06:02.986337 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:02.985680 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:06:02.986337 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:02.985854 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle podName:67ff27b3-847a-430f-ba0a-c598ea1f84b7 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:10.985837183 +0000 UTC m=+52.698899170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle") pod "router-default-848485689f-bcs5k" (UID: "67ff27b3-847a-430f-ba0a-c598ea1f84b7") : configmap references non-existent config key: service-ca.crt Jul 08 19:06:02.986337 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:02.985937 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:06:02.986337 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:02.985974 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs podName:67ff27b3-847a-430f-ba0a-c598ea1f84b7 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:10.985961261 +0000 UTC m=+52.699023265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs") pod "router-default-848485689f-bcs5k" (UID: "67ff27b3-847a-430f-ba0a-c598ea1f84b7") : secret "router-metrics-certs-default" not found Jul 08 19:06:02.986337 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:02.986041 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:06:02.986337 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:02.986054 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5476666885-nm2rb: secret "image-registry-tls" not found Jul 08 19:06:02.986337 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:02.986085 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls podName:8e016d9b-4ab7-4d9a-956c-b24a0991e57c nodeName:}" failed. No retries permitted until 2026-07-08 19:06:10.986074328 +0000 UTC m=+52.699136315 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls") pod "image-registry-5476666885-nm2rb" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c") : secret "image-registry-tls" not found Jul 08 19:06:03.086430 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:03.086391 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:06:03.086635 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:03.086468 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8dqb7\" (UID: \"02594f62-8818-41f7-95dd-22615e301661\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:06:03.086635 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:03.086544 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:06:03.086635 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:03.086608 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:06:03.086635 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:03.086625 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls podName:95ae1488-f214-4927-b45c-ae6b78154a2c nodeName:}" failed. No retries permitted until 2026-07-08 19:06:11.086609455 +0000 UTC m=+52.799671441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-m5lfr" (UID: "95ae1488-f214-4927-b45c-ae6b78154a2c") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:06:03.086818 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:03.086673 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls podName:02594f62-8818-41f7-95dd-22615e301661 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:11.086657801 +0000 UTC m=+52.799719805 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8dqb7" (UID: "02594f62-8818-41f7-95dd-22615e301661") : secret "samples-operator-tls" not found Jul 08 19:06:03.187336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:03.187273 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:06:03.187503 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:03.187465 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:06:03.187577 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:03.187551 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls podName:2679ed35-5fc8-44e5-a711-464cc4147348 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:11.187520713 +0000 UTC m=+52.900582721 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls") pod "dns-default-d7qds" (UID: "2679ed35-5fc8-44e5-a711-464cc4147348") : secret "dns-default-metrics-tls" not found Jul 08 19:06:05.533128 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:05.532948 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f"] Jul 08 19:06:05.541111 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:05.541093 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz"] Jul 08 19:06:05.543475 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:05.543454 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv"] Jul 08 19:06:05.626856 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:06:05.626766 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65eeccc7_92bd_4368_ba14_006f4359eb52.slice/crio-67adc54cbdee88ac99fc100e63dd737ea96ae56c4a2dadc596cb6bb0d04b2b4b WatchSource:0}: Error finding container 67adc54cbdee88ac99fc100e63dd737ea96ae56c4a2dadc596cb6bb0d04b2b4b: Status 404 returned error can't find the container with id 67adc54cbdee88ac99fc100e63dd737ea96ae56c4a2dadc596cb6bb0d04b2b4b Jul 08 19:06:05.627992 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:06:05.627332 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93abe0c3_1967_4154_8ec8_d70f9f8b261a.slice/crio-807e390a043837aa8bdbbe63de034ded592b2bc12af0f1e54c1638fe3a61495a WatchSource:0}: Error finding container 807e390a043837aa8bdbbe63de034ded592b2bc12af0f1e54c1638fe3a61495a: Status 404 returned error can't find the container with id 807e390a043837aa8bdbbe63de034ded592b2bc12af0f1e54c1638fe3a61495a Jul 08 19:06:05.628187 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:06:05.628170 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda74eb786_74a9_461b_aa6d_7711c79087d9.slice/crio-54af673c6a1f886212088a2fcf320b6f5f47df59379f2859124a40a495edd2fc WatchSource:0}: Error finding container 54af673c6a1f886212088a2fcf320b6f5f47df59379f2859124a40a495edd2fc: Status 404 returned error can't find the container with id 54af673c6a1f886212088a2fcf320b6f5f47df59379f2859124a40a495edd2fc Jul 08 19:06:06.058766 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.058563 2554 generic.go:356] "Generic (PLEG): container finished" podID="b0f41c78-6dd9-4703-a789-2e8b8588dd34" containerID="eb5f91c6527ed2892e4df2594502fae448e07ff9c99539a935f071676126af08" exitCode=0 Jul 08 19:06:06.058921 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.058624 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zghgb" event={"ID":"b0f41c78-6dd9-4703-a789-2e8b8588dd34","Type":"ContainerDied","Data":"eb5f91c6527ed2892e4df2594502fae448e07ff9c99539a935f071676126af08"} Jul 08 19:06:06.061274 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.061251 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/0.log" Jul 08 19:06:06.061386 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.061288 2554 generic.go:356] "Generic (PLEG): container finished" podID="7b69a250-2ddf-4409-a5d6-d32e1930554f" containerID="e9f1040b69caf8b2e46c38b40d89712d783e9efc041bfe981f29e8183355edef" exitCode=255 Jul 08 19:06:06.061386 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.061354 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" event={"ID":"7b69a250-2ddf-4409-a5d6-d32e1930554f","Type":"ContainerDied","Data":"e9f1040b69caf8b2e46c38b40d89712d783e9efc041bfe981f29e8183355edef"} Jul 08 19:06:06.061631 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.061616 2554 scope.go:117] "RemoveContainer" containerID="e9f1040b69caf8b2e46c38b40d89712d783e9efc041bfe981f29e8183355edef" Jul 08 19:06:06.064151 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.064128 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jdbfs" event={"ID":"f740612f-3c23-4bc5-b121-6066ca21933d","Type":"ContainerStarted","Data":"b98668cb1c70d8ad1644c213b87826a6ce5db4c6ddc77b6eb1fbac34056d53dd"} Jul 08 19:06:06.067019 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.066995 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" event={"ID":"ca1f8503-54a2-49ad-b93b-06df16afe5ec","Type":"ContainerStarted","Data":"1dc85c00f548518e05e6cab0d87eed69122fe429e6bd657a8d2f6324ec923b5a"} Jul 08 19:06:06.068469 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.068448 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s2fhk" event={"ID":"703ee24d-3481-41b5-a46d-19ed9038cd15","Type":"ContainerStarted","Data":"695f896e35911fbfae0fcbba66d6927f98aa10aa124aa030dd619ed696146f14"} Jul 08 19:06:06.069856 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.069834 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" event={"ID":"43812205-6218-459c-9ea3-02fc8c11375f","Type":"ContainerStarted","Data":"6eff106a5a3cfb072bcc42280e41f10dd70d65c6675c1d20b573caf7f9b3df5c"} Jul 08 19:06:06.070917 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.070888 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" event={"ID":"a74eb786-74a9-461b-aa6d-7711c79087d9","Type":"ContainerStarted","Data":"54af673c6a1f886212088a2fcf320b6f5f47df59379f2859124a40a495edd2fc"} Jul 08 19:06:06.072068 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.072034 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f" event={"ID":"65eeccc7-92bd-4368-ba14-006f4359eb52","Type":"ContainerStarted","Data":"67adc54cbdee88ac99fc100e63dd737ea96ae56c4a2dadc596cb6bb0d04b2b4b"} Jul 08 19:06:06.073535 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.073506 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" event={"ID":"c4c20110-58e2-40d1-8740-de379ef5108a","Type":"ContainerStarted","Data":"b087072e1c68b9c690ad7b42d89b6371140be2358fbdce95e48aacd17926e829"} Jul 08 19:06:06.074826 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.074807 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" event={"ID":"93abe0c3-1967-4154-8ec8-d70f9f8b261a","Type":"ContainerStarted","Data":"807e390a043837aa8bdbbe63de034ded592b2bc12af0f1e54c1638fe3a61495a"} Jul 08 19:06:06.148437 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.144756 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" podStartSLOduration=20.610346345 podStartE2EDuration="30.144735729s" totalImagesPullingTime="9.534389384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:06.134173352 +0000 UTC m=+47.847235561" watchObservedRunningTime="2026-07-08 19:06:06.144735729 +0000 UTC m=+47.857797740" Jul 08 19:06:06.228745 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.228687 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" podStartSLOduration=20.71164143 podStartE2EDuration="30.22866426s" totalImagesPullingTime="9.51702283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:06.185622752 +0000 UTC m=+47.898684763" watchObservedRunningTime="2026-07-08 19:06:06.22866426 +0000 UTC m=+47.941726271" Jul 08 19:06:06.268215 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.268162 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s2fhk" podStartSLOduration=20.475301285 podStartE2EDuration="30.268146127s" totalImagesPullingTime="9.792844842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:06.262794197 +0000 UTC m=+47.975856205" watchObservedRunningTime="2026-07-08 19:06:06.268146127 +0000 UTC m=+47.981208135" Jul 08 19:06:06.312445 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.312388 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" podStartSLOduration=20.803305415 podStartE2EDuration="30.312366488s" totalImagesPullingTime="9.509061073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:06.311021981 +0000 UTC m=+48.024083990" watchObservedRunningTime="2026-07-08 19:06:06.312366488 +0000 UTC m=+48.025428499" Jul 08 19:06:06.361847 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.361420 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jdbfs" podStartSLOduration=1.897633108 podStartE2EDuration="11.361398374s" totalImagesPullingTime="9.463765266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:06.359982043 +0000 UTC m=+48.073044052" watchObservedRunningTime="2026-07-08 19:06:06.361398374 +0000 UTC m=+48.074460385" Jul 08 19:06:06.794452 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.794390 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:06.856535 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:06.856428 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:07.092190 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.092108 2554 generic.go:356] "Generic (PLEG): container finished" podID="b0f41c78-6dd9-4703-a789-2e8b8588dd34" containerID="71900ca13496ee08e36ded7160a0d7c988a839403951d9e06a76b583d7d629a6" exitCode=0 Jul 08 19:06:07.092342 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.092213 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zghgb" event={"ID":"b0f41c78-6dd9-4703-a789-2e8b8588dd34","Type":"ContainerDied","Data":"71900ca13496ee08e36ded7160a0d7c988a839403951d9e06a76b583d7d629a6"} Jul 08 19:06:07.099312 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.099287 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:06:07.103552 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.101876 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/0.log" Jul 08 19:06:07.103552 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.101908 2554 generic.go:356] "Generic (PLEG): container finished" podID="7b69a250-2ddf-4409-a5d6-d32e1930554f" containerID="b06ead82ad0c168ce10a61c0a166eb1a96372738c4c6a9f0f235ba3d726dc2d2" exitCode=255 Jul 08 19:06:07.103552 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.102001 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" event={"ID":"7b69a250-2ddf-4409-a5d6-d32e1930554f","Type":"ContainerDied","Data":"b06ead82ad0c168ce10a61c0a166eb1a96372738c4c6a9f0f235ba3d726dc2d2"} Jul 08 19:06:07.103552 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.102046 2554 scope.go:117] "RemoveContainer" containerID="e9f1040b69caf8b2e46c38b40d89712d783e9efc041bfe981f29e8183355edef" Jul 08 19:06:07.103552 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.102815 2554 scope.go:117] "RemoveContainer" containerID="b06ead82ad0c168ce10a61c0a166eb1a96372738c4c6a9f0f235ba3d726dc2d2" Jul 08 19:06:07.103552 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:07.102974 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8rx2k_openshift-console-operator(7b69a250-2ddf-4409-a5d6-d32e1930554f)\"" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" podUID="7b69a250-2ddf-4409-a5d6-d32e1930554f" Jul 08 19:06:07.350455 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.349924 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cxj44"] Jul 08 19:06:07.380703 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.380647 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cxj44"] Jul 08 19:06:07.380871 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.380784 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.386170 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.385513 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vczqd\"" Jul 08 19:06:07.386170 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.386001 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 19:06:07.387487 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.386953 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 19:06:07.410926 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.410860 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:07.438065 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.438024 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggsv2\" (UniqueName: \"kubernetes.io/projected/52354b96-af19-4e4a-b38b-a922ba912690-kube-api-access-ggsv2\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.438220 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.438096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52354b96-af19-4e4a-b38b-a922ba912690-data-volume\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.438220 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.438125 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.438369 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.438282 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.438369 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.438340 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52354b96-af19-4e4a-b38b-a922ba912690-crio-socket\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.507856 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.507798 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:07.541935 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.540426 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.541935 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.540484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52354b96-af19-4e4a-b38b-a922ba912690-crio-socket\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.541935 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.540556 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggsv2\" (UniqueName: \"kubernetes.io/projected/52354b96-af19-4e4a-b38b-a922ba912690-kube-api-access-ggsv2\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.541935 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.540605 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52354b96-af19-4e4a-b38b-a922ba912690-data-volume\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.541935 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.540633 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.541935 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:07.540774 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:06:07.541935 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:07.540837 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls podName:52354b96-af19-4e4a-b38b-a922ba912690 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:08.040819092 +0000 UTC m=+49.753881085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxj44" (UID: "52354b96-af19-4e4a-b38b-a922ba912690") : secret "insights-runtime-extractor-tls" not found Jul 08 19:06:07.541935 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:07.541077 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:06:07.541935 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:07.541116 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm podName:52354b96-af19-4e4a-b38b-a922ba912690 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:08.041102586 +0000 UTC m=+49.754164578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxj44" (UID: "52354b96-af19-4e4a-b38b-a922ba912690") : configmap "kube-rbac-proxy" not found Jul 08 19:06:07.541935 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.541313 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52354b96-af19-4e4a-b38b-a922ba912690-crio-socket\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.541935 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.541870 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52354b96-af19-4e4a-b38b-a922ba912690-data-volume\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.555910 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.555877 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggsv2\" (UniqueName: \"kubernetes.io/projected/52354b96-af19-4e4a-b38b-a922ba912690-kube-api-access-ggsv2\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:07.695799 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.695669 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:07.769638 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.769534 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:07.875810 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.875752 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:07.941168 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:07.941074 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:08.014009 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:08.013965 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:08.047981 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:08.047127 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:08.047981 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:08.047268 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:08.047981 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:08.047505 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:06:08.047981 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:08.047578 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls podName:52354b96-af19-4e4a-b38b-a922ba912690 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:09.047559394 +0000 UTC m=+50.760621386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxj44" (UID: "52354b96-af19-4e4a-b38b-a922ba912690") : secret "insights-runtime-extractor-tls" not found Jul 08 19:06:08.047981 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:08.047866 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:06:08.047981 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:08.047913 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm podName:52354b96-af19-4e4a-b38b-a922ba912690 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:09.047898514 +0000 UTC m=+50.760960507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxj44" (UID: "52354b96-af19-4e4a-b38b-a922ba912690") : configmap "kube-rbac-proxy" not found Jul 08 19:06:08.113537 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:08.113224 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:08.126255 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:08.126211 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zghgb" event={"ID":"b0f41c78-6dd9-4703-a789-2e8b8588dd34","Type":"ContainerStarted","Data":"4f6e21299f91061d94b4833abeec5db1767007056dce6f972ffa39f59fca8312"} Jul 08 19:06:08.134611 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:08.133856 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:06:08.134611 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:08.134230 2554 scope.go:117] "RemoveContainer" containerID="b06ead82ad0c168ce10a61c0a166eb1a96372738c4c6a9f0f235ba3d726dc2d2" Jul 08 19:06:08.134611 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:08.134409 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8rx2k_openshift-console-operator(7b69a250-2ddf-4409-a5d6-d32e1930554f)\"" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" podUID="7b69a250-2ddf-4409-a5d6-d32e1930554f" Jul 08 19:06:08.156367 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:08.156145 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zghgb" podStartSLOduration=17.917035996 podStartE2EDuration="50.156124716s" totalImagesPullingTime="32.23908872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:05:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:08.155603364 +0000 UTC m=+49.868665370" watchObservedRunningTime="2026-07-08 19:06:08.156124716 +0000 UTC m=+49.869186704" Jul 08 19:06:08.258200 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:08.258116 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:08.359651 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:08.359452 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:08.460866 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:08.460836 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:08.712550 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:08.712488 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:08.811374 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:08.811342 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:09.061508 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:09.061175 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:09.061508 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:09.061270 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:06:09.061508 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:09.061356 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm podName:52354b96-af19-4e4a-b38b-a922ba912690 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:11.061334701 +0000 UTC m=+52.774396689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxj44" (UID: "52354b96-af19-4e4a-b38b-a922ba912690") : configmap "kube-rbac-proxy" not found Jul 08 19:06:09.061508 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:09.061281 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:09.061508 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:09.061388 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:06:09.061508 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:09.061441 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls podName:52354b96-af19-4e4a-b38b-a922ba912690 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:11.061425487 +0000 UTC m=+52.774487475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxj44" (UID: "52354b96-af19-4e4a-b38b-a922ba912690") : secret "insights-runtime-extractor-tls" not found Jul 08 19:06:09.344627 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:09.344537 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:09.363157 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:09.363130 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hrtph_9fc4fdec-4266-4d3f-84f2-d8af4e5b6088/dns-node-resolver/0.log" Jul 08 19:06:09.414476 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:09.414440 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:10.161946 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:10.161920 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hcvlp_9a7e5565-004d-4074-afba-446e2b1aa5bb/node-ca/0.log" Jul 08 19:06:10.417622 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:10.417511 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:10.522243 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:10.522202 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:10.700791 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:10.700700 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:10.762660 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:10.762620 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:10.987456 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:10.987422 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:06:10.987680 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:10.987491 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:06:10.987680 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:10.987538 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:06:10.987680 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:10.987611 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:06:10.987680 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:10.987669 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:06:10.987680 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:10.987683 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5476666885-nm2rb: secret "image-registry-tls" not found Jul 08 19:06:10.987902 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:10.987689 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs podName:67ff27b3-847a-430f-ba0a-c598ea1f84b7 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:26.987668149 +0000 UTC m=+68.700730150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs") pod "router-default-848485689f-bcs5k" (UID: "67ff27b3-847a-430f-ba0a-c598ea1f84b7") : secret "router-metrics-certs-default" not found Jul 08 19:06:10.987902 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:10.987716 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls podName:8e016d9b-4ab7-4d9a-956c-b24a0991e57c nodeName:}" failed. No retries permitted until 2026-07-08 19:06:26.987706043 +0000 UTC m=+68.700768049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls") pod "image-registry-5476666885-nm2rb" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c") : secret "image-registry-tls" not found Jul 08 19:06:10.987902 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:10.987731 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle podName:67ff27b3-847a-430f-ba0a-c598ea1f84b7 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:26.987723606 +0000 UTC m=+68.700785598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle") pod "router-default-848485689f-bcs5k" (UID: "67ff27b3-847a-430f-ba0a-c598ea1f84b7") : configmap references non-existent config key: service-ca.crt Jul 08 19:06:11.088900 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:11.088866 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:06:11.089068 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:11.088935 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:11.089068 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:11.088974 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8dqb7\" (UID: \"02594f62-8818-41f7-95dd-22615e301661\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:06:11.089068 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:11.089029 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:06:11.089212 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:11.089064 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:06:11.089212 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:11.089096 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls podName:95ae1488-f214-4927-b45c-ae6b78154a2c nodeName:}" failed. No retries permitted until 2026-07-08 19:06:27.089079554 +0000 UTC m=+68.802141541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-m5lfr" (UID: "95ae1488-f214-4927-b45c-ae6b78154a2c") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:06:11.089212 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:11.089068 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:11.089212 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:11.089111 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm podName:52354b96-af19-4e4a-b38b-a922ba912690 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:15.089105301 +0000 UTC m=+56.802167289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxj44" (UID: "52354b96-af19-4e4a-b38b-a922ba912690") : configmap "kube-rbac-proxy" not found Jul 08 19:06:11.089212 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:11.089153 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:06:11.089212 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:11.089203 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls podName:52354b96-af19-4e4a-b38b-a922ba912690 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:15.089186213 +0000 UTC m=+56.802248207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxj44" (UID: "52354b96-af19-4e4a-b38b-a922ba912690") : secret "insights-runtime-extractor-tls" not found Jul 08 19:06:11.089436 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:11.089223 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:06:11.089436 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:11.089286 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls podName:02594f62-8818-41f7-95dd-22615e301661 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:27.089271271 +0000 UTC m=+68.802333267 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8dqb7" (UID: "02594f62-8818-41f7-95dd-22615e301661") : secret "samples-operator-tls" not found Jul 08 19:06:11.190069 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:11.190042 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:06:11.190443 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:11.190202 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:06:11.190443 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:11.190265 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls podName:2679ed35-5fc8-44e5-a711-464cc4147348 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:27.190250305 +0000 UTC m=+68.903312292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls") pod "dns-default-d7qds" (UID: "2679ed35-5fc8-44e5-a711-464cc4147348") : secret "dns-default-metrics-tls" not found Jul 08 19:06:11.360874 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:11.360790 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jdbfs_f740612f-3c23-4bc5-b121-6066ca21933d/serve-healthcheck-canary/0.log" Jul 08 19:06:11.409209 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:11.409174 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:13.153688 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:13.153652 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" event={"ID":"a74eb786-74a9-461b-aa6d-7711c79087d9","Type":"ContainerStarted","Data":"1fdfadf8e4512ab61d928e2d0cd59c0ca4b0dacf96588fd0fba411ed03e7e6d1"} Jul 08 19:06:13.154121 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:13.153831 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" Jul 08 19:06:13.155310 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:13.155278 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f" event={"ID":"65eeccc7-92bd-4368-ba14-006f4359eb52","Type":"ContainerStarted","Data":"dfa65ef082c9b6762c9adff5b6ce794ead329100af62da7fd4c06756c85f068f"} Jul 08 19:06:13.155851 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:13.155827 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" Jul 08 19:06:13.157698 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:13.157676 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" event={"ID":"93abe0c3-1967-4154-8ec8-d70f9f8b261a","Type":"ContainerStarted","Data":"0273e940a9318ce0cb3d9687904e48e6a1a8bfb1caca4571e83722114402afd5"} Jul 08 19:06:13.157793 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:13.157707 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" event={"ID":"93abe0c3-1967-4154-8ec8-d70f9f8b261a","Type":"ContainerStarted","Data":"5f9d40d5a7963bb5274924fc6e49bb9db604a51d02fd848c326e0a3ce6d873c2"} Jul 08 19:06:13.157793 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:13.157719 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" event={"ID":"93abe0c3-1967-4154-8ec8-d70f9f8b261a","Type":"ContainerStarted","Data":"1c0ae8f9adac0952dd4cc23a72f9d3780a4a20bfb1e6fcebdd501cfffec0c03b"} Jul 08 19:06:13.176081 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:13.176043 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c75d557cb-gfnjv" podStartSLOduration=6.144167999 podStartE2EDuration="13.176030325s" totalImagesPullingTime="7.031862326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:13.174392838 +0000 UTC m=+54.887454847" watchObservedRunningTime="2026-07-08 19:06:13.176030325 +0000 UTC m=+54.889092344" Jul 08 19:06:13.192339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:13.192297 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57cbbb4cd-ln76f" podStartSLOduration=6.17829432 podStartE2EDuration="13.192285939s" totalImagesPullingTime="7.013991619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:13.191717809 +0000 UTC m=+54.904779821" watchObservedRunningTime="2026-07-08 19:06:13.192285939 +0000 UTC m=+54.905347945" Jul 08 19:06:13.214944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:13.214899 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" podStartSLOduration=6.1876404449999995 podStartE2EDuration="13.214886809s" totalImagesPullingTime="7.027246364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:13.214007733 +0000 UTC m=+54.927069745" watchObservedRunningTime="2026-07-08 19:06:13.214886809 +0000 UTC m=+54.927948818" Jul 08 19:06:14.207451 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:14.207415 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:14.645567 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:14.645477 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:14.747451 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:14.747412 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:14.848953 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:14.848919 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:15.072848 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:15.072807 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:15.126090 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:15.126065 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:15.126241 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:15.126154 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:15.126241 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:15.126203 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:06:15.126367 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:15.126277 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm podName:52354b96-af19-4e4a-b38b-a922ba912690 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:23.126255458 +0000 UTC m=+64.839317461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxj44" (UID: "52354b96-af19-4e4a-b38b-a922ba912690") : configmap "kube-rbac-proxy" not found Jul 08 19:06:15.126367 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:15.126293 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:06:15.126367 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:15.126351 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls podName:52354b96-af19-4e4a-b38b-a922ba912690 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:23.126336353 +0000 UTC m=+64.839398348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxj44" (UID: "52354b96-af19-4e4a-b38b-a922ba912690") : secret "insights-runtime-extractor-tls" not found Jul 08 19:06:15.252058 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:15.252027 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:15.352059 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:15.351953 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:15.468966 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:15.468933 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:15.559850 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:15.559820 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:15.595938 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:15.595904 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:06:15.596091 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:15.595984 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:06:15.596371 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:15.596355 2554 scope.go:117] "RemoveContainer" containerID="b06ead82ad0c168ce10a61c0a166eb1a96372738c4c6a9f0f235ba3d726dc2d2" Jul 08 19:06:15.596552 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:15.596529 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8rx2k_openshift-console-operator(7b69a250-2ddf-4409-a5d6-d32e1930554f)\"" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" podUID="7b69a250-2ddf-4409-a5d6-d32e1930554f" Jul 08 19:06:15.657884 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:15.657813 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:15.930423 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:15.930317 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:16.947472 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:16.947427 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:17.329052 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:17.329017 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:17.530989 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:17.530954 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:17.726214 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:17.726186 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:17.931345 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:17.931317 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:18.668204 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:18.668169 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:18.768956 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:18.768925 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:19.123797 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:19.123765 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:19.333604 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:19.333554 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:19.556839 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:19.556808 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:19.655431 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:19.655397 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:19.751754 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:19.751718 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:19.940106 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:19.940019 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:19.999147 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:19.999126 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l49h6" Jul 08 19:06:20.619887 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:20.619851 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:21.137417 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:21.137380 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:21.328090 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:21.328060 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:21.429243 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:21.429157 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:21.531416 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:21.531382 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:21.742525 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:21.742494 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:21.948120 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:21.948080 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:22.880195 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:22.880160 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:22.981640 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:22.981606 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:23.127502 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:23.127473 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:23.198844 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:23.198767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:23.199004 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:23.198869 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:23.199004 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:23.198923 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:06:23.199004 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:23.198992 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls podName:52354b96-af19-4e4a-b38b-a922ba912690 nodeName:}" failed. No retries permitted until 2026-07-08 19:06:39.198974118 +0000 UTC m=+80.912036120 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxj44" (UID: "52354b96-af19-4e4a-b38b-a922ba912690") : secret "insights-runtime-extractor-tls" not found Jul 08 19:06:23.199326 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:23.199306 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52354b96-af19-4e4a-b38b-a922ba912690-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:23.572387 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:23.572353 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:23.737964 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:23.737934 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:24.130822 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.130787 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:24.409687 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.409579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs\") pod \"network-metrics-daemon-n9cvr\" (UID: \"f8410cd6-d550-4965-b769-0e74878b627c\") " pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:06:24.409687 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.409667 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnsfs\" (UniqueName: \"kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs\") pod \"network-check-target-clvfv\" (UID: \"23ec8c0f-09a1-4ea4-8999-e4378d4938ff\") " pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:06:24.412024 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.411993 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnsfs\" (UniqueName: \"kubernetes.io/projected/23ec8c0f-09a1-4ea4-8999-e4378d4938ff-kube-api-access-cnsfs\") pod \"network-check-target-clvfv\" (UID: \"23ec8c0f-09a1-4ea4-8999-e4378d4938ff\") " pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:06:24.412555 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.412538 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 19:06:24.422384 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.422360 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8410cd6-d550-4965-b769-0e74878b627c-metrics-certs\") pod \"network-metrics-daemon-n9cvr\" (UID: \"f8410cd6-d550-4965-b769-0e74878b627c\") " pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:06:24.442438 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.442415 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fsv9h\"" Jul 08 19:06:24.450116 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.450093 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:06:24.510767 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.510740 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:06:24.513818 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.513790 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 19:06:24.523401 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.523370 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2687d3bc-3cc1-44ef-8da4-be808f0e005b-original-pull-secret\") pod \"global-pull-secret-syncer-s5ld2\" (UID: \"2687d3bc-3cc1-44ef-8da4-be808f0e005b\") " pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:06:24.613143 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.613121 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-clvfv"] Jul 08 19:06:24.615366 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:06:24.615338 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ec8c0f_09a1_4ea4_8999_e4378d4938ff.slice/crio-2bdd972ed4ff97a7494651f3bc4784f9d4795420acc8d08a7d4f95762c63558c WatchSource:0}: Error finding container 2bdd972ed4ff97a7494651f3bc4784f9d4795420acc8d08a7d4f95762c63558c: Status 404 returned error can't find the container with id 2bdd972ed4ff97a7494651f3bc4784f9d4795420acc8d08a7d4f95762c63558c Jul 08 19:06:24.645842 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.645821 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vfh9q\"" Jul 08 19:06:24.653292 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.653270 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n9cvr" Jul 08 19:06:24.730811 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.730682 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:24.746380 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.746357 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5ld2" Jul 08 19:06:24.806865 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.806840 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n9cvr"] Jul 08 19:06:24.809258 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:06:24.809224 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8410cd6_d550_4965_b769_0e74878b627c.slice/crio-21ef6f210e76a121d4b36f6899c144e4acc9c600fc337076d253696c35f43c5b WatchSource:0}: Error finding container 21ef6f210e76a121d4b36f6899c144e4acc9c600fc337076d253696c35f43c5b: Status 404 returned error can't find the container with id 21ef6f210e76a121d4b36f6899c144e4acc9c600fc337076d253696c35f43c5b Jul 08 19:06:24.889041 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:24.888964 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s5ld2"] Jul 08 19:06:24.891333 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:06:24.891310 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2687d3bc_3cc1_44ef_8da4_be808f0e005b.slice/crio-d9f5df88ea926b732d674c317a87a3f7e8634a402f4088dddc0efd3433680f6b WatchSource:0}: Error finding container d9f5df88ea926b732d674c317a87a3f7e8634a402f4088dddc0efd3433680f6b: Status 404 returned error can't find the container with id d9f5df88ea926b732d674c317a87a3f7e8634a402f4088dddc0efd3433680f6b Jul 08 19:06:25.132151 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:25.132103 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:25.195621 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:25.195575 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s5ld2" event={"ID":"2687d3bc-3cc1-44ef-8da4-be808f0e005b","Type":"ContainerStarted","Data":"d9f5df88ea926b732d674c317a87a3f7e8634a402f4088dddc0efd3433680f6b"} Jul 08 19:06:25.196709 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:25.196686 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n9cvr" event={"ID":"f8410cd6-d550-4965-b769-0e74878b627c","Type":"ContainerStarted","Data":"21ef6f210e76a121d4b36f6899c144e4acc9c600fc337076d253696c35f43c5b"} Jul 08 19:06:25.198046 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:25.198018 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-clvfv" event={"ID":"23ec8c0f-09a1-4ea4-8999-e4378d4938ff","Type":"ContainerStarted","Data":"f43acf2dd0accf73c9b40585da0a54c10025e83e7635279579cf21c6b1f4d07f"} Jul 08 19:06:25.198153 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:25.198063 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-clvfv" event={"ID":"23ec8c0f-09a1-4ea4-8999-e4378d4938ff","Type":"ContainerStarted","Data":"2bdd972ed4ff97a7494651f3bc4784f9d4795420acc8d08a7d4f95762c63558c"} Jul 08 19:06:25.198153 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:25.198143 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:06:25.218320 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:25.218270 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-clvfv" podStartSLOduration=67.218256867 podStartE2EDuration="1m7.218256867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:25.217993427 +0000 UTC m=+66.931055436" watchObservedRunningTime="2026-07-08 19:06:25.218256867 +0000 UTC m=+66.931318876" Jul 08 19:06:25.285423 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:25.285395 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:25.343415 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:25.343385 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:25.529183 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:25.529142 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:27.034962 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.034917 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:06:27.034962 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.034970 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:06:27.035435 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.035091 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:06:27.035775 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.035750 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ff27b3-847a-430f-ba0a-c598ea1f84b7-service-ca-bundle\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:06:27.037249 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.037220 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff27b3-847a-430f-ba0a-c598ea1f84b7-metrics-certs\") pod \"router-default-848485689f-bcs5k\" (UID: \"67ff27b3-847a-430f-ba0a-c598ea1f84b7\") " pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:06:27.037398 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.037378 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls\") pod \"image-registry-5476666885-nm2rb\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:06:27.135966 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.135889 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:06:27.136116 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.135966 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8dqb7\" (UID: \"02594f62-8818-41f7-95dd-22615e301661\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:06:27.138782 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.138756 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/02594f62-8818-41f7-95dd-22615e301661-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8dqb7\" (UID: \"02594f62-8818-41f7-95dd-22615e301661\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:06:27.139522 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.139494 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95ae1488-f214-4927-b45c-ae6b78154a2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m5lfr\" (UID: \"95ae1488-f214-4927-b45c-ae6b78154a2c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:06:27.213029 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.212990 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n9cvr" event={"ID":"f8410cd6-d550-4965-b769-0e74878b627c","Type":"ContainerStarted","Data":"eed1956c39d700fcd10e84d750a09bb59c84029054b22f43e9703238c466519f"} Jul 08 19:06:27.213175 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.213051 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n9cvr" event={"ID":"f8410cd6-d550-4965-b769-0e74878b627c","Type":"ContainerStarted","Data":"0201f15f2b764d4705f1b7aa76396df5b5f0290d0d2b3701e12f1c79867865c2"} Jul 08 19:06:27.236730 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.236701 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:06:27.239351 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.239332 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2679ed35-5fc8-44e5-a711-464cc4147348-metrics-tls\") pod \"dns-default-d7qds\" (UID: \"2679ed35-5fc8-44e5-a711-464cc4147348\") " pod="openshift-dns/dns-default-d7qds" Jul 08 19:06:27.245044 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.244966 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n9cvr" podStartSLOduration=67.541241126 podStartE2EDuration="1m9.244949299s" totalImagesPullingTime="1.703708173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:27.244154517 +0000 UTC m=+68.957216526" watchObservedRunningTime="2026-07-08 19:06:27.244949299 +0000 UTC m=+68.958011312" Jul 08 19:06:27.299125 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.299099 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mxm59\"" Jul 08 19:06:27.307173 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.307137 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:06:27.325158 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.325134 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xc4bf\"" Jul 08 19:06:27.333617 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.333576 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:06:27.353425 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.353408 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d5pht\"" Jul 08 19:06:27.361652 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.361635 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" Jul 08 19:06:27.445443 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.444983 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pqqlw\"" Jul 08 19:06:27.445443 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.445229 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" Jul 08 19:06:27.457478 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.457265 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cxdf4\"" Jul 08 19:06:27.460738 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.460665 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d7qds" Jul 08 19:06:27.498983 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.498842 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5476666885-nm2rb"] Jul 08 19:06:27.502948 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:06:27.502778 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e016d9b_4ab7_4d9a_956c_b24a0991e57c.slice/crio-72e8eaf15acaf84c7cf1833bfabe7055b7a0a6dbccd95e8ea770ea94fe555c7b WatchSource:0}: Error finding container 72e8eaf15acaf84c7cf1833bfabe7055b7a0a6dbccd95e8ea770ea94fe555c7b: Status 404 returned error can't find the container with id 72e8eaf15acaf84c7cf1833bfabe7055b7a0a6dbccd95e8ea770ea94fe555c7b Jul 08 19:06:27.548335 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.548134 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-848485689f-bcs5k"] Jul 08 19:06:27.572803 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.572749 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr"] Jul 08 19:06:27.575720 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:06:27.575693 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ae1488_f214_4927_b45c_ae6b78154a2c.slice/crio-fdbfeb7c90ca50f3e67ddb7481804c8f54cd231b91f4cf90488acd82272e8b46 WatchSource:0}: Error finding container fdbfeb7c90ca50f3e67ddb7481804c8f54cd231b91f4cf90488acd82272e8b46: Status 404 returned error can't find the container with id fdbfeb7c90ca50f3e67ddb7481804c8f54cd231b91f4cf90488acd82272e8b46 Jul 08 19:06:27.641141 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.640793 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7"] Jul 08 19:06:27.665625 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:27.665573 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d7qds"] Jul 08 19:06:27.669965 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:06:27.669943 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2679ed35_5fc8_44e5_a711_464cc4147348.slice/crio-1e44f329c48c883c909c02d5088b26a9f1090b34bf9a37ec0e02efeb492787e0 WatchSource:0}: Error finding container 1e44f329c48c883c909c02d5088b26a9f1090b34bf9a37ec0e02efeb492787e0: Status 404 returned error can't find the container with id 1e44f329c48c883c909c02d5088b26a9f1090b34bf9a37ec0e02efeb492787e0 Jul 08 19:06:28.219038 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:28.218983 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" event={"ID":"02594f62-8818-41f7-95dd-22615e301661","Type":"ContainerStarted","Data":"3e86453f40ea47446e2c365ed36722dfb7013f2109fdf04f6e3ea45d6140f6d3"} Jul 08 19:06:28.220716 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:28.220534 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" event={"ID":"95ae1488-f214-4927-b45c-ae6b78154a2c","Type":"ContainerStarted","Data":"fdbfeb7c90ca50f3e67ddb7481804c8f54cd231b91f4cf90488acd82272e8b46"} Jul 08 19:06:28.222675 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:28.222429 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-848485689f-bcs5k" event={"ID":"67ff27b3-847a-430f-ba0a-c598ea1f84b7","Type":"ContainerStarted","Data":"025d6bce4cb355465d50c03eda104f773514423104dc0bc683600002216f85cd"} Jul 08 19:06:28.222675 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:28.222476 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-848485689f-bcs5k" event={"ID":"67ff27b3-847a-430f-ba0a-c598ea1f84b7","Type":"ContainerStarted","Data":"4b160238fdb1fa7a29aa57d610ddfbd7ae2feb6528979264d52c605c150dc213"} Jul 08 19:06:28.223818 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:28.223788 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d7qds" event={"ID":"2679ed35-5fc8-44e5-a711-464cc4147348","Type":"ContainerStarted","Data":"1e44f329c48c883c909c02d5088b26a9f1090b34bf9a37ec0e02efeb492787e0"} Jul 08 19:06:28.225448 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:28.225419 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5476666885-nm2rb" event={"ID":"8e016d9b-4ab7-4d9a-956c-b24a0991e57c","Type":"ContainerStarted","Data":"6106bc7bc1a1bf31352148c05ccf2d3f71a32be23f3f9d5118e9f994f37bb23e"} Jul 08 19:06:28.225559 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:28.225468 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5476666885-nm2rb" event={"ID":"8e016d9b-4ab7-4d9a-956c-b24a0991e57c","Type":"ContainerStarted","Data":"72e8eaf15acaf84c7cf1833bfabe7055b7a0a6dbccd95e8ea770ea94fe555c7b"} Jul 08 19:06:28.244513 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:28.244420 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-848485689f-bcs5k" podStartSLOduration=52.244400271 podStartE2EDuration="52.244400271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:28.243767802 +0000 UTC m=+69.956829815" watchObservedRunningTime="2026-07-08 19:06:28.244400271 +0000 UTC m=+69.957462280" Jul 08 19:06:28.266319 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:28.266265 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5476666885-nm2rb" podStartSLOduration=69.266245975 podStartE2EDuration="1m9.266245975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:28.265125188 +0000 UTC m=+69.978187197" watchObservedRunningTime="2026-07-08 19:06:28.266245975 +0000 UTC m=+69.979307986" Jul 08 19:06:28.334417 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:28.334376 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:06:28.337752 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:28.337725 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:06:29.231119 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:29.230828 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:06:29.231563 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:29.231212 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:06:29.232642 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:29.232521 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-848485689f-bcs5k" Jul 08 19:06:30.821028 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:30.820994 2554 scope.go:117] "RemoveContainer" containerID="b06ead82ad0c168ce10a61c0a166eb1a96372738c4c6a9f0f235ba3d726dc2d2" Jul 08 19:06:30.908026 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:30.907981 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:30.978653 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:30.978618 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:31.627855 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:31.627816 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:31.719923 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:31.719855 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:31.821335 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:31.821291 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:31.935475 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:31.935435 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:32.225054 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:32.225022 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:32.324046 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:32.324009 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:33.249918 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.249876 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s5ld2" event={"ID":"2687d3bc-3cc1-44ef-8da4-be808f0e005b","Type":"ContainerStarted","Data":"17ed73ff35633a4e71664c02e44ed6f55e2c22f0bbf516a7173ee0c22e95f809"} Jul 08 19:06:33.252529 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.252457 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:06:33.252677 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.252582 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" event={"ID":"7b69a250-2ddf-4409-a5d6-d32e1930554f","Type":"ContainerStarted","Data":"8b01147fd272a8d5155d44c3afaf4302f1ded07cab6654cf92525f12e9211ddb"} Jul 08 19:06:33.253226 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.253197 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:06:33.255343 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.255303 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:33.256538 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.256506 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d7qds" event={"ID":"2679ed35-5fc8-44e5-a711-464cc4147348","Type":"ContainerStarted","Data":"be0bf9196c770762d76afb5210c8c37fe15574551fdd2fee575b179ee5e0f9ef"} Jul 08 19:06:33.256664 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.256548 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d7qds" event={"ID":"2679ed35-5fc8-44e5-a711-464cc4147348","Type":"ContainerStarted","Data":"432944477ecee993b3a07f774cc4c20652dec0028b68d37acf7c81e351722c1c"} Jul 08 19:06:33.256664 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.256569 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d7qds" Jul 08 19:06:33.258454 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.258429 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" event={"ID":"02594f62-8818-41f7-95dd-22615e301661","Type":"ContainerStarted","Data":"2140ae8780b29665999cb80c2039669ac46a9837e8325cf07bd352321f291f53"} Jul 08 19:06:33.258559 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.258477 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" event={"ID":"02594f62-8818-41f7-95dd-22615e301661","Type":"ContainerStarted","Data":"316480f3280e42ba1f646bc64b7221b1090b320b1ed0de334bfcc5c04b1ad264"} Jul 08 19:06:33.259963 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.259945 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" event={"ID":"95ae1488-f214-4927-b45c-ae6b78154a2c","Type":"ContainerStarted","Data":"3668a304e46d89975e7e7307c517cfa05c821c1eefed6129c0d77cbf3c650bed"} Jul 08 19:06:33.292474 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.292414 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8dqb7" podStartSLOduration=52.280129138 podStartE2EDuration="57.29239501s" totalImagesPullingTime="5.012265872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:33.292077262 +0000 UTC m=+75.005139270" watchObservedRunningTime="2026-07-08 19:06:33.29239501 +0000 UTC m=+75.005457021" Jul 08 19:06:33.293087 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.293056 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s5ld2" podStartSLOduration=66.46214674 podStartE2EDuration="1m14.293045528s" totalImagesPullingTime="7.830898788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:33.272556804 +0000 UTC m=+74.985618813" watchObservedRunningTime="2026-07-08 19:06:33.293045528 +0000 UTC m=+75.006107538" Jul 08 19:06:33.314846 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.314799 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m5lfr" podStartSLOduration=52.16780559 podStartE2EDuration="57.314781288s" totalImagesPullingTime="5.146975698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:33.313327462 +0000 UTC m=+75.026389470" watchObservedRunningTime="2026-07-08 19:06:33.314781288 +0000 UTC m=+75.027843300" Jul 08 19:06:33.324180 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.324142 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:33.332489 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.332435 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" podStartSLOduration=47.815133318 podStartE2EDuration="57.332417352s" totalImagesPullingTime="9.517284034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:33.332056014 +0000 UTC m=+75.045118036" watchObservedRunningTime="2026-07-08 19:06:33.332417352 +0000 UTC m=+75.045479363" Jul 08 19:06:33.359267 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.359198 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d7qds" podStartSLOduration=33.307563506 podStartE2EDuration="38.359175316s" totalImagesPullingTime="5.05161181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:33.358868346 +0000 UTC m=+75.071930356" watchObservedRunningTime="2026-07-08 19:06:33.359175316 +0000 UTC m=+75.072237326" Jul 08 19:06:33.397558 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.397531 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-8rx2k" Jul 08 19:06:33.398307 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.398278 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:33.598032 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.597936 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:33.664747 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.664718 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:33.772999 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.772962 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:33.915937 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:33.915862 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:34.265808 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:34.265781 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:34.366387 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:34.366356 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:34.704058 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:34.703983 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:34.805497 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:34.805453 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:34.907680 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:34.907642 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:34.974806 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:34.974768 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:35.114274 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:35.114243 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:35.311407 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:35.311321 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:35.408275 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:35.408231 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:35.510563 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:35.510517 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:35.610481 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:35.610384 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:35.875000 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:35.874913 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:39.241608 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:39.241567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:39.243830 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:39.243807 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52354b96-af19-4e4a-b38b-a922ba912690-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxj44\" (UID: \"52354b96-af19-4e4a-b38b-a922ba912690\") " pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:39.498567 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:39.498476 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:39.500331 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:39.500309 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vczqd\"" Jul 08 19:06:39.507696 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:39.507676 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cxj44" Jul 08 19:06:39.568254 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:39.568228 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:39.660663 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:39.660642 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cxj44"] Jul 08 19:06:39.662528 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:06:39.662496 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52354b96_af19_4e4a_b38b_a922ba912690.slice/crio-07bc8a64718b0a75dc2ef23e0d154ed22bffcb98d4b779b2aacf271a6ba2c70d WatchSource:0}: Error finding container 07bc8a64718b0a75dc2ef23e0d154ed22bffcb98d4b779b2aacf271a6ba2c70d: Status 404 returned error can't find the container with id 07bc8a64718b0a75dc2ef23e0d154ed22bffcb98d4b779b2aacf271a6ba2c70d Jul 08 19:06:40.288304 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:40.288183 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxj44" event={"ID":"52354b96-af19-4e4a-b38b-a922ba912690","Type":"ContainerStarted","Data":"07bc8a64718b0a75dc2ef23e0d154ed22bffcb98d4b779b2aacf271a6ba2c70d"} Jul 08 19:06:40.459571 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:40.459538 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:40.565562 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:40.565469 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:40.636566 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:40.636486 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:41.224527 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:41.224492 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:43.267076 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:43.267047 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d7qds" Jul 08 19:06:44.305655 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:44.305622 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxj44" event={"ID":"52354b96-af19-4e4a-b38b-a922ba912690","Type":"ContainerStarted","Data":"05d736f57ba647fc5019ac4f62c9cd2551648ccc9a995d933f67d8eb350cfe29"} Jul 08 19:06:45.312471 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:45.312435 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxj44" event={"ID":"52354b96-af19-4e4a-b38b-a922ba912690","Type":"ContainerStarted","Data":"a8c4e785b48ef0a0f808e0bc2d562042529acaeb766047f3a76f0ac8e1f67c78"} Jul 08 19:06:45.708888 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:45.708848 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:45.777554 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:45.777520 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:46.296934 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:46.296891 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:46.398149 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:46.398101 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:46.636424 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:46.636336 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:47.311471 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:47.311393 2554 patch_prober.go:28] interesting pod/image-registry-5476666885-nm2rb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 19:06:47.311471 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:47.311443 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5476666885-nm2rb" podUID="8e016d9b-4ab7-4d9a-956c-b24a0991e57c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 19:06:47.321958 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:47.321933 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxj44" event={"ID":"52354b96-af19-4e4a-b38b-a922ba912690","Type":"ContainerStarted","Data":"dfc5c6b41a1a87e83f219254fd9ed29cdbb392d6c771c0ba056d6379918cfbdd"} Jul 08 19:06:47.345096 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:47.345049 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cxj44" podStartSLOduration=33.06703425 podStartE2EDuration="40.345035038s" totalImagesPullingTime="7.278000788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:06:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:47.344238866 +0000 UTC m=+89.057300889" watchObservedRunningTime="2026-07-08 19:06:47.345035038 +0000 UTC m=+89.058097047" Jul 08 19:06:48.612787 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.612748 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:48.847760 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.847710 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:48.888123 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.888052 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-stgbd"] Jul 08 19:06:48.891523 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.891501 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:48.894160 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.894137 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 19:06:48.894335 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.894142 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 19:06:48.894460 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.894210 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fq6bn\"" Jul 08 19:06:48.894460 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.894220 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 19:06:48.895067 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.895049 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 19:06:48.922959 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.922933 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:48.923061 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.922964 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-tls\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:48.923061 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.922989 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-wtmp\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:48.923131 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.923110 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/122f6e4d-f1ee-4c19-a39d-f52219a636fb-root\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:48.923170 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.923150 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcl6b\" (UniqueName: \"kubernetes.io/projected/122f6e4d-f1ee-4c19-a39d-f52219a636fb-kube-api-access-bcl6b\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:48.923211 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.923182 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/122f6e4d-f1ee-4c19-a39d-f52219a636fb-metrics-client-ca\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:48.923255 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.923222 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-textfile\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:48.923287 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.923260 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/122f6e4d-f1ee-4c19-a39d-f52219a636fb-sys\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:48.923327 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.923289 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:48.948010 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:48.947986 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:49.024216 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024189 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-textfile\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.024329 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024220 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/122f6e4d-f1ee-4c19-a39d-f52219a636fb-sys\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.024329 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024242 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.024329 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024284 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.024329 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024310 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/122f6e4d-f1ee-4c19-a39d-f52219a636fb-sys\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.024625 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024312 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-tls\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.024625 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024384 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-wtmp\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.024625 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024435 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/122f6e4d-f1ee-4c19-a39d-f52219a636fb-root\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.024625 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024460 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcl6b\" (UniqueName: \"kubernetes.io/projected/122f6e4d-f1ee-4c19-a39d-f52219a636fb-kube-api-access-bcl6b\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.024625 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024479 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/122f6e4d-f1ee-4c19-a39d-f52219a636fb-metrics-client-ca\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.024625 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:49.024488 2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 19:06:49.024625 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024503 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-textfile\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.024625 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:06:49.024558 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-tls podName:122f6e4d-f1ee-4c19-a39d-f52219a636fb nodeName:}" failed. No retries permitted until 2026-07-08 19:06:49.524538161 +0000 UTC m=+91.237600154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-tls") pod "node-exporter-stgbd" (UID: "122f6e4d-f1ee-4c19-a39d-f52219a636fb") : secret "node-exporter-tls" not found Jul 08 19:06:49.024625 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024563 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-wtmp\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.024625 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024579 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/122f6e4d-f1ee-4c19-a39d-f52219a636fb-root\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.025016 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.024931 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.025052 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.025012 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/122f6e4d-f1ee-4c19-a39d-f52219a636fb-metrics-client-ca\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.026605 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.026575 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.033001 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.032984 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcl6b\" (UniqueName: \"kubernetes.io/projected/122f6e4d-f1ee-4c19-a39d-f52219a636fb-kube-api-access-bcl6b\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.048765 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.048742 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:49.150230 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.150145 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:49.249344 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.249311 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:49.330191 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.330157 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:49.438724 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.438646 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:49.528081 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.528050 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-tls\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.530273 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.530241 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/122f6e4d-f1ee-4c19-a39d-f52219a636fb-node-exporter-tls\") pod \"node-exporter-stgbd\" (UID: \"122f6e4d-f1ee-4c19-a39d-f52219a636fb\") " pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.801297 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.801265 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-stgbd" Jul 08 19:06:49.813794 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:06:49.813761 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122f6e4d_f1ee_4c19_a39d_f52219a636fb.slice/crio-96576d16032fbe8b018178f7c4807bc2d14e978e7fb749b14121bf60da060885 WatchSource:0}: Error finding container 96576d16032fbe8b018178f7c4807bc2d14e978e7fb749b14121bf60da060885: Status 404 returned error can't find the container with id 96576d16032fbe8b018178f7c4807bc2d14e978e7fb749b14121bf60da060885 Jul 08 19:06:49.869453 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.869423 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:49.975200 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:49.975160 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:50.201360 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:50.201270 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:50.239779 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:50.239758 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:06:50.320698 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:50.320666 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:50.334987 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:50.334954 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-stgbd" event={"ID":"122f6e4d-f1ee-4c19-a39d-f52219a636fb","Type":"ContainerStarted","Data":"96576d16032fbe8b018178f7c4807bc2d14e978e7fb749b14121bf60da060885"} Jul 08 19:06:50.833078 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:50.832990 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:50.932021 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:50.931983 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:51.340806 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:51.340724 2554 generic.go:356] "Generic (PLEG): container finished" podID="122f6e4d-f1ee-4c19-a39d-f52219a636fb" containerID="866e66474b3a3619580fd701da64c0f815da6714c88f02c105e951c7585fdf6d" exitCode=0 Jul 08 19:06:51.340936 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:51.340811 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-stgbd" event={"ID":"122f6e4d-f1ee-4c19-a39d-f52219a636fb","Type":"ContainerDied","Data":"866e66474b3a3619580fd701da64c0f815da6714c88f02c105e951c7585fdf6d"} Jul 08 19:06:51.931842 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:51.931790 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:52.025124 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:52.025090 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:52.156647 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:52.156616 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:52.346085 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:52.346050 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-stgbd" event={"ID":"122f6e4d-f1ee-4c19-a39d-f52219a636fb","Type":"ContainerStarted","Data":"f8169a5d9cc2cb709c3015bf9a8aff9c958d1d4d3996584e6df483767a3a2831"} Jul 08 19:06:52.346272 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:52.346097 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-stgbd" event={"ID":"122f6e4d-f1ee-4c19-a39d-f52219a636fb","Type":"ContainerStarted","Data":"e5c571838b41797800961112ddd8c8eae035e10e3fd257d9927768d2d42baa03"} Jul 08 19:06:52.420898 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:52.420844 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-stgbd" podStartSLOduration=3.151328297 podStartE2EDuration="4.420827168s" totalImagesPullingTime="1.20723676s" totalInitContainerRuntime="62.262111ms" isStatefulPod=true podCreationTimestamp="2026-07-08 19:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:52.420003765 +0000 UTC m=+94.133065773" watchObservedRunningTime="2026-07-08 19:06:52.420827168 +0000 UTC m=+94.133889198" Jul 08 19:06:52.449244 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:52.449206 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:52.596836 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:52.596745 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:52.661483 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:52.661443 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:53.340747 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:53.340718 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5476666885-nm2rb"] Jul 08 19:06:53.458791 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:53.458756 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:53.512765 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:53.512732 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:53.642184 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:53.642086 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:53.723124 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:53.723086 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:53.783376 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:53.783324 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:53.843625 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:53.843570 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:53.942683 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:53.942575 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:54.042089 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:54.042056 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:55.241876 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:55.241844 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:56.205063 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:56.205025 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:56.209604 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:56.209568 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-clvfv" Jul 08 19:06:56.305642 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:56.305613 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:58.924824 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:58.924788 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:59.158467 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:59.158421 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:06:59.259539 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:06:59.259504 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:00.975848 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:00.975816 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:01.067936 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:01.067898 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:01.471391 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:01.471338 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:01.573173 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:01.573136 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:05.292703 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:05.292668 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:05.393340 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:05.393299 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:10.235173 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:10.235127 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:10.337305 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:10.337269 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:10.431757 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:10.431722 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:11.420412 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:11.420329 2554 generic.go:356] "Generic (PLEG): container finished" podID="c4c20110-58e2-40d1-8740-de379ef5108a" containerID="b087072e1c68b9c690ad7b42d89b6371140be2358fbdce95e48aacd17926e829" exitCode=0 Jul 08 19:07:11.420412 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:11.420397 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" event={"ID":"c4c20110-58e2-40d1-8740-de379ef5108a","Type":"ContainerDied","Data":"b087072e1c68b9c690ad7b42d89b6371140be2358fbdce95e48aacd17926e829"} Jul 08 19:07:11.420873 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:11.420749 2554 scope.go:117] "RemoveContainer" containerID="b087072e1c68b9c690ad7b42d89b6371140be2358fbdce95e48aacd17926e829" Jul 08 19:07:12.426422 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:12.426379 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ctxkn" event={"ID":"c4c20110-58e2-40d1-8740-de379ef5108a","Type":"ContainerStarted","Data":"5d664e962a7556e9abd7fc743d24a5fa70ab6b2abcb8eabab01079238b21c3ba"} Jul 08 19:07:15.915128 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:15.915097 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:16.018408 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:16.018367 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:18.364230 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:18.364166 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5476666885-nm2rb" podUID="8e016d9b-4ab7-4d9a-956c-b24a0991e57c" containerName="registry" containerID="cri-o://6106bc7bc1a1bf31352148c05ccf2d3f71a32be23f3f9d5118e9f994f37bb23e" gracePeriod=30 Jul 08 19:07:19.105272 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.105246 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:07:19.272867 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.272777 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls\") pod \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " Jul 08 19:07:19.272867 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.272817 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-installation-pull-secrets\") pod \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " Jul 08 19:07:19.272867 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.272849 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-trusted-ca\") pod \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " Jul 08 19:07:19.272867 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.272871 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-ca-trust-extracted\") pod \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " Jul 08 19:07:19.273187 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.272909 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-bound-sa-token\") pod \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " Jul 08 19:07:19.273187 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.272930 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdt4b\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-kube-api-access-wdt4b\") pod \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " Jul 08 19:07:19.273187 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.272969 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-certificates\") pod \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " Jul 08 19:07:19.273187 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.273023 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-image-registry-private-configuration\") pod \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\" (UID: \"8e016d9b-4ab7-4d9a-956c-b24a0991e57c\") " Jul 08 19:07:19.273438 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.273391 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8e016d9b-4ab7-4d9a-956c-b24a0991e57c" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:07:19.273785 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.273728 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8e016d9b-4ab7-4d9a-956c-b24a0991e57c" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:07:19.275640 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.275579 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8e016d9b-4ab7-4d9a-956c-b24a0991e57c" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:07:19.275754 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.275657 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8e016d9b-4ab7-4d9a-956c-b24a0991e57c" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:07:19.275754 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.275728 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8e016d9b-4ab7-4d9a-956c-b24a0991e57c" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:07:19.275842 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.275781 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-kube-api-access-wdt4b" (OuterVolumeSpecName: "kube-api-access-wdt4b") pod "8e016d9b-4ab7-4d9a-956c-b24a0991e57c" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c"). InnerVolumeSpecName "kube-api-access-wdt4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:07:19.275924 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.275908 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8e016d9b-4ab7-4d9a-956c-b24a0991e57c" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:07:19.281797 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.281768 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8e016d9b-4ab7-4d9a-956c-b24a0991e57c" (UID: "8e016d9b-4ab7-4d9a-956c-b24a0991e57c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:07:19.373844 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.373811 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-image-registry-private-configuration\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:07:19.373844 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.373841 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-tls\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:07:19.373844 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.373851 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-installation-pull-secrets\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:07:19.374256 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.373860 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-trusted-ca\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:07:19.374256 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.373868 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-ca-trust-extracted\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:07:19.374256 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.373876 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-bound-sa-token\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:07:19.374256 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.373901 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdt4b\" (UniqueName: \"kubernetes.io/projected/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-kube-api-access-wdt4b\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:07:19.374256 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.373911 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8e016d9b-4ab7-4d9a-956c-b24a0991e57c-registry-certificates\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:07:19.453354 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.453321 2554 generic.go:356] "Generic (PLEG): container finished" podID="8e016d9b-4ab7-4d9a-956c-b24a0991e57c" containerID="6106bc7bc1a1bf31352148c05ccf2d3f71a32be23f3f9d5118e9f994f37bb23e" exitCode=0 Jul 08 19:07:19.453531 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.453370 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5476666885-nm2rb" Jul 08 19:07:19.453531 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.453384 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5476666885-nm2rb" event={"ID":"8e016d9b-4ab7-4d9a-956c-b24a0991e57c","Type":"ContainerDied","Data":"6106bc7bc1a1bf31352148c05ccf2d3f71a32be23f3f9d5118e9f994f37bb23e"} Jul 08 19:07:19.453531 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.453424 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5476666885-nm2rb" event={"ID":"8e016d9b-4ab7-4d9a-956c-b24a0991e57c","Type":"ContainerDied","Data":"72e8eaf15acaf84c7cf1833bfabe7055b7a0a6dbccd95e8ea770ea94fe555c7b"} Jul 08 19:07:19.453531 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.453443 2554 scope.go:117] "RemoveContainer" containerID="6106bc7bc1a1bf31352148c05ccf2d3f71a32be23f3f9d5118e9f994f37bb23e" Jul 08 19:07:19.464382 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.463728 2554 scope.go:117] "RemoveContainer" containerID="6106bc7bc1a1bf31352148c05ccf2d3f71a32be23f3f9d5118e9f994f37bb23e" Jul 08 19:07:19.464382 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:07:19.464096 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6106bc7bc1a1bf31352148c05ccf2d3f71a32be23f3f9d5118e9f994f37bb23e\": container with ID starting with 6106bc7bc1a1bf31352148c05ccf2d3f71a32be23f3f9d5118e9f994f37bb23e not found: ID does not exist" containerID="6106bc7bc1a1bf31352148c05ccf2d3f71a32be23f3f9d5118e9f994f37bb23e" Jul 08 19:07:19.464382 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.464138 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6106bc7bc1a1bf31352148c05ccf2d3f71a32be23f3f9d5118e9f994f37bb23e"} err="failed to get container status \"6106bc7bc1a1bf31352148c05ccf2d3f71a32be23f3f9d5118e9f994f37bb23e\": rpc error: code = NotFound desc = could not find container \"6106bc7bc1a1bf31352148c05ccf2d3f71a32be23f3f9d5118e9f994f37bb23e\": container with ID starting with 6106bc7bc1a1bf31352148c05ccf2d3f71a32be23f3f9d5118e9f994f37bb23e not found: ID does not exist" Jul 08 19:07:19.482779 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.482745 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5476666885-nm2rb"] Jul 08 19:07:19.486503 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:19.486479 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5476666885-nm2rb"] Jul 08 19:07:20.825285 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:20.825247 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e016d9b-4ab7-4d9a-956c-b24a0991e57c" path="/var/lib/kubelet/pods/8e016d9b-4ab7-4d9a-956c-b24a0991e57c/volumes" Jul 08 19:07:26.484249 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:26.484216 2554 generic.go:356] "Generic (PLEG): container finished" podID="43812205-6218-459c-9ea3-02fc8c11375f" containerID="6eff106a5a3cfb072bcc42280e41f10dd70d65c6675c1d20b573caf7f9b3df5c" exitCode=0 Jul 08 19:07:26.484631 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:26.484263 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" event={"ID":"43812205-6218-459c-9ea3-02fc8c11375f","Type":"ContainerDied","Data":"6eff106a5a3cfb072bcc42280e41f10dd70d65c6675c1d20b573caf7f9b3df5c"} Jul 08 19:07:26.484631 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:26.484553 2554 scope.go:117] "RemoveContainer" containerID="6eff106a5a3cfb072bcc42280e41f10dd70d65c6675c1d20b573caf7f9b3df5c" Jul 08 19:07:27.492144 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:27.492061 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-dt7sg" event={"ID":"43812205-6218-459c-9ea3-02fc8c11375f","Type":"ContainerStarted","Data":"fc46a74e0afcfae95028e93ab22ea62e416ac658948e82b06368f1048f93a2a9"} Jul 08 19:07:30.918892 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:30.918858 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:30.995419 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:30.995374 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:32.511029 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:32.510996 2554 generic.go:356] "Generic (PLEG): container finished" podID="ca1f8503-54a2-49ad-b93b-06df16afe5ec" containerID="1dc85c00f548518e05e6cab0d87eed69122fe429e6bd657a8d2f6324ec923b5a" exitCode=0 Jul 08 19:07:32.511382 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:32.511066 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" event={"ID":"ca1f8503-54a2-49ad-b93b-06df16afe5ec","Type":"ContainerDied","Data":"1dc85c00f548518e05e6cab0d87eed69122fe429e6bd657a8d2f6324ec923b5a"} Jul 08 19:07:32.511382 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:32.511338 2554 scope.go:117] "RemoveContainer" containerID="1dc85c00f548518e05e6cab0d87eed69122fe429e6bd657a8d2f6324ec923b5a" Jul 08 19:07:33.373473 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:33.373436 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:07:33.516633 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:33.516579 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5kv9x" event={"ID":"ca1f8503-54a2-49ad-b93b-06df16afe5ec","Type":"ContainerStarted","Data":"56ca6e83cd2eca44ba56de538efbcc35ff50dcdb4b91609da92b474a78a94360"} Jul 08 19:07:41.353176 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:41.353138 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" podUID="93abe0c3-1967-4154-8ec8-d70f9f8b261a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 19:07:51.353187 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:07:51.353150 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" podUID="93abe0c3-1967-4154-8ec8-d70f9f8b261a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 19:08:01.353614 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:01.353559 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" podUID="93abe0c3-1967-4154-8ec8-d70f9f8b261a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 19:08:01.353976 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:01.353651 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" Jul 08 19:08:01.354207 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:01.354189 2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0273e940a9318ce0cb3d9687904e48e6a1a8bfb1caca4571e83722114402afd5"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 08 19:08:01.354243 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:01.354230 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" podUID="93abe0c3-1967-4154-8ec8-d70f9f8b261a" containerName="service-proxy" containerID="cri-o://0273e940a9318ce0cb3d9687904e48e6a1a8bfb1caca4571e83722114402afd5" gracePeriod=30 Jul 08 19:08:01.624139 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:01.624053 2554 generic.go:356] "Generic (PLEG): container finished" podID="93abe0c3-1967-4154-8ec8-d70f9f8b261a" containerID="0273e940a9318ce0cb3d9687904e48e6a1a8bfb1caca4571e83722114402afd5" exitCode=2 Jul 08 19:08:01.624139 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:01.624118 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" event={"ID":"93abe0c3-1967-4154-8ec8-d70f9f8b261a","Type":"ContainerDied","Data":"0273e940a9318ce0cb3d9687904e48e6a1a8bfb1caca4571e83722114402afd5"} Jul 08 19:08:01.624308 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:01.624164 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68f758959b-zdptz" event={"ID":"93abe0c3-1967-4154-8ec8-d70f9f8b261a","Type":"ContainerStarted","Data":"f7c66ce0684e12640cb67f9e200c0dc32456caa38ea03933e480011cc7168792"} Jul 08 19:08:08.218961 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:08.218911 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:08.517165 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:08.517074 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:17.936417 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:17.936330 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:18.037757 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:18.037716 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:21.758065 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:21.758031 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:29.385058 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:29.385021 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:29.485445 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:29.485409 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:29.547985 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:29.547953 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:57.859897 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:57.859860 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:08:57.918536 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:08:57.918498 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:23.524165 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:09:23.524120 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:23.621757 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:09:23.621705 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:33.909126 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:09:33.909084 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:33.998291 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:09:33.998243 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:35.521021 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:09:35.520984 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:35.622491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:09:35.622458 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:44.648882 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:09:44.648775 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:44.711648 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:09:44.711611 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:44.773917 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:09:44.773883 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:45.919486 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:09:45.919454 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:46.032980 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:09:46.032941 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:09:46.109513 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:09:46.109481 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:18.633515 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:10:18.633487 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:10:18.640099 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:10:18.640076 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:10:18.644226 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:10:18.644203 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 19:10:31.075112 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:10:31.075076 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:32.908646 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:10:32.908568 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:57.771809 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:10:57.771770 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:10:59.148996 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:10:59.148964 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:01.380020 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:01.379977 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:01.445577 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:01.445543 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:02.831960 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:02.831926 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:02.935534 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:02.935498 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:03.319900 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:03.319865 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:03.419686 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:03.419655 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:04.163455 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:04.163426 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:05.187261 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:05.187228 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:05.397858 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:05.397829 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:08.786321 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:08.786276 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:08.846167 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:08.846140 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:12.790335 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:12.790250 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:15.792776 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:15.792739 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:15.887844 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:15.887814 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:22.654455 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:22.654417 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:22.761648 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:22.761613 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:24.899628 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:24.899575 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:34.768561 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:34.768524 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:34.873908 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:34.873875 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:36.577917 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:36.577880 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:36.679694 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:36.679655 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:37.211224 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.211195 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:37.466204 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.466093 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:37.569102 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.569071 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:37.632060 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.632027 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc"] Jul 08 19:11:37.632450 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.632290 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e016d9b-4ab7-4d9a-956c-b24a0991e57c" containerName="registry" Jul 08 19:11:37.632450 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.632300 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e016d9b-4ab7-4d9a-956c-b24a0991e57c" containerName="registry" Jul 08 19:11:37.632450 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.632360 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e016d9b-4ab7-4d9a-956c-b24a0991e57c" containerName="registry" Jul 08 19:11:37.635310 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.635293 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.642084 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.642058 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 19:11:37.642198 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.642147 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 19:11:37.643421 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.643400 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 19:11:37.643521 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.643400 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 19:11:37.644034 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.644018 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fl96f\"" Jul 08 19:11:37.654366 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.654337 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc"] Jul 08 19:11:37.734799 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.734708 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkl4f\" (UniqueName: \"kubernetes.io/projected/2ae4bb01-23d2-4368-98b9-5af90fa3151b-kube-api-access-dkl4f\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.734799 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.734758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2ae4bb01-23d2-4368-98b9-5af90fa3151b-manifests\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.734799 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.734777 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2ae4bb01-23d2-4368-98b9-5af90fa3151b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.735069 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.734834 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ae4bb01-23d2-4368-98b9-5af90fa3151b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.735069 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.734953 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ae4bb01-23d2-4368-98b9-5af90fa3151b-tmp\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.832343 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.832306 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:37.836300 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.836274 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ae4bb01-23d2-4368-98b9-5af90fa3151b-tmp\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.836436 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.836315 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkl4f\" (UniqueName: \"kubernetes.io/projected/2ae4bb01-23d2-4368-98b9-5af90fa3151b-kube-api-access-dkl4f\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.836436 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.836348 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2ae4bb01-23d2-4368-98b9-5af90fa3151b-manifests\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.836436 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.836364 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2ae4bb01-23d2-4368-98b9-5af90fa3151b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.836436 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.836384 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ae4bb01-23d2-4368-98b9-5af90fa3151b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.836812 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.836794 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2ae4bb01-23d2-4368-98b9-5af90fa3151b-manifests\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.838761 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.838730 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ae4bb01-23d2-4368-98b9-5af90fa3151b-tmp\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.838903 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.838887 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2ae4bb01-23d2-4368-98b9-5af90fa3151b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.838944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.838888 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ae4bb01-23d2-4368-98b9-5af90fa3151b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.855741 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.855720 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkl4f\" (UniqueName: \"kubernetes.io/projected/2ae4bb01-23d2-4368-98b9-5af90fa3151b-kube-api-access-dkl4f\") pod \"opendatahub-operator-controller-manager-6667fbd97f-s4wvc\" (UID: \"2ae4bb01-23d2-4368-98b9-5af90fa3151b\") " pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:37.932671 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.932638 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:37.945535 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:37.945514 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:38.030210 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:38.030165 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:38.081682 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:38.081639 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc"] Jul 08 19:11:38.085210 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:11:38.085183 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ae4bb01_23d2_4368_98b9_5af90fa3151b.slice/crio-033f1cfd5d3ed71bb14b1030c1fccf47ffe0ea61d1c2b912122ba6eaa75969c9 WatchSource:0}: Error finding container 033f1cfd5d3ed71bb14b1030c1fccf47ffe0ea61d1c2b912122ba6eaa75969c9: Status 404 returned error can't find the container with id 033f1cfd5d3ed71bb14b1030c1fccf47ffe0ea61d1c2b912122ba6eaa75969c9 Jul 08 19:11:38.086901 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:38.086884 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:11:38.159787 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:38.159749 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:38.259171 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:38.259087 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:38.341863 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:38.341829 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:38.393207 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:38.393176 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" event={"ID":"2ae4bb01-23d2-4368-98b9-5af90fa3151b","Type":"ContainerStarted","Data":"033f1cfd5d3ed71bb14b1030c1fccf47ffe0ea61d1c2b912122ba6eaa75969c9"} Jul 08 19:11:41.274477 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:41.274389 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:41.366958 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:41.366918 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:41.407403 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:41.407368 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" event={"ID":"2ae4bb01-23d2-4368-98b9-5af90fa3151b","Type":"ContainerStarted","Data":"92b428471bd001ddd6fcc3266ce5e7d2d6a3ec1a1935b7096f7c81dee5f661fe"} Jul 08 19:11:42.412613 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:42.412502 2554 generic.go:356] "Generic (PLEG): container finished" podID="2ae4bb01-23d2-4368-98b9-5af90fa3151b" containerID="92b428471bd001ddd6fcc3266ce5e7d2d6a3ec1a1935b7096f7c81dee5f661fe" exitCode=0 Jul 08 19:11:42.412613 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:42.412586 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" event={"ID":"2ae4bb01-23d2-4368-98b9-5af90fa3151b","Type":"ContainerDied","Data":"92b428471bd001ddd6fcc3266ce5e7d2d6a3ec1a1935b7096f7c81dee5f661fe"} Jul 08 19:11:43.419166 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:43.419131 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" event={"ID":"2ae4bb01-23d2-4368-98b9-5af90fa3151b","Type":"ContainerStarted","Data":"b25a8a9845a5a92f70a44d7fee99cfc3215fbafd55b4d662ef306570ce48fab8"} Jul 08 19:11:43.419578 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:43.419246 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:43.465981 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:43.465928 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" podStartSLOduration=2.080864235 podStartE2EDuration="6.465911647s" totalImagesPullingTime="3.308259304s" totalInitContainerRuntime="1.076788108s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:11:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:11:43.465214409 +0000 UTC m=+385.178276418" watchObservedRunningTime="2026-07-08 19:11:43.465911647 +0000 UTC m=+385.178973657" Jul 08 19:11:54.425578 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:54.425544 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6667fbd97f-s4wvc" Jul 08 19:11:57.878272 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:57.878209 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:58.047956 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:58.047923 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:59.000313 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:59.000277 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:59.219284 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:59.219247 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:59.456709 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:59.456625 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:59.563739 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:59.563700 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:59.785656 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:59.785624 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:11:59.929640 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:11:59.929605 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:01.010388 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:01.010342 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:01.177168 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:01.177125 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:02.607301 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:02.607264 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:02.764816 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:02.764776 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:05.918011 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:05.917974 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:07.324033 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:07.324001 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:07.441077 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:07.441044 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:08.397969 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.397934 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:08.423404 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.423374 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz"] Jul 08 19:12:08.437206 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.437173 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.440226 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.440206 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 19:12:08.440334 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.440313 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 19:12:08.441265 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.441246 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q52kd\"" Jul 08 19:12:08.442731 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.442715 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 19:12:08.443039 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.443021 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:12:08.446958 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.446941 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 19:12:08.452364 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.452345 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz"] Jul 08 19:12:08.592023 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.591992 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qzzp\" (UniqueName: \"kubernetes.io/projected/887eda84-4d64-4caf-a291-7f783f54d23a-kube-api-access-4qzzp\") pod \"lws-controller-manager-6f5b6f7879-q9kcz\" (UID: \"887eda84-4d64-4caf-a291-7f783f54d23a\") " pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.592023 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.592035 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/887eda84-4d64-4caf-a291-7f783f54d23a-manager-config\") pod \"lws-controller-manager-6f5b6f7879-q9kcz\" (UID: \"887eda84-4d64-4caf-a291-7f783f54d23a\") " pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.592231 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.592115 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/887eda84-4d64-4caf-a291-7f783f54d23a-metrics-cert\") pod \"lws-controller-manager-6f5b6f7879-q9kcz\" (UID: \"887eda84-4d64-4caf-a291-7f783f54d23a\") " pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.592231 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.592176 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887eda84-4d64-4caf-a291-7f783f54d23a-cert\") pod \"lws-controller-manager-6f5b6f7879-q9kcz\" (UID: \"887eda84-4d64-4caf-a291-7f783f54d23a\") " pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.693473 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.693387 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/887eda84-4d64-4caf-a291-7f783f54d23a-metrics-cert\") pod \"lws-controller-manager-6f5b6f7879-q9kcz\" (UID: \"887eda84-4d64-4caf-a291-7f783f54d23a\") " pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.693473 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.693440 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887eda84-4d64-4caf-a291-7f783f54d23a-cert\") pod \"lws-controller-manager-6f5b6f7879-q9kcz\" (UID: \"887eda84-4d64-4caf-a291-7f783f54d23a\") " pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.693473 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.693461 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qzzp\" (UniqueName: \"kubernetes.io/projected/887eda84-4d64-4caf-a291-7f783f54d23a-kube-api-access-4qzzp\") pod \"lws-controller-manager-6f5b6f7879-q9kcz\" (UID: \"887eda84-4d64-4caf-a291-7f783f54d23a\") " pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.693737 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.693485 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/887eda84-4d64-4caf-a291-7f783f54d23a-manager-config\") pod \"lws-controller-manager-6f5b6f7879-q9kcz\" (UID: \"887eda84-4d64-4caf-a291-7f783f54d23a\") " pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.694265 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.694238 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/887eda84-4d64-4caf-a291-7f783f54d23a-manager-config\") pod \"lws-controller-manager-6f5b6f7879-q9kcz\" (UID: \"887eda84-4d64-4caf-a291-7f783f54d23a\") " pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.696035 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.696008 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887eda84-4d64-4caf-a291-7f783f54d23a-cert\") pod \"lws-controller-manager-6f5b6f7879-q9kcz\" (UID: \"887eda84-4d64-4caf-a291-7f783f54d23a\") " pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.696138 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.696113 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/887eda84-4d64-4caf-a291-7f783f54d23a-metrics-cert\") pod \"lws-controller-manager-6f5b6f7879-q9kcz\" (UID: \"887eda84-4d64-4caf-a291-7f783f54d23a\") " pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.734175 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.734147 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qzzp\" (UniqueName: \"kubernetes.io/projected/887eda84-4d64-4caf-a291-7f783f54d23a-kube-api-access-4qzzp\") pod \"lws-controller-manager-6f5b6f7879-q9kcz\" (UID: \"887eda84-4d64-4caf-a291-7f783f54d23a\") " pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.747170 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.747142 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:08.750535 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.750346 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:08.875845 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.875811 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:08.932577 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:08.932544 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz"] Jul 08 19:12:08.965025 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:12:08.964999 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887eda84_4d64_4caf_a291_7f783f54d23a.slice/crio-097bb7f0d6ad54df4a025034572389c4914418c675e7e5416840224ae0759c7c WatchSource:0}: Error finding container 097bb7f0d6ad54df4a025034572389c4914418c675e7e5416840224ae0759c7c: Status 404 returned error can't find the container with id 097bb7f0d6ad54df4a025034572389c4914418c675e7e5416840224ae0759c7c Jul 08 19:12:09.526488 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:09.526447 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" event={"ID":"887eda84-4d64-4caf-a291-7f783f54d23a","Type":"ContainerStarted","Data":"097bb7f0d6ad54df4a025034572389c4914418c675e7e5416840224ae0759c7c"} Jul 08 19:12:11.536486 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:11.536451 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" event={"ID":"887eda84-4d64-4caf-a291-7f783f54d23a","Type":"ContainerStarted","Data":"7962e91ffa975026209a7270118c09874c1561dee33fd4b8ad898428cf3c92e6"} Jul 08 19:12:11.536901 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:11.536525 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:11.578519 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:11.578466 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" podStartSLOduration=1.198925044 podStartE2EDuration="3.578451715s" totalImagesPullingTime="2.379526671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:12:11.577807345 +0000 UTC m=+413.290869354" watchObservedRunningTime="2026-07-08 19:12:11.578451715 +0000 UTC m=+413.291513725" Jul 08 19:12:15.285253 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.285203 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:15.489263 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.489227 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:15.546418 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.546330 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq"] Jul 08 19:12:15.549815 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.549788 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq" Jul 08 19:12:15.575534 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.575504 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-kdpxr\"" Jul 08 19:12:15.609553 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.609525 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 08 19:12:15.610324 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.610300 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq"] Jul 08 19:12:15.650984 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.650947 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3396f1eb-103f-4818-8303-785e5f8cd947-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r48hq\" (UID: \"3396f1eb-103f-4818-8303-785e5f8cd947\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq" Jul 08 19:12:15.651140 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.650985 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdpjp\" (UniqueName: \"kubernetes.io/projected/3396f1eb-103f-4818-8303-785e5f8cd947-kube-api-access-gdpjp\") pod \"llmisvc-controller-manager-777c6bd7d5-r48hq\" (UID: \"3396f1eb-103f-4818-8303-785e5f8cd947\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq" Jul 08 19:12:15.733864 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.733832 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:15.752093 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.752065 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3396f1eb-103f-4818-8303-785e5f8cd947-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r48hq\" (UID: \"3396f1eb-103f-4818-8303-785e5f8cd947\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq" Jul 08 19:12:15.752237 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.752100 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdpjp\" (UniqueName: \"kubernetes.io/projected/3396f1eb-103f-4818-8303-785e5f8cd947-kube-api-access-gdpjp\") pod \"llmisvc-controller-manager-777c6bd7d5-r48hq\" (UID: \"3396f1eb-103f-4818-8303-785e5f8cd947\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq" Jul 08 19:12:15.754467 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.754439 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3396f1eb-103f-4818-8303-785e5f8cd947-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r48hq\" (UID: \"3396f1eb-103f-4818-8303-785e5f8cd947\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq" Jul 08 19:12:15.834131 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.834056 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdpjp\" (UniqueName: \"kubernetes.io/projected/3396f1eb-103f-4818-8303-785e5f8cd947-kube-api-access-gdpjp\") pod \"llmisvc-controller-manager-777c6bd7d5-r48hq\" (UID: \"3396f1eb-103f-4818-8303-785e5f8cd947\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq" Jul 08 19:12:15.860047 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.860025 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq" Jul 08 19:12:15.951491 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:15.951443 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:16.128612 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:16.128495 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq"] Jul 08 19:12:16.140464 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:12:16.140435 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3396f1eb_103f_4818_8303_785e5f8cd947.slice/crio-a764b9617a1e8a2d969849c3ea19a1c5a6fb9563a95ee7236d9789f680d3762e WatchSource:0}: Error finding container a764b9617a1e8a2d969849c3ea19a1c5a6fb9563a95ee7236d9789f680d3762e: Status 404 returned error can't find the container with id a764b9617a1e8a2d969849c3ea19a1c5a6fb9563a95ee7236d9789f680d3762e Jul 08 19:12:16.556725 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:16.556694 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq" event={"ID":"3396f1eb-103f-4818-8303-785e5f8cd947","Type":"ContainerStarted","Data":"a764b9617a1e8a2d969849c3ea19a1c5a6fb9563a95ee7236d9789f680d3762e"} Jul 08 19:12:17.489548 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:17.489507 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:17.623929 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:17.623890 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:17.786892 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:17.786782 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:20.573906 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:20.573873 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq" event={"ID":"3396f1eb-103f-4818-8303-785e5f8cd947","Type":"ContainerStarted","Data":"d01bbfa48ed6eb84e31911be4de1a5d4cfa403b332db239212f4ad3a3e99b266"} Jul 08 19:12:20.574284 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:20.573997 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq" Jul 08 19:12:20.603511 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:20.603460 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq" podStartSLOduration=1.684120281 podStartE2EDuration="5.603447869s" totalImagesPullingTime="3.919327588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:12:20.602643693 +0000 UTC m=+422.315705702" watchObservedRunningTime="2026-07-08 19:12:20.603447869 +0000 UTC m=+422.316509875" Jul 08 19:12:22.542103 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:22.542070 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f5b6f7879-q9kcz" Jul 08 19:12:51.580409 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:51.580333 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r48hq" Jul 08 19:12:59.475160 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.475122 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:59.574096 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.574065 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:59.650886 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.650854 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j4s8d"] Jul 08 19:12:59.659551 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.659525 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j4s8d" Jul 08 19:12:59.666532 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.666507 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 19:12:59.666683 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.666549 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 19:12:59.667515 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.667474 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xzndg\"" Jul 08 19:12:59.669550 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.669528 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j4s8d"] Jul 08 19:12:59.719358 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.719319 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:12:59.804169 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.804093 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97vqr\" (UniqueName: \"kubernetes.io/projected/4e7d8096-8e1d-4d34-8f62-b2caec16e409-kube-api-access-97vqr\") pod \"kuadrant-operator-catalog-j4s8d\" (UID: \"4e7d8096-8e1d-4d34-8f62-b2caec16e409\") " pod="kuadrant-system/kuadrant-operator-catalog-j4s8d" Jul 08 19:12:59.904956 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.904921 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97vqr\" (UniqueName: \"kubernetes.io/projected/4e7d8096-8e1d-4d34-8f62-b2caec16e409-kube-api-access-97vqr\") pod \"kuadrant-operator-catalog-j4s8d\" (UID: \"4e7d8096-8e1d-4d34-8f62-b2caec16e409\") " pod="kuadrant-system/kuadrant-operator-catalog-j4s8d" Jul 08 19:12:59.948340 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.948312 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97vqr\" (UniqueName: \"kubernetes.io/projected/4e7d8096-8e1d-4d34-8f62-b2caec16e409-kube-api-access-97vqr\") pod \"kuadrant-operator-catalog-j4s8d\" (UID: \"4e7d8096-8e1d-4d34-8f62-b2caec16e409\") " pod="kuadrant-system/kuadrant-operator-catalog-j4s8d" Jul 08 19:12:59.970713 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.970684 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j4s8d" Jul 08 19:12:59.986196 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:12:59.986168 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j4s8d"] Jul 08 19:13:00.125352 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:00.125273 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j4s8d"] Jul 08 19:13:00.128106 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:13:00.128075 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e7d8096_8e1d_4d34_8f62_b2caec16e409.slice/crio-740763f2a146505710ba081a58f9baa8d6faea5adb311f95bfd485f3f6ce9224 WatchSource:0}: Error finding container 740763f2a146505710ba081a58f9baa8d6faea5adb311f95bfd485f3f6ce9224: Status 404 returned error can't find the container with id 740763f2a146505710ba081a58f9baa8d6faea5adb311f95bfd485f3f6ce9224 Jul 08 19:13:00.741509 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:00.741469 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j4s8d" event={"ID":"4e7d8096-8e1d-4d34-8f62-b2caec16e409","Type":"ContainerStarted","Data":"740763f2a146505710ba081a58f9baa8d6faea5adb311f95bfd485f3f6ce9224"} Jul 08 19:13:02.751337 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:02.751301 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j4s8d" event={"ID":"4e7d8096-8e1d-4d34-8f62-b2caec16e409","Type":"ContainerStarted","Data":"ec496a3907fe14a0c8865bd140bcf7ac4d9e2d09a2272462bc94c019cfde9a94"} Jul 08 19:13:02.751736 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:02.751341 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-j4s8d" podUID="4e7d8096-8e1d-4d34-8f62-b2caec16e409" containerName="registry-server" containerID="cri-o://ec496a3907fe14a0c8865bd140bcf7ac4d9e2d09a2272462bc94c019cfde9a94" gracePeriod=2 Jul 08 19:13:02.771133 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:02.771089 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-j4s8d" podStartSLOduration=1.6846620369999998 podStartE2EDuration="3.771073326s" totalImagesPullingTime="2.086411289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:13:02.76916668 +0000 UTC m=+464.482228700" watchObservedRunningTime="2026-07-08 19:13:02.771073326 +0000 UTC m=+464.484135334" Jul 08 19:13:02.999469 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:02.999444 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j4s8d" Jul 08 19:13:03.127851 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:03.127761 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97vqr\" (UniqueName: \"kubernetes.io/projected/4e7d8096-8e1d-4d34-8f62-b2caec16e409-kube-api-access-97vqr\") pod \"4e7d8096-8e1d-4d34-8f62-b2caec16e409\" (UID: \"4e7d8096-8e1d-4d34-8f62-b2caec16e409\") " Jul 08 19:13:03.129958 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:03.129928 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e7d8096-8e1d-4d34-8f62-b2caec16e409-kube-api-access-97vqr" (OuterVolumeSpecName: "kube-api-access-97vqr") pod "4e7d8096-8e1d-4d34-8f62-b2caec16e409" (UID: "4e7d8096-8e1d-4d34-8f62-b2caec16e409"). InnerVolumeSpecName "kube-api-access-97vqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:13:03.228313 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:03.228266 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97vqr\" (UniqueName: \"kubernetes.io/projected/4e7d8096-8e1d-4d34-8f62-b2caec16e409-kube-api-access-97vqr\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:13:03.756841 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:03.756807 2554 generic.go:356] "Generic (PLEG): container finished" podID="4e7d8096-8e1d-4d34-8f62-b2caec16e409" containerID="ec496a3907fe14a0c8865bd140bcf7ac4d9e2d09a2272462bc94c019cfde9a94" exitCode=0 Jul 08 19:13:03.757328 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:03.756854 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j4s8d" Jul 08 19:13:03.757328 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:03.756897 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j4s8d" event={"ID":"4e7d8096-8e1d-4d34-8f62-b2caec16e409","Type":"ContainerDied","Data":"ec496a3907fe14a0c8865bd140bcf7ac4d9e2d09a2272462bc94c019cfde9a94"} Jul 08 19:13:03.757328 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:03.756949 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j4s8d" event={"ID":"4e7d8096-8e1d-4d34-8f62-b2caec16e409","Type":"ContainerDied","Data":"740763f2a146505710ba081a58f9baa8d6faea5adb311f95bfd485f3f6ce9224"} Jul 08 19:13:03.757328 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:03.756972 2554 scope.go:117] "RemoveContainer" containerID="ec496a3907fe14a0c8865bd140bcf7ac4d9e2d09a2272462bc94c019cfde9a94" Jul 08 19:13:03.765561 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:03.765542 2554 scope.go:117] "RemoveContainer" containerID="ec496a3907fe14a0c8865bd140bcf7ac4d9e2d09a2272462bc94c019cfde9a94" Jul 08 19:13:03.765863 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:13:03.765844 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec496a3907fe14a0c8865bd140bcf7ac4d9e2d09a2272462bc94c019cfde9a94\": container with ID starting with ec496a3907fe14a0c8865bd140bcf7ac4d9e2d09a2272462bc94c019cfde9a94 not found: ID does not exist" containerID="ec496a3907fe14a0c8865bd140bcf7ac4d9e2d09a2272462bc94c019cfde9a94" Jul 08 19:13:03.765909 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:03.765874 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec496a3907fe14a0c8865bd140bcf7ac4d9e2d09a2272462bc94c019cfde9a94"} err="failed to get container status \"ec496a3907fe14a0c8865bd140bcf7ac4d9e2d09a2272462bc94c019cfde9a94\": rpc error: code = NotFound desc = could not find container \"ec496a3907fe14a0c8865bd140bcf7ac4d9e2d09a2272462bc94c019cfde9a94\": container with ID starting with ec496a3907fe14a0c8865bd140bcf7ac4d9e2d09a2272462bc94c019cfde9a94 not found: ID does not exist" Jul 08 19:13:03.779322 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:03.779282 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j4s8d"] Jul 08 19:13:03.786873 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:03.786853 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j4s8d"] Jul 08 19:13:04.825437 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:04.825403 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e7d8096-8e1d-4d34-8f62-b2caec16e409" path="/var/lib/kubelet/pods/4e7d8096-8e1d-4d34-8f62-b2caec16e409/volumes" Jul 08 19:13:18.646442 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:18.646410 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:20.070903 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:20.070871 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:20.164844 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:20.164808 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:29.104214 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:29.104172 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:31.160909 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:31.160875 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:31.258211 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:31.258174 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:31.357006 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:31.356972 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:32.519627 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:32.519567 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:35.559415 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:35.559374 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:36.165715 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:36.165677 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:36.275885 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:36.275855 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:37.062664 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:37.062608 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:37.368024 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:37.367915 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:37.914066 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:37.914040 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:38.171236 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:38.171134 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:38.288683 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:38.288639 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:40.444836 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.444795 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:40.537571 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.537536 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rvszv"] Jul 08 19:13:40.537876 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.537863 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7d8096-8e1d-4d34-8f62-b2caec16e409" containerName="registry-server" Jul 08 19:13:40.537934 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.537877 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7d8096-8e1d-4d34-8f62-b2caec16e409" containerName="registry-server" Jul 08 19:13:40.537973 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.537939 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e7d8096-8e1d-4d34-8f62-b2caec16e409" containerName="registry-server" Jul 08 19:13:40.544864 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.544848 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rvszv" Jul 08 19:13:40.556558 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.556539 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 19:13:40.557747 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.557732 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rgrpv\"" Jul 08 19:13:40.557804 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.557730 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 19:13:40.576134 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.576107 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rvszv"] Jul 08 19:13:40.597615 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.597573 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:40.600663 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.600642 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crtfp\" (UniqueName: \"kubernetes.io/projected/09f7a019-2cec-446b-89f4-66ea92058ea9-kube-api-access-crtfp\") pod \"authorino-operator-75cc8d5cb7-rvszv\" (UID: \"09f7a019-2cec-446b-89f4-66ea92058ea9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rvszv" Jul 08 19:13:40.701060 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.700972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crtfp\" (UniqueName: \"kubernetes.io/projected/09f7a019-2cec-446b-89f4-66ea92058ea9-kube-api-access-crtfp\") pod \"authorino-operator-75cc8d5cb7-rvszv\" (UID: \"09f7a019-2cec-446b-89f4-66ea92058ea9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rvszv" Jul 08 19:13:40.747347 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.747311 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crtfp\" (UniqueName: \"kubernetes.io/projected/09f7a019-2cec-446b-89f4-66ea92058ea9-kube-api-access-crtfp\") pod \"authorino-operator-75cc8d5cb7-rvszv\" (UID: \"09f7a019-2cec-446b-89f4-66ea92058ea9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rvszv" Jul 08 19:13:40.854063 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:40.854030 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rvszv" Jul 08 19:13:41.004089 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:13:41.004053 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f7a019_2cec_446b_89f4_66ea92058ea9.slice/crio-8af4ab0cdef4553028e6e67b33a7312a255af2f364a8b08b80ed58beab3c1d10 WatchSource:0}: Error finding container 8af4ab0cdef4553028e6e67b33a7312a255af2f364a8b08b80ed58beab3c1d10: Status 404 returned error can't find the container with id 8af4ab0cdef4553028e6e67b33a7312a255af2f364a8b08b80ed58beab3c1d10 Jul 08 19:13:41.004397 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:41.004373 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rvszv"] Jul 08 19:13:41.342034 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:41.341946 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:41.910778 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:41.910740 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rvszv" event={"ID":"09f7a019-2cec-446b-89f4-66ea92058ea9","Type":"ContainerStarted","Data":"8af4ab0cdef4553028e6e67b33a7312a255af2f364a8b08b80ed58beab3c1d10"} Jul 08 19:13:43.194349 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:43.194297 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:43.922082 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:43.922048 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rvszv" event={"ID":"09f7a019-2cec-446b-89f4-66ea92058ea9","Type":"ContainerStarted","Data":"436d52a309ef33ace0d100d50af1ba497bacde8c9f158353ae4f8fe9a35943af"} Jul 08 19:13:43.922243 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:43.922147 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rvszv" Jul 08 19:13:43.971191 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:43.971139 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rvszv" podStartSLOduration=1.5423572719999998 podStartE2EDuration="3.971121351s" totalImagesPullingTime="2.428764079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:13:43.969347419 +0000 UTC m=+505.682409421" watchObservedRunningTime="2026-07-08 19:13:43.971121351 +0000 UTC m=+505.684183360" Jul 08 19:13:44.716123 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:44.716088 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:44.821263 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:44.821225 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:46.306986 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:46.306947 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:46.847576 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:46.847545 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:48.293987 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:48.293950 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:48.394610 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:48.394550 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:54.929402 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:54.929374 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rvszv" Jul 08 19:13:56.727544 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.727508 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk"] Jul 08 19:13:56.730873 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.730855 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:56.734316 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.734293 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qjbt8\"" Jul 08 19:13:56.748318 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.748284 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk"] Jul 08 19:13:56.823803 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.823768 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2llx\" (UniqueName: \"kubernetes.io/projected/00705399-2380-4428-a6cd-3f1bda7c0ada-kube-api-access-f2llx\") pod \"kuadrant-operator-controller-manager-55467d9f7-97qhk\" (UID: \"00705399-2380-4428-a6cd-3f1bda7c0ada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:56.823970 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.823831 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00705399-2380-4428-a6cd-3f1bda7c0ada-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-97qhk\" (UID: \"00705399-2380-4428-a6cd-3f1bda7c0ada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:56.834288 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.834265 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk"] Jul 08 19:13:56.834470 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:13:56.834453 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-f2llx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" podUID="00705399-2380-4428-a6cd-3f1bda7c0ada" Jul 08 19:13:56.924459 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.924425 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2llx\" (UniqueName: \"kubernetes.io/projected/00705399-2380-4428-a6cd-3f1bda7c0ada-kube-api-access-f2llx\") pod \"kuadrant-operator-controller-manager-55467d9f7-97qhk\" (UID: \"00705399-2380-4428-a6cd-3f1bda7c0ada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:56.924659 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.924640 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00705399-2380-4428-a6cd-3f1bda7c0ada-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-97qhk\" (UID: \"00705399-2380-4428-a6cd-3f1bda7c0ada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:56.925066 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.925031 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00705399-2380-4428-a6cd-3f1bda7c0ada-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-97qhk\" (UID: \"00705399-2380-4428-a6cd-3f1bda7c0ada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:56.938229 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.938204 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2llx\" (UniqueName: \"kubernetes.io/projected/00705399-2380-4428-a6cd-3f1bda7c0ada-kube-api-access-f2llx\") pod \"kuadrant-operator-controller-manager-55467d9f7-97qhk\" (UID: \"00705399-2380-4428-a6cd-3f1bda7c0ada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:56.957032 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.957002 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk"] Jul 08 19:13:56.964068 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.964035 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:56.973865 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.973838 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:56.974900 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.974875 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk"] Jul 08 19:13:56.976570 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:13:56.976544 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-97qhk\" is forbidden: User \"system:node:ip-10-0-138-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-105.ec2.internal' and this object" podUID="00705399-2380-4428-a6cd-3f1bda7c0ada" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:56.981453 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:56.981394 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:56.983960 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:13:56.983933 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-97qhk\" is forbidden: User \"system:node:ip-10-0-138-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-105.ec2.internal' and this object" podUID="00705399-2380-4428-a6cd-3f1bda7c0ada" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:57.025494 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.025465 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2llx\" (UniqueName: \"kubernetes.io/projected/00705399-2380-4428-a6cd-3f1bda7c0ada-kube-api-access-f2llx\") pod \"00705399-2380-4428-a6cd-3f1bda7c0ada\" (UID: \"00705399-2380-4428-a6cd-3f1bda7c0ada\") " Jul 08 19:13:57.025675 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.025535 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00705399-2380-4428-a6cd-3f1bda7c0ada-extensions-socket-volume\") pod \"00705399-2380-4428-a6cd-3f1bda7c0ada\" (UID: \"00705399-2380-4428-a6cd-3f1bda7c0ada\") " Jul 08 19:13:57.025815 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.025793 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00705399-2380-4428-a6cd-3f1bda7c0ada-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "00705399-2380-4428-a6cd-3f1bda7c0ada" (UID: "00705399-2380-4428-a6cd-3f1bda7c0ada"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:13:57.027748 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.027724 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00705399-2380-4428-a6cd-3f1bda7c0ada-kube-api-access-f2llx" (OuterVolumeSpecName: "kube-api-access-f2llx") pod "00705399-2380-4428-a6cd-3f1bda7c0ada" (UID: "00705399-2380-4428-a6cd-3f1bda7c0ada"). InnerVolumeSpecName "kube-api-access-f2llx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:13:57.064276 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.064243 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:57.126427 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.126395 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2llx\" (UniqueName: \"kubernetes.io/projected/00705399-2380-4428-a6cd-3f1bda7c0ada-kube-api-access-f2llx\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:13:57.126427 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.126420 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00705399-2380-4428-a6cd-3f1bda7c0ada-extensions-socket-volume\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:13:57.126818 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.126797 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkt45"] Jul 08 19:13:57.132851 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.132828 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkt45" Jul 08 19:13:57.136038 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:13:57.136002 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-97qhk\" is forbidden: User \"system:node:ip-10-0-138-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-105.ec2.internal' and this object" podUID="00705399-2380-4428-a6cd-3f1bda7c0ada" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:57.142082 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.142063 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-nx8dx\"" Jul 08 19:13:57.177738 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.177700 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:57.221476 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.221445 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkt45"] Jul 08 19:13:57.227202 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.227175 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nm59\" (UniqueName: \"kubernetes.io/projected/674a7e79-175d-4be7-8fd8-9d14b659d711-kube-api-access-6nm59\") pod \"limitador-operator-controller-manager-859d7b78bd-dkt45\" (UID: \"674a7e79-175d-4be7-8fd8-9d14b659d711\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkt45" Jul 08 19:13:57.328640 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.328527 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nm59\" (UniqueName: \"kubernetes.io/projected/674a7e79-175d-4be7-8fd8-9d14b659d711-kube-api-access-6nm59\") pod \"limitador-operator-controller-manager-859d7b78bd-dkt45\" (UID: \"674a7e79-175d-4be7-8fd8-9d14b659d711\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkt45" Jul 08 19:13:57.340028 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.340002 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nm59\" (UniqueName: \"kubernetes.io/projected/674a7e79-175d-4be7-8fd8-9d14b659d711-kube-api-access-6nm59\") pod \"limitador-operator-controller-manager-859d7b78bd-dkt45\" (UID: \"674a7e79-175d-4be7-8fd8-9d14b659d711\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkt45" Jul 08 19:13:57.443853 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.443805 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkt45" Jul 08 19:13:57.575152 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.575126 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkt45"] Jul 08 19:13:57.577735 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:13:57.577710 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674a7e79_175d_4be7_8fd8_9d14b659d711.slice/crio-5e10fc5600d00063bd7a071048c4a89c03f142e6c06b84cac7b36f76a56b3c3a WatchSource:0}: Error finding container 5e10fc5600d00063bd7a071048c4a89c03f142e6c06b84cac7b36f76a56b3c3a: Status 404 returned error can't find the container with id 5e10fc5600d00063bd7a071048c4a89c03f142e6c06b84cac7b36f76a56b3c3a Jul 08 19:13:57.980347 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.980323 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:57.980818 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:57.980320 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkt45" event={"ID":"674a7e79-175d-4be7-8fd8-9d14b659d711","Type":"ContainerStarted","Data":"5e10fc5600d00063bd7a071048c4a89c03f142e6c06b84cac7b36f76a56b3c3a"} Jul 08 19:13:57.982778 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:13:57.982752 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-97qhk\" is forbidden: User \"system:node:ip-10-0-138-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-105.ec2.internal' and this object" podUID="00705399-2380-4428-a6cd-3f1bda7c0ada" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:57.989534 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:13:57.989504 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-97qhk\" is forbidden: User \"system:node:ip-10-0-138-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-105.ec2.internal' and this object" podUID="00705399-2380-4428-a6cd-3f1bda7c0ada" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:58.825059 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:13:58.825010 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-97qhk\" is forbidden: User \"system:node:ip-10-0-138-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-105.ec2.internal' and this object" podUID="00705399-2380-4428-a6cd-3f1bda7c0ada" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-97qhk" Jul 08 19:13:58.827327 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:58.827299 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00705399-2380-4428-a6cd-3f1bda7c0ada" path="/var/lib/kubelet/pods/00705399-2380-4428-a6cd-3f1bda7c0ada/volumes" Jul 08 19:13:59.952870 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:59.952832 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:13:59.990617 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:59.990559 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkt45" event={"ID":"674a7e79-175d-4be7-8fd8-9d14b659d711","Type":"ContainerStarted","Data":"45079829ddbbe2039b74b459fe874ebb1f3a012dd36dbb0ff6b14c57e7eb1bd7"} Jul 08 19:13:59.990803 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:13:59.990698 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkt45" Jul 08 19:14:00.013373 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:00.013322 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkt45" podStartSLOduration=1.6245108940000001 podStartE2EDuration="3.013306361s" totalImagesPullingTime="1.388795467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:14:00.012107513 +0000 UTC m=+521.725169523" watchObservedRunningTime="2026-07-08 19:14:00.013306361 +0000 UTC m=+521.726368428" Jul 08 19:14:00.029026 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:00.028997 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:02.502294 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:02.502258 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:02.608012 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:02.607981 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:07.106969 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:07.106931 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:07.207219 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:07.207180 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:09.016814 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:09.016778 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:09.077757 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:09.077723 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:10.041909 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:10.041872 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:11.002784 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:11.002754 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkt45" Jul 08 19:14:17.112172 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:17.112131 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:17.212291 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:17.212258 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:17.713135 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:17.713104 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:17.800729 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:17.800696 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:21.512349 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:21.512314 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:21.628756 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:21.628727 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:25.602700 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:25.602662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:26.012259 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:26.012219 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:30.382789 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:30.382755 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:30.493282 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:30.493238 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:30.594149 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:30.594115 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:31.241677 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:31.241642 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:31.303108 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:31.303074 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:31.419311 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:31.419270 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjxkz"] Jul 08 19:14:31.426766 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:31.426743 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wjxkz" Jul 08 19:14:31.429328 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:31.429303 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bkhd4\"" Jul 08 19:14:31.429865 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:31.429841 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjxkz"] Jul 08 19:14:31.508459 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:31.508384 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbszt\" (UniqueName: \"kubernetes.io/projected/aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2-kube-api-access-cbszt\") pod \"authorino-75d556bd77-wjxkz\" (UID: \"aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2\") " pod="kuadrant-system/authorino-75d556bd77-wjxkz" Jul 08 19:14:31.609853 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:31.609818 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbszt\" (UniqueName: \"kubernetes.io/projected/aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2-kube-api-access-cbszt\") pod \"authorino-75d556bd77-wjxkz\" (UID: \"aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2\") " pod="kuadrant-system/authorino-75d556bd77-wjxkz" Jul 08 19:14:31.618464 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:31.618430 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbszt\" (UniqueName: \"kubernetes.io/projected/aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2-kube-api-access-cbszt\") pod \"authorino-75d556bd77-wjxkz\" (UID: \"aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2\") " pod="kuadrant-system/authorino-75d556bd77-wjxkz" Jul 08 19:14:31.736131 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:31.736093 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wjxkz" Jul 08 19:14:31.876116 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:31.876087 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjxkz"] Jul 08 19:14:31.878331 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:14:31.878305 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa05ee33_d1a6_42c6_8e77_f8e310bc6cc2.slice/crio-869728e2dd6cb5d4b159115b9cb1708b18fe8b6a781b535a69cea2509d9f118e WatchSource:0}: Error finding container 869728e2dd6cb5d4b159115b9cb1708b18fe8b6a781b535a69cea2509d9f118e: Status 404 returned error can't find the container with id 869728e2dd6cb5d4b159115b9cb1708b18fe8b6a781b535a69cea2509d9f118e Jul 08 19:14:32.129567 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:32.129488 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wjxkz" event={"ID":"aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2","Type":"ContainerStarted","Data":"869728e2dd6cb5d4b159115b9cb1708b18fe8b6a781b535a69cea2509d9f118e"} Jul 08 19:14:33.587763 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:33.587733 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:33.653412 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:33.653377 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:36.153413 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:36.153370 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wjxkz" event={"ID":"aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2","Type":"ContainerStarted","Data":"1e5ac0d83581dce51ea3dfb8214c9387fffde1e296db094137ec4456a0dc42f2"} Jul 08 19:14:36.169621 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:36.169545 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-wjxkz" podStartSLOduration=1.380377582 podStartE2EDuration="5.169528642s" totalImagesPullingTime="3.78915106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:14:36.168940547 +0000 UTC m=+557.882002558" watchObservedRunningTime="2026-07-08 19:14:36.169528642 +0000 UTC m=+557.882590650" Jul 08 19:14:39.665930 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:39.665892 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:51.599016 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:51.598976 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:51.701925 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:51.701888 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:14:52.200056 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:14:52.200024 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:03.793469 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:03.793433 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:03.944279 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:03.944245 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:04.363364 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.363327 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-674fccc756-f4bgn"] Jul 08 19:15:04.366515 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.366497 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674fccc756-f4bgn" Jul 08 19:15:04.376219 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.376194 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-674fccc756-f4bgn"] Jul 08 19:15:04.456391 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.456354 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-674fccc756-f4bgn"] Jul 08 19:15:04.456659 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:15:04.456552 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-m2kbz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-674fccc756-f4bgn" podUID="0d06baea-31df-4726-9e7d-51aee058792e" Jul 08 19:15:04.459163 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.459140 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2kbz\" (UniqueName: \"kubernetes.io/projected/0d06baea-31df-4726-9e7d-51aee058792e-kube-api-access-m2kbz\") pod \"authorino-674fccc756-f4bgn\" (UID: \"0d06baea-31df-4726-9e7d-51aee058792e\") " pod="kuadrant-system/authorino-674fccc756-f4bgn" Jul 08 19:15:04.489509 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.489471 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74b7d4585b-7b7wc"] Jul 08 19:15:04.492800 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.492779 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b7d4585b-7b7wc" Jul 08 19:15:04.500239 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.500221 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 08 19:15:04.517727 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.517698 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74b7d4585b-7b7wc"] Jul 08 19:15:04.560085 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.560047 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cff4258f-5a02-4c76-9d77-234f56e46529-tls-cert\") pod \"authorino-74b7d4585b-7b7wc\" (UID: \"cff4258f-5a02-4c76-9d77-234f56e46529\") " pod="kuadrant-system/authorino-74b7d4585b-7b7wc" Jul 08 19:15:04.560262 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.560100 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2kbz\" (UniqueName: \"kubernetes.io/projected/0d06baea-31df-4726-9e7d-51aee058792e-kube-api-access-m2kbz\") pod \"authorino-674fccc756-f4bgn\" (UID: \"0d06baea-31df-4726-9e7d-51aee058792e\") " pod="kuadrant-system/authorino-674fccc756-f4bgn" Jul 08 19:15:04.560262 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.560144 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq6db\" (UniqueName: \"kubernetes.io/projected/cff4258f-5a02-4c76-9d77-234f56e46529-kube-api-access-zq6db\") pod \"authorino-74b7d4585b-7b7wc\" (UID: \"cff4258f-5a02-4c76-9d77-234f56e46529\") " pod="kuadrant-system/authorino-74b7d4585b-7b7wc" Jul 08 19:15:04.572173 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.572134 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2kbz\" (UniqueName: \"kubernetes.io/projected/0d06baea-31df-4726-9e7d-51aee058792e-kube-api-access-m2kbz\") pod \"authorino-674fccc756-f4bgn\" (UID: \"0d06baea-31df-4726-9e7d-51aee058792e\") " pod="kuadrant-system/authorino-674fccc756-f4bgn" Jul 08 19:15:04.661228 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.661129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq6db\" (UniqueName: \"kubernetes.io/projected/cff4258f-5a02-4c76-9d77-234f56e46529-kube-api-access-zq6db\") pod \"authorino-74b7d4585b-7b7wc\" (UID: \"cff4258f-5a02-4c76-9d77-234f56e46529\") " pod="kuadrant-system/authorino-74b7d4585b-7b7wc" Jul 08 19:15:04.661228 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.661222 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cff4258f-5a02-4c76-9d77-234f56e46529-tls-cert\") pod \"authorino-74b7d4585b-7b7wc\" (UID: \"cff4258f-5a02-4c76-9d77-234f56e46529\") " pod="kuadrant-system/authorino-74b7d4585b-7b7wc" Jul 08 19:15:04.663651 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.663627 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cff4258f-5a02-4c76-9d77-234f56e46529-tls-cert\") pod \"authorino-74b7d4585b-7b7wc\" (UID: \"cff4258f-5a02-4c76-9d77-234f56e46529\") " pod="kuadrant-system/authorino-74b7d4585b-7b7wc" Jul 08 19:15:04.680265 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.680236 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq6db\" (UniqueName: \"kubernetes.io/projected/cff4258f-5a02-4c76-9d77-234f56e46529-kube-api-access-zq6db\") pod \"authorino-74b7d4585b-7b7wc\" (UID: \"cff4258f-5a02-4c76-9d77-234f56e46529\") " pod="kuadrant-system/authorino-74b7d4585b-7b7wc" Jul 08 19:15:04.801528 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.801492 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b7d4585b-7b7wc" Jul 08 19:15:04.934917 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:04.934883 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74b7d4585b-7b7wc"] Jul 08 19:15:04.937252 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:15:04.937229 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcff4258f_5a02_4c76_9d77_234f56e46529.slice/crio-5e9de0bc04f76ec9cdaee997d77ff76528935605ddb4ed540a96f59726a64b96 WatchSource:0}: Error finding container 5e9de0bc04f76ec9cdaee997d77ff76528935605ddb4ed540a96f59726a64b96: Status 404 returned error can't find the container with id 5e9de0bc04f76ec9cdaee997d77ff76528935605ddb4ed540a96f59726a64b96 Jul 08 19:15:05.285006 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:05.284984 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674fccc756-f4bgn" Jul 08 19:15:05.285006 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:05.284994 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b7d4585b-7b7wc" event={"ID":"cff4258f-5a02-4c76-9d77-234f56e46529","Type":"ContainerStarted","Data":"5e9de0bc04f76ec9cdaee997d77ff76528935605ddb4ed540a96f59726a64b96"} Jul 08 19:15:05.291988 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:05.291967 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674fccc756-f4bgn" Jul 08 19:15:05.366825 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:05.366793 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2kbz\" (UniqueName: \"kubernetes.io/projected/0d06baea-31df-4726-9e7d-51aee058792e-kube-api-access-m2kbz\") pod \"0d06baea-31df-4726-9e7d-51aee058792e\" (UID: \"0d06baea-31df-4726-9e7d-51aee058792e\") " Jul 08 19:15:05.369057 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:05.369026 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d06baea-31df-4726-9e7d-51aee058792e-kube-api-access-m2kbz" (OuterVolumeSpecName: "kube-api-access-m2kbz") pod "0d06baea-31df-4726-9e7d-51aee058792e" (UID: "0d06baea-31df-4726-9e7d-51aee058792e"). InnerVolumeSpecName "kube-api-access-m2kbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:15:05.467612 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:05.467550 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2kbz\" (UniqueName: \"kubernetes.io/projected/0d06baea-31df-4726-9e7d-51aee058792e-kube-api-access-m2kbz\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:15:06.290928 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:06.290899 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674fccc756-f4bgn" Jul 08 19:15:06.291377 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:06.290892 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b7d4585b-7b7wc" event={"ID":"cff4258f-5a02-4c76-9d77-234f56e46529","Type":"ContainerStarted","Data":"bf01172b59491b3fc854e17636ff3a0f8edf615bf9065281102d645a55938528"} Jul 08 19:15:06.342507 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:06.342447 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74b7d4585b-7b7wc" podStartSLOduration=1.9976749219999999 podStartE2EDuration="2.342430933s" totalImagesPullingTime="344.756011ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:15:06.328642177 +0000 UTC m=+588.041704182" watchObservedRunningTime="2026-07-08 19:15:06.342430933 +0000 UTC m=+588.055492945" Jul 08 19:15:06.398439 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:06.398404 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-674fccc756-f4bgn"] Jul 08 19:15:06.399921 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:06.399895 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjxkz"] Jul 08 19:15:06.400088 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:06.400067 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-wjxkz" podUID="aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2" containerName="authorino" containerID="cri-o://1e5ac0d83581dce51ea3dfb8214c9387fffde1e296db094137ec4456a0dc42f2" gracePeriod=30 Jul 08 19:15:06.415238 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:06.415214 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-674fccc756-f4bgn"] Jul 08 19:15:06.645640 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:06.645615 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wjxkz" Jul 08 19:15:06.678921 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:06.678893 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbszt\" (UniqueName: \"kubernetes.io/projected/aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2-kube-api-access-cbszt\") pod \"aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2\" (UID: \"aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2\") " Jul 08 19:15:06.706210 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:06.706167 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2-kube-api-access-cbszt" (OuterVolumeSpecName: "kube-api-access-cbszt") pod "aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2" (UID: "aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2"). InnerVolumeSpecName "kube-api-access-cbszt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:15:06.780316 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:06.780274 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbszt\" (UniqueName: \"kubernetes.io/projected/aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2-kube-api-access-cbszt\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:15:06.826634 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:06.826538 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d06baea-31df-4726-9e7d-51aee058792e" path="/var/lib/kubelet/pods/0d06baea-31df-4726-9e7d-51aee058792e/volumes" Jul 08 19:15:07.297662 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:07.297625 2554 generic.go:356] "Generic (PLEG): container finished" podID="aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2" containerID="1e5ac0d83581dce51ea3dfb8214c9387fffde1e296db094137ec4456a0dc42f2" exitCode=0 Jul 08 19:15:07.298102 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:07.297689 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wjxkz" event={"ID":"aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2","Type":"ContainerDied","Data":"1e5ac0d83581dce51ea3dfb8214c9387fffde1e296db094137ec4456a0dc42f2"} Jul 08 19:15:07.298102 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:07.297728 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wjxkz" event={"ID":"aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2","Type":"ContainerDied","Data":"869728e2dd6cb5d4b159115b9cb1708b18fe8b6a781b535a69cea2509d9f118e"} Jul 08 19:15:07.298102 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:07.297739 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wjxkz" Jul 08 19:15:07.298102 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:07.297746 2554 scope.go:117] "RemoveContainer" containerID="1e5ac0d83581dce51ea3dfb8214c9387fffde1e296db094137ec4456a0dc42f2" Jul 08 19:15:07.308143 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:07.308113 2554 scope.go:117] "RemoveContainer" containerID="1e5ac0d83581dce51ea3dfb8214c9387fffde1e296db094137ec4456a0dc42f2" Jul 08 19:15:07.308664 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:15:07.308639 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e5ac0d83581dce51ea3dfb8214c9387fffde1e296db094137ec4456a0dc42f2\": container with ID starting with 1e5ac0d83581dce51ea3dfb8214c9387fffde1e296db094137ec4456a0dc42f2 not found: ID does not exist" containerID="1e5ac0d83581dce51ea3dfb8214c9387fffde1e296db094137ec4456a0dc42f2" Jul 08 19:15:07.308780 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:07.308680 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e5ac0d83581dce51ea3dfb8214c9387fffde1e296db094137ec4456a0dc42f2"} err="failed to get container status \"1e5ac0d83581dce51ea3dfb8214c9387fffde1e296db094137ec4456a0dc42f2\": rpc error: code = NotFound desc = could not find container \"1e5ac0d83581dce51ea3dfb8214c9387fffde1e296db094137ec4456a0dc42f2\": container with ID starting with 1e5ac0d83581dce51ea3dfb8214c9387fffde1e296db094137ec4456a0dc42f2 not found: ID does not exist" Jul 08 19:15:07.314272 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:07.314247 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjxkz"] Jul 08 19:15:07.318689 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:07.318664 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjxkz"] Jul 08 19:15:08.826097 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:08.826065 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2" path="/var/lib/kubelet/pods/aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2/volumes" Jul 08 19:15:11.016223 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:11.016186 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:11.269918 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:11.269820 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:11.333091 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:11.333054 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:14.143105 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:14.143069 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:14.244560 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:14.244527 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:18.665555 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:18.665525 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:15:18.670216 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:18.670191 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:15:21.394164 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:21.394123 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:37.737768 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:37.737732 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:39.695336 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:39.695308 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:43.495867 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:43.495789 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:44.016031 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:44.015986 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:44.824325 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:44.824288 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:44.919802 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:44.919766 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:45.002139 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:45.002100 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:56.736852 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:56.736814 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:15:56.841813 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:15:56.841782 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:07.310053 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:07.310018 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:26.737281 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:26.737243 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:33.712617 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.712558 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv"] Jul 08 19:16:33.713108 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.712961 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2" containerName="authorino" Jul 08 19:16:33.713108 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.712974 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2" containerName="authorino" Jul 08 19:16:33.713108 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.713034 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa05ee33-d1a6-42c6-8e77-f8e310bc6cc2" containerName="authorino" Jul 08 19:16:33.715988 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.715972 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.719114 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.719094 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 19:16:33.719244 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.719224 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 19:16:33.719339 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.719325 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 08 19:16:33.720289 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.720270 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mc8ln\"" Jul 08 19:16:33.727709 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.727690 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv"] Jul 08 19:16:33.745111 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.745076 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:33.805270 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.805239 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2215037d-3344-4d96-b656-772c0dde24da-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.805270 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.805272 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2215037d-3344-4d96-b656-772c0dde24da-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.805507 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.805303 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2215037d-3344-4d96-b656-772c0dde24da-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.805507 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.805396 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2215037d-3344-4d96-b656-772c0dde24da-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.805507 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.805421 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzlqr\" (UniqueName: \"kubernetes.io/projected/2215037d-3344-4d96-b656-772c0dde24da-kube-api-access-hzlqr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.805507 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.805466 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2215037d-3344-4d96-b656-772c0dde24da-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.906333 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.906297 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2215037d-3344-4d96-b656-772c0dde24da-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.906333 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.906333 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzlqr\" (UniqueName: \"kubernetes.io/projected/2215037d-3344-4d96-b656-772c0dde24da-kube-api-access-hzlqr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.906576 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.906375 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2215037d-3344-4d96-b656-772c0dde24da-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.906576 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.906413 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2215037d-3344-4d96-b656-772c0dde24da-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.906576 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.906433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2215037d-3344-4d96-b656-772c0dde24da-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.906576 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.906486 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2215037d-3344-4d96-b656-772c0dde24da-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.906820 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.906782 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2215037d-3344-4d96-b656-772c0dde24da-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.906820 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.906804 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2215037d-3344-4d96-b656-772c0dde24da-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.906931 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.906916 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2215037d-3344-4d96-b656-772c0dde24da-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.908775 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.908747 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2215037d-3344-4d96-b656-772c0dde24da-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.908904 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.908841 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2215037d-3344-4d96-b656-772c0dde24da-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:33.914653 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:33.914631 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzlqr\" (UniqueName: \"kubernetes.io/projected/2215037d-3344-4d96-b656-772c0dde24da-kube-api-access-hzlqr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7bznv\" (UID: \"2215037d-3344-4d96-b656-772c0dde24da\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:34.026116 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:34.026028 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:34.158223 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:34.158178 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv"] Jul 08 19:16:34.160669 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:16:34.160576 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2215037d_3344_4d96_b656_772c0dde24da.slice/crio-fa5e3df263ff761f42866adb843cd894603f4b12b50047eeca41fd9f38851773 WatchSource:0}: Error finding container fa5e3df263ff761f42866adb843cd894603f4b12b50047eeca41fd9f38851773: Status 404 returned error can't find the container with id fa5e3df263ff761f42866adb843cd894603f4b12b50047eeca41fd9f38851773 Jul 08 19:16:34.667616 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:34.667566 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" event={"ID":"2215037d-3344-4d96-b656-772c0dde24da","Type":"ContainerStarted","Data":"fa5e3df263ff761f42866adb843cd894603f4b12b50047eeca41fd9f38851773"} Jul 08 19:16:35.673746 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:35.673656 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" event={"ID":"2215037d-3344-4d96-b656-772c0dde24da","Type":"ContainerStarted","Data":"971d907468068c680a393c2cbe43a5fc5916fbd3b1dfb7a1a5a925363ae6be2e"} Jul 08 19:16:35.694616 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:35.694527 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" podStartSLOduration=1.62070704 podStartE2EDuration="2.694505587s" totalImagesPullingTime="1.073798547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:16:35.693960024 +0000 UTC m=+677.407022032" watchObservedRunningTime="2026-07-08 19:16:35.694505587 +0000 UTC m=+677.407567596" Jul 08 19:16:37.862861 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:37.862820 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:16:44.026328 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:44.026294 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:44.026754 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:44.026355 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:44.038735 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:44.038704 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:44.725207 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:44.725173 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7bznv" Jul 08 19:16:56.268958 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:16:56.268927 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:16.809911 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.809820 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5"] Jul 08 19:17:16.813206 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.813190 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.815935 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.815908 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 08 19:17:16.827847 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.827823 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5"] Jul 08 19:17:16.855131 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.855104 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:16.863078 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.863058 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv2rp\" (UniqueName: \"kubernetes.io/projected/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-kube-api-access-pv2rp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.863176 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.863093 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.863176 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.863148 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.863267 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.863180 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.863267 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.863214 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.863267 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.863233 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.964558 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.964522 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.964558 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.964559 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.964768 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.964579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.964768 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.964736 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv2rp\" (UniqueName: \"kubernetes.io/projected/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-kube-api-access-pv2rp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.964842 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.964774 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.964842 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.964831 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.964941 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.964918 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.965007 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.964986 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.965073 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.965021 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.967066 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.967037 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.967171 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.967159 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:16.972994 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:16.972968 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv2rp\" (UniqueName: \"kubernetes.io/projected/b75067ce-69aa-4c8e-bf1f-eb850ee774a2-kube-api-access-pv2rp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xd2x5\" (UID: \"b75067ce-69aa-4c8e-bf1f-eb850ee774a2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:17.124479 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:17.124379 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:17.265580 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:17.265557 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5"] Jul 08 19:17:17.268155 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:17:17.268129 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75067ce_69aa_4c8e_bf1f_eb850ee774a2.slice/crio-ab0f0d8ecb3636495fcdb5d42ef4fdc15746e95dd54ab9ac199120db32944658 WatchSource:0}: Error finding container ab0f0d8ecb3636495fcdb5d42ef4fdc15746e95dd54ab9ac199120db32944658: Status 404 returned error can't find the container with id ab0f0d8ecb3636495fcdb5d42ef4fdc15746e95dd54ab9ac199120db32944658 Jul 08 19:17:17.269676 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:17.269653 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:17:17.860717 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:17.860621 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" event={"ID":"b75067ce-69aa-4c8e-bf1f-eb850ee774a2","Type":"ContainerStarted","Data":"b9ee14112313093f3033075c5e416aca27d64eb6bdeaa75d79f496952c7f4de6"} Jul 08 19:17:17.860717 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:17.860713 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" event={"ID":"b75067ce-69aa-4c8e-bf1f-eb850ee774a2","Type":"ContainerStarted","Data":"ab0f0d8ecb3636495fcdb5d42ef4fdc15746e95dd54ab9ac199120db32944658"} Jul 08 19:17:17.880361 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:17.880314 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" podStartSLOduration=1.6799574640000001 podStartE2EDuration="1.880300165s" totalImagesPullingTime="200.342701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:17:17.879677349 +0000 UTC m=+719.592739358" watchObservedRunningTime="2026-07-08 19:17:17.880300165 +0000 UTC m=+719.593362173" Jul 08 19:17:21.189998 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.189962 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt"] Jul 08 19:17:21.193269 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.193250 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.195813 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.195791 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 08 19:17:21.205530 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.205507 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt"] Jul 08 19:17:21.216380 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.216356 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:17:21.300308 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.300270 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ef4d770-9b84-47c0-899e-7b03c815d950-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.300308 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.300304 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ef4d770-9b84-47c0-899e-7b03c815d950-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.300542 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.300347 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-869ph\" (UniqueName: \"kubernetes.io/projected/3ef4d770-9b84-47c0-899e-7b03c815d950-kube-api-access-869ph\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.300542 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.300407 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef4d770-9b84-47c0-899e-7b03c815d950-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.300542 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.300464 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef4d770-9b84-47c0-899e-7b03c815d950-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.300754 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.300566 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef4d770-9b84-47c0-899e-7b03c815d950-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.401772 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.401740 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef4d770-9b84-47c0-899e-7b03c815d950-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.401969 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.401802 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef4d770-9b84-47c0-899e-7b03c815d950-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.401969 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.401835 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef4d770-9b84-47c0-899e-7b03c815d950-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.401969 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.401868 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ef4d770-9b84-47c0-899e-7b03c815d950-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.402128 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.402000 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ef4d770-9b84-47c0-899e-7b03c815d950-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.402128 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.402066 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-869ph\" (UniqueName: \"kubernetes.io/projected/3ef4d770-9b84-47c0-899e-7b03c815d950-kube-api-access-869ph\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.402298 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.402274 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ef4d770-9b84-47c0-899e-7b03c815d950-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.402357 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.402312 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef4d770-9b84-47c0-899e-7b03c815d950-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.402413 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.402357 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef4d770-9b84-47c0-899e-7b03c815d950-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.404165 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.404148 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ef4d770-9b84-47c0-899e-7b03c815d950-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.404300 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.404281 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef4d770-9b84-47c0-899e-7b03c815d950-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.411467 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.411444 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-869ph\" (UniqueName: \"kubernetes.io/projected/3ef4d770-9b84-47c0-899e-7b03c815d950-kube-api-access-869ph\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt\" (UID: \"3ef4d770-9b84-47c0-899e-7b03c815d950\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.502507 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.502473 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:21.648136 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.648102 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt"] Jul 08 19:17:21.651391 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:17:21.651364 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ef4d770_9b84_47c0_899e_7b03c815d950.slice/crio-96817e171126a394a462a9009396be569ce64881f62eff3122ad7aa4e81bff56 WatchSource:0}: Error finding container 96817e171126a394a462a9009396be569ce64881f62eff3122ad7aa4e81bff56: Status 404 returned error can't find the container with id 96817e171126a394a462a9009396be569ce64881f62eff3122ad7aa4e81bff56 Jul 08 19:17:21.878024 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:21.877989 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" event={"ID":"3ef4d770-9b84-47c0-899e-7b03c815d950","Type":"ContainerStarted","Data":"96817e171126a394a462a9009396be569ce64881f62eff3122ad7aa4e81bff56"} Jul 08 19:17:22.883377 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:22.883346 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" event={"ID":"3ef4d770-9b84-47c0-899e-7b03c815d950","Type":"ContainerStarted","Data":"ffb00e23f9573d3857dfd65089a246a0dd6de2455e423ba2c4c0862de92fd17c"} Jul 08 19:17:22.920238 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:22.920180 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" podStartSLOduration=1.7086820550000001 podStartE2EDuration="1.92015926s" totalImagesPullingTime="211.477205ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:17:22.913689187 +0000 UTC m=+724.626751196" watchObservedRunningTime="2026-07-08 19:17:22.92015926 +0000 UTC m=+724.633221270" Jul 08 19:17:27.124918 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:27.124883 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:27.125368 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:27.124972 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:27.137787 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:27.137763 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:27.915499 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:27.915466 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xd2x5" Jul 08 19:17:31.502876 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:31.502837 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:31.503375 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:31.502900 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:31.515089 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:31.515063 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:17:31.932365 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:17:31.932288 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt" Jul 08 19:18:52.414338 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:52.414246 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74b7d4585b-7b7wc"] Jul 08 19:18:52.414934 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:52.414506 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-74b7d4585b-7b7wc" podUID="cff4258f-5a02-4c76-9d77-234f56e46529" containerName="authorino" containerID="cri-o://bf01172b59491b3fc854e17636ff3a0f8edf615bf9065281102d645a55938528" gracePeriod=30 Jul 08 19:18:52.659859 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:52.659834 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b7d4585b-7b7wc" Jul 08 19:18:52.682326 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:52.682255 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq6db\" (UniqueName: \"kubernetes.io/projected/cff4258f-5a02-4c76-9d77-234f56e46529-kube-api-access-zq6db\") pod \"cff4258f-5a02-4c76-9d77-234f56e46529\" (UID: \"cff4258f-5a02-4c76-9d77-234f56e46529\") " Jul 08 19:18:52.682326 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:52.682305 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cff4258f-5a02-4c76-9d77-234f56e46529-tls-cert\") pod \"cff4258f-5a02-4c76-9d77-234f56e46529\" (UID: \"cff4258f-5a02-4c76-9d77-234f56e46529\") " Jul 08 19:18:52.684366 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:52.684341 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cff4258f-5a02-4c76-9d77-234f56e46529-kube-api-access-zq6db" (OuterVolumeSpecName: "kube-api-access-zq6db") pod "cff4258f-5a02-4c76-9d77-234f56e46529" (UID: "cff4258f-5a02-4c76-9d77-234f56e46529"). InnerVolumeSpecName "kube-api-access-zq6db". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:18:52.694069 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:52.694044 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cff4258f-5a02-4c76-9d77-234f56e46529-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cff4258f-5a02-4c76-9d77-234f56e46529" (UID: "cff4258f-5a02-4c76-9d77-234f56e46529"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:18:52.783212 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:52.783178 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq6db\" (UniqueName: \"kubernetes.io/projected/cff4258f-5a02-4c76-9d77-234f56e46529-kube-api-access-zq6db\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:18:52.783212 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:52.783209 2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cff4258f-5a02-4c76-9d77-234f56e46529-tls-cert\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:18:53.130104 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:53.130070 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:53.274825 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:53.274794 2554 generic.go:356] "Generic (PLEG): container finished" podID="cff4258f-5a02-4c76-9d77-234f56e46529" containerID="bf01172b59491b3fc854e17636ff3a0f8edf615bf9065281102d645a55938528" exitCode=0 Jul 08 19:18:53.274988 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:53.274836 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b7d4585b-7b7wc" Jul 08 19:18:53.274988 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:53.274845 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b7d4585b-7b7wc" event={"ID":"cff4258f-5a02-4c76-9d77-234f56e46529","Type":"ContainerDied","Data":"bf01172b59491b3fc854e17636ff3a0f8edf615bf9065281102d645a55938528"} Jul 08 19:18:53.274988 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:53.274877 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b7d4585b-7b7wc" event={"ID":"cff4258f-5a02-4c76-9d77-234f56e46529","Type":"ContainerDied","Data":"5e9de0bc04f76ec9cdaee997d77ff76528935605ddb4ed540a96f59726a64b96"} Jul 08 19:18:53.274988 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:53.274893 2554 scope.go:117] "RemoveContainer" containerID="bf01172b59491b3fc854e17636ff3a0f8edf615bf9065281102d645a55938528" Jul 08 19:18:53.283034 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:53.283009 2554 scope.go:117] "RemoveContainer" containerID="bf01172b59491b3fc854e17636ff3a0f8edf615bf9065281102d645a55938528" Jul 08 19:18:53.283272 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:18:53.283253 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf01172b59491b3fc854e17636ff3a0f8edf615bf9065281102d645a55938528\": container with ID starting with bf01172b59491b3fc854e17636ff3a0f8edf615bf9065281102d645a55938528 not found: ID does not exist" containerID="bf01172b59491b3fc854e17636ff3a0f8edf615bf9065281102d645a55938528" Jul 08 19:18:53.283323 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:53.283281 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf01172b59491b3fc854e17636ff3a0f8edf615bf9065281102d645a55938528"} err="failed to get container status \"bf01172b59491b3fc854e17636ff3a0f8edf615bf9065281102d645a55938528\": rpc error: code = NotFound desc = could not find container \"bf01172b59491b3fc854e17636ff3a0f8edf615bf9065281102d645a55938528\": container with ID starting with bf01172b59491b3fc854e17636ff3a0f8edf615bf9065281102d645a55938528 not found: ID does not exist" Jul 08 19:18:53.284653 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:53.284623 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:53.359635 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:53.359603 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74b7d4585b-7b7wc"] Jul 08 19:18:53.364049 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:53.364024 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74b7d4585b-7b7wc"] Jul 08 19:18:54.337490 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:54.337453 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:54.430983 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:54.430954 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:18:54.825532 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:18:54.825500 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cff4258f-5a02-4c76-9d77-234f56e46529" path="/var/lib/kubelet/pods/cff4258f-5a02-4c76-9d77-234f56e46529/volumes" Jul 08 19:19:44.763128 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:19:44.763089 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:05.313345 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:20:05.313308 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:06.765204 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:20:06.765171 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:18.693116 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:20:18.693085 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:20:18.694248 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:20:18.694225 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:20:47.820137 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:20:47.820104 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:49.104539 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:20:49.104507 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:54.106052 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:20:54.106017 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:54.206988 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:20:54.206951 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:54.306492 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:20:54.306464 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:20:54.499160 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:20:54.499092 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:21:00.787758 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:21:00.787724 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:21:00.845584 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:21:00.845555 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:21:01.543226 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:21:01.543197 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:22:05.964757 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:22:05.964661 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:22:44.604319 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:22:44.604286 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:23:51.456387 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:23:51.456348 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:25:18.720067 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:25:18.720040 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:25:18.720547 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:25:18.720040 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:28:48.870391 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:28:48.870354 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:30:13.806034 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:30:13.806002 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:30:18.745937 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:30:18.745908 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:30:18.746580 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:30:18.746559 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:31:26.827245 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:31:26.827211 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:00.207679 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:00.207642 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:07.701208 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:07.701176 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:15.966179 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:15.966099 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:21.141545 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:21.141490 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:24.121809 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:24.121779 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:24.226975 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:24.226939 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:24.595779 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:24.595746 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:30.786388 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:30.786356 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:30.848975 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:30.848943 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:31.012143 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:31.012114 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:31.116265 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:31.116187 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:32.102523 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:32.102495 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:32.221537 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:32.221508 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:32.318555 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:32.318521 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:32.750241 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:32.750216 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:32.822179 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:32.822153 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:32.882237 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:32.882207 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:33.322357 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:33.322314 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:33.379423 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:33.379381 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:34.804948 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:34.804916 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:37.293787 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:37.293753 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:37.499644 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:37.499609 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:37.610888 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:37.610815 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:37.929324 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:37.929240 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:40.126881 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:40.126847 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:43.683031 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:43.682994 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:43.786274 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:43.786240 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:43.929675 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:43.929640 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:44.030558 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:44.030526 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:45.100533 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:45.100498 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:45.204883 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:45.204849 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:45.307036 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:45.307000 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:45.677213 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:45.677184 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:45.772505 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:45.772468 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:45.872861 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:45.872829 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:47.588132 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:47.588084 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:50.257398 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:50.257365 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:50.564743 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:50.564654 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:56.391082 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:56.391038 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:56.495582 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:56.495555 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:32:58.840286 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:32:58.840251 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:02.701194 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:02.701156 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:02.801355 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:02.801325 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:02.940350 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:02.940316 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:02.995881 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:02.995848 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:04.042035 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:04.042002 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:04.152311 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:04.152278 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:04.247825 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:04.247789 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:04.446994 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:04.446894 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:04.702385 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:04.702298 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:04.802938 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:04.802876 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:07.037331 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:07.037301 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:08.557052 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:08.557015 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:08.744231 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:08.744195 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:08.853950 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:08.853872 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:08.967231 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:08.967199 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:10.507161 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:10.507126 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:15.173248 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:15.173219 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:15.227355 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:15.227311 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:15.659164 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:15.659123 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:15.755928 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:15.755883 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:15.855176 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:15.855124 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:17.330900 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:17.330864 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:23.165024 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:23.164980 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:23.271234 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:23.271184 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:23.365863 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:23.365814 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:23.465576 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:23.465537 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:23.913389 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:23.913290 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:49.971327 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:49.971294 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:55.793203 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:55.793165 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:55.895557 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:55.895526 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:33:55.993172 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:33:55.993146 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:11.933563 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:11.933533 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:18.064718 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:18.064681 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:18.120853 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:18.120816 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:18.187071 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:18.187036 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:18.287102 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:18.287071 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:28.805777 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:28.805741 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:29.648912 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:29.648883 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:35.803503 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:35.803466 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:35.864399 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:35.864350 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:35.936607 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:35.936556 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:36.040802 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:36.040770 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:36.137458 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:36.137382 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:36.859079 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:36.859045 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:36.962956 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:36.962923 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:37.058410 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:37.058375 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:38.642538 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:38.642507 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:44.539304 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:44.539259 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:44.599757 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:44.599725 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:45.247190 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:45.247156 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:51.369047 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:51.369011 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:51.424510 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:51.424476 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:51.619175 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:51.619091 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:51.986584 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:51.986552 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:52.522791 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:52.522757 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:54.673429 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:54.673397 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:54.770669 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:54.770641 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:54.869944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:54.869917 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:55.032496 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:55.032465 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:55.338325 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:55.338245 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:55.438787 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:55.438746 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:59.178667 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:59.178625 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:34:59.856402 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:34:59.856361 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:00.082432 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:00.082396 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:00.336436 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:00.336398 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:06.399795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:06.399742 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:06.500356 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:06.500322 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:06.810189 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:06.810156 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:07.229440 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:07.229408 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:07.302084 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:07.302053 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:13.492425 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:13.492346 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:13.595363 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:13.595317 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:13.765475 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:13.765393 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:14.117037 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:14.116956 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:14.218128 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:14.218091 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:14.326396 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:14.326336 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:18.772278 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:18.772247 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:35:18.772917 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:18.772900 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:35:20.249891 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:20.249861 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:20.351088 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:20.351022 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:20.450836 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:20.450776 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:20.616774 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:20.616653 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:26.670257 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:26.670142 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:26.737661 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:26.737611 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:29.860629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:29.860565 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:29.959989 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:29.959933 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:33.642019 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:33.641985 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:34.067770 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:34.067743 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:34.665986 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:34.665942 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:36.810781 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:36.810724 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:36.916107 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:36.916069 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:36.995562 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:36.995531 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:37.101373 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:37.101289 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:37.574886 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:37.574857 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:37.725625 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:37.725574 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:41.346080 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:41.346046 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:52.414806 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.414773 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf"] Jul 08 19:35:52.415255 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.415080 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cff4258f-5a02-4c76-9d77-234f56e46529" containerName="authorino" Jul 08 19:35:52.415255 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.415090 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cff4258f-5a02-4c76-9d77-234f56e46529" containerName="authorino" Jul 08 19:35:52.415255 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.415153 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cff4258f-5a02-4c76-9d77-234f56e46529" containerName="authorino" Jul 08 19:35:52.418137 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.418115 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.421767 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.421739 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3f1b3726\"/\"default-dockercfg-trwjp\"" Jul 08 19:35:52.421957 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.421940 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3f1b3726\"/\"kube-root-ca.crt\"" Jul 08 19:35:52.424352 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.424324 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3f1b3726\"/\"openshift-service-ca.crt\"" Jul 08 19:35:52.424562 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.424543 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3f1b3726\"/\"e2e-lifecycle-model-3f1b3726-kserve-self-signed-certs\"" Jul 08 19:35:52.429099 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.429079 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf"] Jul 08 19:35:52.448204 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.448150 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:52.552554 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.552520 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-home\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.552554 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.552550 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-tls-certs\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.552817 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.552615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-dshm\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.552817 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.552677 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-model-cache\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.552817 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.552776 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-tmp-dir\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.552817 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.552811 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlmdz\" (UniqueName: \"kubernetes.io/projected/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-kube-api-access-tlmdz\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.653448 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.653412 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-dshm\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.653448 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.653452 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-model-cache\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.653718 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.653480 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-tmp-dir\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.653718 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.653506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlmdz\" (UniqueName: \"kubernetes.io/projected/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-kube-api-access-tlmdz\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.653718 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.653564 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-home\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.653718 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.653585 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-tls-certs\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.653949 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.653927 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-tmp-dir\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.653989 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.653966 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-model-cache\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.654025 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.653997 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-home\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.655635 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.655617 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-dshm\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.656055 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.656039 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-tls-certs\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.662799 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.662774 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlmdz\" (UniqueName: \"kubernetes.io/projected/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-kube-api-access-tlmdz\") pod \"e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.728611 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.728561 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:35:52.865635 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:52.865541 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf"] Jul 08 19:35:52.868337 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:35:52.868312 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b77b34d_5ffd_477e_b0fa_dadbfdd30e94.slice/crio-f036608489a230cf91ad64705d7eb43d51487ef3c66d68922351a359180a32d5 WatchSource:0}: Error finding container f036608489a230cf91ad64705d7eb43d51487ef3c66d68922351a359180a32d5: Status 404 returned error can't find the container with id f036608489a230cf91ad64705d7eb43d51487ef3c66d68922351a359180a32d5 Jul 08 19:35:53.723656 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:53.723621 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" event={"ID":"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94","Type":"ContainerStarted","Data":"766657c10534ba7da82a973f6c380dcb0e5e41d46e5bda0d4fa8d22a2ac49023"} Jul 08 19:35:53.724038 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:53.723664 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" event={"ID":"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94","Type":"ContainerStarted","Data":"f036608489a230cf91ad64705d7eb43d51487ef3c66d68922351a359180a32d5"} Jul 08 19:35:53.744304 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:35:53.744253 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" podStartSLOduration=1.744237295 podStartE2EDuration="1.744237295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:53.742546607 +0000 UTC m=+1835.455608617" watchObservedRunningTime="2026-07-08 19:35:53.744237295 +0000 UTC m=+1835.457299302" Jul 08 19:36:02.729607 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:02.729559 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:36:02.730035 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:02.729640 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:36:02.742266 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:02.742236 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:36:02.779376 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:02.779350 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:36:13.940953 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:13.940898 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:36:14.350875 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:14.350840 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:36:20.113422 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:20.113387 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:36:25.064019 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:25.063980 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf"] Jul 08 19:36:25.114739 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:25.114673 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:36:40.084146 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.084105 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" podUID="9b77b34d-5ffd-477e-b0fa-dadbfdd30e94" containerName="main" containerID="cri-o://766657c10534ba7da82a973f6c380dcb0e5e41d46e5bda0d4fa8d22a2ac49023" gracePeriod=45 Jul 08 19:36:40.328272 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.328245 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:36:40.373974 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.373888 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-dshm\") pod \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " Jul 08 19:36:40.373974 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.373947 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-tls-certs\") pod \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " Jul 08 19:36:40.374209 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.374037 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-home\") pod \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " Jul 08 19:36:40.374209 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.374105 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlmdz\" (UniqueName: \"kubernetes.io/projected/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-kube-api-access-tlmdz\") pod \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " Jul 08 19:36:40.374209 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.374144 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-model-cache\") pod \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " Jul 08 19:36:40.374209 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.374175 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-tmp-dir\") pod \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\" (UID: \"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94\") " Jul 08 19:36:40.374538 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.374511 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-model-cache" (OuterVolumeSpecName: "model-cache") pod "9b77b34d-5ffd-477e-b0fa-dadbfdd30e94" (UID: "9b77b34d-5ffd-477e-b0fa-dadbfdd30e94"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:36:40.374664 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.374631 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9b77b34d-5ffd-477e-b0fa-dadbfdd30e94" (UID: "9b77b34d-5ffd-477e-b0fa-dadbfdd30e94"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:36:40.374930 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.374906 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-home" (OuterVolumeSpecName: "home") pod "9b77b34d-5ffd-477e-b0fa-dadbfdd30e94" (UID: "9b77b34d-5ffd-477e-b0fa-dadbfdd30e94"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:36:40.376655 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.376622 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-kube-api-access-tlmdz" (OuterVolumeSpecName: "kube-api-access-tlmdz") pod "9b77b34d-5ffd-477e-b0fa-dadbfdd30e94" (UID: "9b77b34d-5ffd-477e-b0fa-dadbfdd30e94"). InnerVolumeSpecName "kube-api-access-tlmdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:36:40.376762 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.376726 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-dshm" (OuterVolumeSpecName: "dshm") pod "9b77b34d-5ffd-477e-b0fa-dadbfdd30e94" (UID: "9b77b34d-5ffd-477e-b0fa-dadbfdd30e94"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:36:40.376762 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.376727 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9b77b34d-5ffd-477e-b0fa-dadbfdd30e94" (UID: "9b77b34d-5ffd-477e-b0fa-dadbfdd30e94"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:36:40.475773 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.475727 2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-home\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:36:40.475773 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.475768 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlmdz\" (UniqueName: \"kubernetes.io/projected/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-kube-api-access-tlmdz\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:36:40.475773 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.475780 2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-model-cache\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:36:40.475773 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.475789 2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-tmp-dir\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:36:40.475773 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.475796 2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-dshm\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:36:40.476080 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.475803 2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94-tls-certs\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:36:40.930610 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.930556 2554 generic.go:356] "Generic (PLEG): container finished" podID="9b77b34d-5ffd-477e-b0fa-dadbfdd30e94" containerID="766657c10534ba7da82a973f6c380dcb0e5e41d46e5bda0d4fa8d22a2ac49023" exitCode=0 Jul 08 19:36:40.930789 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.930635 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" Jul 08 19:36:40.930789 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.930644 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" event={"ID":"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94","Type":"ContainerDied","Data":"766657c10534ba7da82a973f6c380dcb0e5e41d46e5bda0d4fa8d22a2ac49023"} Jul 08 19:36:40.930789 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.930701 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf" event={"ID":"9b77b34d-5ffd-477e-b0fa-dadbfdd30e94","Type":"ContainerDied","Data":"f036608489a230cf91ad64705d7eb43d51487ef3c66d68922351a359180a32d5"} Jul 08 19:36:40.930789 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.930725 2554 scope.go:117] "RemoveContainer" containerID="766657c10534ba7da82a973f6c380dcb0e5e41d46e5bda0d4fa8d22a2ac49023" Jul 08 19:36:40.939126 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.939094 2554 scope.go:117] "RemoveContainer" containerID="766657c10534ba7da82a973f6c380dcb0e5e41d46e5bda0d4fa8d22a2ac49023" Jul 08 19:36:40.939369 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:36:40.939351 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"766657c10534ba7da82a973f6c380dcb0e5e41d46e5bda0d4fa8d22a2ac49023\": container with ID starting with 766657c10534ba7da82a973f6c380dcb0e5e41d46e5bda0d4fa8d22a2ac49023 not found: ID does not exist" containerID="766657c10534ba7da82a973f6c380dcb0e5e41d46e5bda0d4fa8d22a2ac49023" Jul 08 19:36:40.939428 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.939377 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"766657c10534ba7da82a973f6c380dcb0e5e41d46e5bda0d4fa8d22a2ac49023"} err="failed to get container status \"766657c10534ba7da82a973f6c380dcb0e5e41d46e5bda0d4fa8d22a2ac49023\": rpc error: code = NotFound desc = could not find container \"766657c10534ba7da82a973f6c380dcb0e5e41d46e5bda0d4fa8d22a2ac49023\": container with ID starting with 766657c10534ba7da82a973f6c380dcb0e5e41d46e5bda0d4fa8d22a2ac49023 not found: ID does not exist" Jul 08 19:36:40.952565 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.952537 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf"] Jul 08 19:36:40.956201 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:40.956179 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-3f1b3726/e2e-lifecycle-model-3f1b3726-kserve-d7b7ccfff-jrjdf"] Jul 08 19:36:42.826040 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:36:42.826007 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b77b34d-5ffd-477e-b0fa-dadbfdd30e94" path="/var/lib/kubelet/pods/9b77b34d-5ffd-477e-b0fa-dadbfdd30e94/volumes" Jul 08 19:37:07.827199 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:07.827167 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:08.961463 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:08.961433 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:14.838617 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:14.838562 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:14.940159 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:14.940128 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:15.180156 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:15.180076 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:16.517379 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:16.517343 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:16.615217 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:16.615183 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:16.715246 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:16.715213 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:17.486345 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:17.486312 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:17.585278 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:17.585244 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:17.688370 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:17.688334 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:19.179314 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:19.179226 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:25.490436 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:25.490405 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:25.592228 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:25.592192 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:26.180252 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:26.180205 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:32.276111 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:32.276079 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:32.377312 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:32.377278 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:32.483995 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:32.483963 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:38.487486 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:38.487451 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:43.047857 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:43.047819 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:37:43.403350 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:37:43.403269 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:04.411437 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:04.411406 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:10.742363 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:10.742276 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:10.842413 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:10.842364 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:11.091410 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:11.091331 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:11.429541 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:11.429446 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:12.113985 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:12.113950 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:14.678675 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:14.678642 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:14.779431 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:14.779402 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:14.881219 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:14.881183 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:15.347800 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:15.347768 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:15.448460 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:15.448428 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:15.548203 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:15.548168 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:19.224284 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:19.224255 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:19.578400 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:19.578314 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:19.969576 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:19.969522 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:20.261256 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:20.261168 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:22.740879 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:22.740843 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:22.835006 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:22.834970 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:22.899309 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:22.899282 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:23.066862 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:23.066786 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:23.420039 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:23.419950 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:23.526034 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:23.526003 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:27.180755 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:27.180722 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:35.966649 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:35.966616 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb"] Jul 08 19:38:35.967013 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:35.966940 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b77b34d-5ffd-477e-b0fa-dadbfdd30e94" containerName="main" Jul 08 19:38:35.967013 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:35.966954 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b77b34d-5ffd-477e-b0fa-dadbfdd30e94" containerName="main" Jul 08 19:38:35.967013 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:35.967013 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b77b34d-5ffd-477e-b0fa-dadbfdd30e94" containerName="main" Jul 08 19:38:35.969946 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:35.969931 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:35.974631 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:35.974584 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-f953f1\"/\"kube-root-ca.crt\"" Jul 08 19:38:35.974631 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:35.974619 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-f953f1\"/\"openshift-service-ca.crt\"" Jul 08 19:38:35.974804 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:35.974702 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-f953f1\"/\"test-model-f953f1-kserve-self-signed-certs\"" Jul 08 19:38:35.974883 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:35.974868 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-f953f1\"/\"default-dockercfg-g6pvb\"" Jul 08 19:38:35.989372 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:35.989345 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb"] Jul 08 19:38:36.017331 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.017305 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:36.054210 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.054189 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-tmp-dir\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.054330 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.054220 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-home\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.054330 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.054235 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-dshm\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.054330 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.054259 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-model-cache\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.054330 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.054324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f12c9be4-1eba-4951-b895-0d9a13d04f7d-tls-certs\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.054478 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.054354 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vqjm\" (UniqueName: \"kubernetes.io/projected/f12c9be4-1eba-4951-b895-0d9a13d04f7d-kube-api-access-7vqjm\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.155784 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.155757 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-tmp-dir\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.155944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.155790 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-home\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.155944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.155805 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-dshm\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.155944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.155831 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-model-cache\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.156108 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.155970 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f12c9be4-1eba-4951-b895-0d9a13d04f7d-tls-certs\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.156108 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.156039 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vqjm\" (UniqueName: \"kubernetes.io/projected/f12c9be4-1eba-4951-b895-0d9a13d04f7d-kube-api-access-7vqjm\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.156200 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.156175 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-tmp-dir\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.156242 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.156215 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-home\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.156321 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.156303 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-model-cache\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.158175 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.158153 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-dshm\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.158345 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.158329 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f12c9be4-1eba-4951-b895-0d9a13d04f7d-tls-certs\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.165806 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.165784 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vqjm\" (UniqueName: \"kubernetes.io/projected/f12c9be4-1eba-4951-b895-0d9a13d04f7d-kube-api-access-7vqjm\") pod \"test-model-f953f1-kserve-5dc768c69-r2jcb\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.280535 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.280453 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:36.430880 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.430838 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb"] Jul 08 19:38:36.434306 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:38:36.434279 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf12c9be4_1eba_4951_b895_0d9a13d04f7d.slice/crio-a5a810b01a382027e24efb4e23c8eef2d624b16c60d9f525644184bb2937b51b WatchSource:0}: Error finding container a5a810b01a382027e24efb4e23c8eef2d624b16c60d9f525644184bb2937b51b: Status 404 returned error can't find the container with id a5a810b01a382027e24efb4e23c8eef2d624b16c60d9f525644184bb2937b51b Jul 08 19:38:36.520275 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.520243 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:36.615173 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:36.615102 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:37.440444 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:37.440410 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" event={"ID":"f12c9be4-1eba-4951-b895-0d9a13d04f7d","Type":"ContainerStarted","Data":"50b9e45d3ed17f80b56d25ef9e760babdd8ad2c6deb265df3c708f1fe3689ac0"} Jul 08 19:38:37.440444 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:37.440450 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" event={"ID":"f12c9be4-1eba-4951-b895-0d9a13d04f7d","Type":"ContainerStarted","Data":"a5a810b01a382027e24efb4e23c8eef2d624b16c60d9f525644184bb2937b51b"} Jul 08 19:38:37.460992 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:37.460939 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" podStartSLOduration=2.460923373 podStartE2EDuration="2.460923373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:38:37.459565307 +0000 UTC m=+1999.172627319" watchObservedRunningTime="2026-07-08 19:38:37.460923373 +0000 UTC m=+1999.173985382" Jul 08 19:38:45.424397 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:45.424360 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:45.524846 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:45.524813 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:38:46.281361 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:46.281325 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:46.281552 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:46.281395 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:46.293681 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:46.293652 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:38:46.488670 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:38:46.488645 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:39:25.334163 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:25.334131 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:27.835252 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:27.835217 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:28.612806 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.612767 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh"] Jul 08 19:39:28.616106 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.616085 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.618889 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.618869 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a246eb\"/\"openshift-service-ca.crt\"" Jul 08 19:39:28.619930 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.619907 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a246eb\"/\"default-dockercfg-dvzmz\"" Jul 08 19:39:28.620031 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.619938 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a246eb\"/\"kube-root-ca.crt\"" Jul 08 19:39:28.620031 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.619963 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a246eb\"/\"test-model-a246eb-kserve-self-signed-certs\"" Jul 08 19:39:28.625091 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.625071 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh"] Jul 08 19:39:28.635000 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.634980 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:28.705041 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.705006 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04357213-7def-4480-a4c5-3f2f10c2839d-tls-certs\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.705238 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.705080 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-model-cache\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.705238 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.705096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-tmp-dir\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.705238 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.705117 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-home\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.705238 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.705132 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-dshm\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.705238 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.705148 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg9fc\" (UniqueName: \"kubernetes.io/projected/04357213-7def-4480-a4c5-3f2f10c2839d-kube-api-access-sg9fc\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.806317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.806282 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-model-cache\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.806317 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.806315 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-tmp-dir\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.806568 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.806340 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-home\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.806568 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.806466 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-dshm\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.806568 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.806511 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg9fc\" (UniqueName: \"kubernetes.io/projected/04357213-7def-4480-a4c5-3f2f10c2839d-kube-api-access-sg9fc\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.806766 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.806572 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04357213-7def-4480-a4c5-3f2f10c2839d-tls-certs\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.806766 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.806719 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-home\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.806874 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.806774 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-tmp-dir\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.806874 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.806825 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-model-cache\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.808786 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.808760 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-dshm\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.808925 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.808911 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04357213-7def-4480-a4c5-3f2f10c2839d-tls-certs\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.815001 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.814977 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg9fc\" (UniqueName: \"kubernetes.io/projected/04357213-7def-4480-a4c5-3f2f10c2839d-kube-api-access-sg9fc\") pod \"test-model-a246eb-kserve-756dbc444f-67vsh\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:28.926822 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:28.926751 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:29.058158 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:29.058104 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh"] Jul 08 19:39:29.060343 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:39:29.060314 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04357213_7def_4480_a4c5_3f2f10c2839d.slice/crio-4920ffe10c7f6090c64a651a40da33bc1c123a52ccd183f0c0bccb27c0c54b6e WatchSource:0}: Error finding container 4920ffe10c7f6090c64a651a40da33bc1c123a52ccd183f0c0bccb27c0c54b6e: Status 404 returned error can't find the container with id 4920ffe10c7f6090c64a651a40da33bc1c123a52ccd183f0c0bccb27c0c54b6e Jul 08 19:39:29.665944 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:29.665912 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" event={"ID":"04357213-7def-4480-a4c5-3f2f10c2839d","Type":"ContainerStarted","Data":"229594a53a7e11b40ea58960c8805328f04d478a301a60b3bcdfcb9df78920e3"} Jul 08 19:39:29.666114 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:29.665954 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" event={"ID":"04357213-7def-4480-a4c5-3f2f10c2839d","Type":"ContainerStarted","Data":"4920ffe10c7f6090c64a651a40da33bc1c123a52ccd183f0c0bccb27c0c54b6e"} Jul 08 19:39:29.684012 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:29.683964 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" podStartSLOduration=1.6839499359999999 podStartE2EDuration="1.683949936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:29.682369489 +0000 UTC m=+2051.395431499" watchObservedRunningTime="2026-07-08 19:39:29.683949936 +0000 UTC m=+2051.397011944" Jul 08 19:39:38.927265 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:38.927232 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:38.927265 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:38.927276 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:38.939272 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:38.939251 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:39.720229 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:39.720195 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:39:51.684230 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:51.684195 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb"] Jul 08 19:39:51.704296 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:51.704265 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:52.582342 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:52.582308 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh"] Jul 08 19:39:52.603963 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:52.603932 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:52.786144 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:52.786109 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:53.276608 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:53.276549 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:53.375000 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:53.374962 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:53.485082 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:53.485053 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:39:58.272088 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:39:58.272043 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:06.782354 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:06.782307 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" podUID="f12c9be4-1eba-4951-b895-0d9a13d04f7d" containerName="main" containerID="cri-o://50b9e45d3ed17f80b56d25ef9e760babdd8ad2c6deb265df3c708f1fe3689ac0" gracePeriod=45 Jul 08 19:40:07.013697 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.013667 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:07.037935 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.037879 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:40:07.133305 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.133277 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-tmp-dir\") pod \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " Jul 08 19:40:07.133509 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.133335 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-model-cache\") pod \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " Jul 08 19:40:07.133509 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.133391 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vqjm\" (UniqueName: \"kubernetes.io/projected/f12c9be4-1eba-4951-b895-0d9a13d04f7d-kube-api-access-7vqjm\") pod \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " Jul 08 19:40:07.133509 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.133424 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-home\") pod \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " Jul 08 19:40:07.133509 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.133448 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-dshm\") pod \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " Jul 08 19:40:07.133509 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.133500 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f12c9be4-1eba-4951-b895-0d9a13d04f7d-tls-certs\") pod \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\" (UID: \"f12c9be4-1eba-4951-b895-0d9a13d04f7d\") " Jul 08 19:40:07.133790 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.133520 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f12c9be4-1eba-4951-b895-0d9a13d04f7d" (UID: "f12c9be4-1eba-4951-b895-0d9a13d04f7d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:40:07.133790 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.133691 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-home" (OuterVolumeSpecName: "home") pod "f12c9be4-1eba-4951-b895-0d9a13d04f7d" (UID: "f12c9be4-1eba-4951-b895-0d9a13d04f7d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:40:07.133790 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.133704 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-model-cache" (OuterVolumeSpecName: "model-cache") pod "f12c9be4-1eba-4951-b895-0d9a13d04f7d" (UID: "f12c9be4-1eba-4951-b895-0d9a13d04f7d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:40:07.133790 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.133773 2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-model-cache\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:40:07.133790 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.133789 2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-home\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:40:07.134040 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.133800 2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-tmp-dir\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:40:07.135714 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.135688 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-dshm" (OuterVolumeSpecName: "dshm") pod "f12c9be4-1eba-4951-b895-0d9a13d04f7d" (UID: "f12c9be4-1eba-4951-b895-0d9a13d04f7d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:40:07.135822 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.135804 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f12c9be4-1eba-4951-b895-0d9a13d04f7d-kube-api-access-7vqjm" (OuterVolumeSpecName: "kube-api-access-7vqjm") pod "f12c9be4-1eba-4951-b895-0d9a13d04f7d" (UID: "f12c9be4-1eba-4951-b895-0d9a13d04f7d"). InnerVolumeSpecName "kube-api-access-7vqjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:40:07.135875 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.135838 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f12c9be4-1eba-4951-b895-0d9a13d04f7d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f12c9be4-1eba-4951-b895-0d9a13d04f7d" (UID: "f12c9be4-1eba-4951-b895-0d9a13d04f7d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:07.234217 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.234177 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vqjm\" (UniqueName: \"kubernetes.io/projected/f12c9be4-1eba-4951-b895-0d9a13d04f7d-kube-api-access-7vqjm\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:40:07.234217 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.234213 2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f12c9be4-1eba-4951-b895-0d9a13d04f7d-dshm\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:40:07.234217 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.234222 2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f12c9be4-1eba-4951-b895-0d9a13d04f7d-tls-certs\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:40:07.604312 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.604270 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" podUID="04357213-7def-4480-a4c5-3f2f10c2839d" containerName="main" containerID="cri-o://229594a53a7e11b40ea58960c8805328f04d478a301a60b3bcdfcb9df78920e3" gracePeriod=45 Jul 08 19:40:07.834305 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.834272 2554 generic.go:356] "Generic (PLEG): container finished" podID="f12c9be4-1eba-4951-b895-0d9a13d04f7d" containerID="50b9e45d3ed17f80b56d25ef9e760babdd8ad2c6deb265df3c708f1fe3689ac0" exitCode=0 Jul 08 19:40:07.834706 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.834311 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" Jul 08 19:40:07.834706 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.834348 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" event={"ID":"f12c9be4-1eba-4951-b895-0d9a13d04f7d","Type":"ContainerDied","Data":"50b9e45d3ed17f80b56d25ef9e760babdd8ad2c6deb265df3c708f1fe3689ac0"} Jul 08 19:40:07.834706 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.834391 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb" event={"ID":"f12c9be4-1eba-4951-b895-0d9a13d04f7d","Type":"ContainerDied","Data":"a5a810b01a382027e24efb4e23c8eef2d624b16c60d9f525644184bb2937b51b"} Jul 08 19:40:07.834706 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.834409 2554 scope.go:117] "RemoveContainer" containerID="50b9e45d3ed17f80b56d25ef9e760babdd8ad2c6deb265df3c708f1fe3689ac0" Jul 08 19:40:07.835798 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.835759 2554 generic.go:356] "Generic (PLEG): container finished" podID="04357213-7def-4480-a4c5-3f2f10c2839d" containerID="229594a53a7e11b40ea58960c8805328f04d478a301a60b3bcdfcb9df78920e3" exitCode=0 Jul 08 19:40:07.835921 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.835830 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" event={"ID":"04357213-7def-4480-a4c5-3f2f10c2839d","Type":"ContainerDied","Data":"229594a53a7e11b40ea58960c8805328f04d478a301a60b3bcdfcb9df78920e3"} Jul 08 19:40:07.851492 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.851474 2554 scope.go:117] "RemoveContainer" containerID="50b9e45d3ed17f80b56d25ef9e760babdd8ad2c6deb265df3c708f1fe3689ac0" Jul 08 19:40:07.851772 ip-10-0-138-105 kubenswrapper[2554]: E0708 19:40:07.851748 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50b9e45d3ed17f80b56d25ef9e760babdd8ad2c6deb265df3c708f1fe3689ac0\": container with ID starting with 50b9e45d3ed17f80b56d25ef9e760babdd8ad2c6deb265df3c708f1fe3689ac0 not found: ID does not exist" containerID="50b9e45d3ed17f80b56d25ef9e760babdd8ad2c6deb265df3c708f1fe3689ac0" Jul 08 19:40:07.851883 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.851780 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b9e45d3ed17f80b56d25ef9e760babdd8ad2c6deb265df3c708f1fe3689ac0"} err="failed to get container status \"50b9e45d3ed17f80b56d25ef9e760babdd8ad2c6deb265df3c708f1fe3689ac0\": rpc error: code = NotFound desc = could not find container \"50b9e45d3ed17f80b56d25ef9e760babdd8ad2c6deb265df3c708f1fe3689ac0\": container with ID starting with 50b9e45d3ed17f80b56d25ef9e760babdd8ad2c6deb265df3c708f1fe3689ac0 not found: ID does not exist" Jul 08 19:40:07.856298 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.856256 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:40:07.865974 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.865953 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb"] Jul 08 19:40:07.872415 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.872386 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-f953f1/test-model-f953f1-kserve-5dc768c69-r2jcb"] Jul 08 19:40:07.940362 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.940331 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-tmp-dir\") pod \"04357213-7def-4480-a4c5-3f2f10c2839d\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " Jul 08 19:40:07.940522 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.940396 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg9fc\" (UniqueName: \"kubernetes.io/projected/04357213-7def-4480-a4c5-3f2f10c2839d-kube-api-access-sg9fc\") pod \"04357213-7def-4480-a4c5-3f2f10c2839d\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " Jul 08 19:40:07.940522 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.940479 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-model-cache\") pod \"04357213-7def-4480-a4c5-3f2f10c2839d\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " Jul 08 19:40:07.940522 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.940513 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04357213-7def-4480-a4c5-3f2f10c2839d-tls-certs\") pod \"04357213-7def-4480-a4c5-3f2f10c2839d\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " Jul 08 19:40:07.940738 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.940536 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-dshm\") pod \"04357213-7def-4480-a4c5-3f2f10c2839d\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " Jul 08 19:40:07.940738 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.940560 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-home\") pod \"04357213-7def-4480-a4c5-3f2f10c2839d\" (UID: \"04357213-7def-4480-a4c5-3f2f10c2839d\") " Jul 08 19:40:07.940738 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.940650 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "04357213-7def-4480-a4c5-3f2f10c2839d" (UID: "04357213-7def-4480-a4c5-3f2f10c2839d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:40:07.940885 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.940809 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-model-cache" (OuterVolumeSpecName: "model-cache") pod "04357213-7def-4480-a4c5-3f2f10c2839d" (UID: "04357213-7def-4480-a4c5-3f2f10c2839d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:40:07.940885 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.940875 2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-model-cache\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:40:07.940992 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.940913 2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-tmp-dir\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:40:07.940992 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.940873 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-home" (OuterVolumeSpecName: "home") pod "04357213-7def-4480-a4c5-3f2f10c2839d" (UID: "04357213-7def-4480-a4c5-3f2f10c2839d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:40:07.942658 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.942638 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04357213-7def-4480-a4c5-3f2f10c2839d-kube-api-access-sg9fc" (OuterVolumeSpecName: "kube-api-access-sg9fc") pod "04357213-7def-4480-a4c5-3f2f10c2839d" (UID: "04357213-7def-4480-a4c5-3f2f10c2839d"). InnerVolumeSpecName "kube-api-access-sg9fc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:40:07.943009 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.942993 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04357213-7def-4480-a4c5-3f2f10c2839d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "04357213-7def-4480-a4c5-3f2f10c2839d" (UID: "04357213-7def-4480-a4c5-3f2f10c2839d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:07.943063 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:07.943000 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-dshm" (OuterVolumeSpecName: "dshm") pod "04357213-7def-4480-a4c5-3f2f10c2839d" (UID: "04357213-7def-4480-a4c5-3f2f10c2839d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:40:08.042120 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:08.042081 2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04357213-7def-4480-a4c5-3f2f10c2839d-tls-certs\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:40:08.042120 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:08.042112 2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-dshm\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:40:08.042120 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:08.042124 2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04357213-7def-4480-a4c5-3f2f10c2839d-home\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:40:08.042355 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:08.042136 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg9fc\" (UniqueName: \"kubernetes.io/projected/04357213-7def-4480-a4c5-3f2f10c2839d-kube-api-access-sg9fc\") on node \"ip-10-0-138-105.ec2.internal\" DevicePath \"\"" Jul 08 19:40:08.826334 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:08.826303 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f12c9be4-1eba-4951-b895-0d9a13d04f7d" path="/var/lib/kubelet/pods/f12c9be4-1eba-4951-b895-0d9a13d04f7d/volumes" Jul 08 19:40:08.841341 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:08.841313 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" Jul 08 19:40:08.841742 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:08.841347 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh" event={"ID":"04357213-7def-4480-a4c5-3f2f10c2839d","Type":"ContainerDied","Data":"4920ffe10c7f6090c64a651a40da33bc1c123a52ccd183f0c0bccb27c0c54b6e"} Jul 08 19:40:08.841742 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:08.841394 2554 scope.go:117] "RemoveContainer" containerID="229594a53a7e11b40ea58960c8805328f04d478a301a60b3bcdfcb9df78920e3" Jul 08 19:40:08.859276 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:08.859244 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh"] Jul 08 19:40:08.863977 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:08.863949 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-a246eb/test-model-a246eb-kserve-756dbc444f-67vsh"] Jul 08 19:40:10.825780 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:10.825748 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04357213-7def-4480-a4c5-3f2f10c2839d" path="/var/lib/kubelet/pods/04357213-7def-4480-a4c5-3f2f10c2839d/volumes" Jul 08 19:40:18.797024 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:18.796996 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:40:18.799106 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:18.799084 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:40:30.585655 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:30.585567 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:30.686196 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:30.686132 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:35.148314 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:35.148282 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:35.416055 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:35.415963 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:35.805450 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:35.805418 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:36.207578 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:36.207552 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:36.354641 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:36.354610 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:36.448717 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:36.448680 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:36.651446 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:36.651363 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:42.221574 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:42.221537 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:42.285566 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:42.285536 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:42.495355 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:42.495275 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:43.055350 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:43.055315 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:43.430615 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:43.430514 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:43.713795 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:43.713756 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:46.424402 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:46.424355 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:46.626885 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:46.626839 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:46.697616 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:46.697512 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:47.050862 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:47.050834 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:47.151039 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:47.151006 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:50.966800 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:50.966764 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:51.426052 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:51.425972 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:51.742888 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:51.742841 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:51.841146 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:51.841117 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:54.760210 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:54.760179 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:54.827467 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:54.827432 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:55.134244 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:55.134159 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:55.394855 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:55.394777 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:55.496146 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:55.496109 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:40:59.052047 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:40:59.052013 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:07.298170 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:07.298137 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:07.684487 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:07.684400 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:07.954993 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:07.954913 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:08.054134 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:08.054104 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:08.236637 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:08.236603 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:13.462604 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:13.462511 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:13.517029 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:13.516994 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:13.726443 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:13.726375 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:14.149961 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:14.149884 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:14.555743 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:14.555707 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:14.653651 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:14.653618 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:14.745347 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:14.745315 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:14.967973 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:14.967940 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:20.336648 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:20.336612 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:20.436629 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:20.436583 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:20.595074 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:20.594966 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:21.148138 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:21.148103 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:21.462771 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:21.462744 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:22.358512 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:22.358478 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:24.731799 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:24.731765 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:24.810122 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:24.810088 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:24.867853 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:24.867819 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:25.058439 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:25.058352 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:25.385364 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:25.385287 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:25.488316 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:25.488285 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:29.250490 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:29.250452 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:29.585883 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:29.585796 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:29.891277 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:29.891195 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:29.993954 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:29.993920 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:32.787949 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:32.787912 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:32.874093 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:32.874065 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:32.935416 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:32.935382 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:33.174956 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:33.174852 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:33.375581 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:33.375550 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:33.475268 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:33.475240 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:37.320935 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:37.320878 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:46.092814 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:46.092725 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:46.193723 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:46.193690 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:55.161624 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:55.161573 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:41:55.261866 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:41:55.261835 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:20.443846 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:42:20.443810 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:48.313910 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:42:48.313816 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:42:48.415325 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:42:48.415273 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:42.364546 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:42.364508 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:43.897481 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:43.897441 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:48.671334 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:48.671296 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:48.738584 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:48.738527 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:48.928864 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:48.928776 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:49.219711 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:49.219684 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:49.320459 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:49.320429 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:49.420699 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:49.420662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:49.755489 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:49.755451 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:49.852727 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:49.852694 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:49.955744 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:49.955713 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:50.047271 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:50.047140 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:55.649165 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:55.649132 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:55.748913 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:55.748873 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:44:55.906031 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:44:55.905952 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:01.410913 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:01.410879 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r48hq_3396f1eb-103f-4818-8303-785e5f8cd947/manager/0.log" Jul 08 19:45:02.119291 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:02.119261 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6667fbd97f-s4wvc_2ae4bb01-23d2-4368-98b9-5af90fa3151b/copy-manifests/0.log" Jul 08 19:45:02.137138 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:02.137095 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6667fbd97f-s4wvc_2ae4bb01-23d2-4368-98b9-5af90fa3151b/manager/0.log" Jul 08 19:45:03.562945 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:03.562897 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rvszv_09f7a019-2cec-446b-89f4-66ea92058ea9/manager/0.log" Jul 08 19:45:04.278545 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:04.278513 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dkt45_674a7e79-175d-4be7-8fd8-9d14b659d711/manager/0.log" Jul 08 19:45:05.477945 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:05.477918 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-848485689f-bcs5k_67ff27b3-847a-430f-ba0a-c598ea1f84b7/router/0.log" Jul 08 19:45:07.107188 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:07.107156 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7bznv_2215037d-3344-4d96-b656-772c0dde24da/main/0.log" Jul 08 19:45:07.339051 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:07.339024 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xd2x5_b75067ce-69aa-4c8e-bf1f-eb850ee774a2/main/0.log" Jul 08 19:45:07.451804 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:07.451726 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-qb6wt_3ef4d770-9b84-47c0-899e-7b03c815d950/main/0.log" Jul 08 19:45:11.351896 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:11.351858 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:11.411541 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:11.411506 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:14.589984 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:14.589953 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s5ld2_2687d3bc-3cc1-44ef-8da4-be808f0e005b/global-pull-secret-syncer/0.log" Jul 08 19:45:14.643083 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:14.643058 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" Jul 08 19:45:14.798056 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:14.798025 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-105.ec2.internal_cde45a1e31fbf44904a4c0d935863798/haproxy/0.log" Jul 08 19:45:18.827137 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:18.827047 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:45:18.829538 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:18.829514 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:45:19.977118 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:19.977091 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rvszv_09f7a019-2cec-446b-89f4-66ea92058ea9/manager/0.log" Jul 08 19:45:20.294438 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:20.294343 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dkt45_674a7e79-175d-4be7-8fd8-9d14b659d711/manager/0.log" Jul 08 19:45:22.125834 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:22.125798 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-m5lfr_95ae1488-f214-4927-b45c-ae6b78154a2c/cluster-monitoring-operator/0.log" Jul 08 19:45:22.433071 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:22.432989 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-stgbd_122f6e4d-f1ee-4c19-a39d-f52219a636fb/node-exporter/0.log" Jul 08 19:45:22.452551 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:22.452524 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-stgbd_122f6e4d-f1ee-4c19-a39d-f52219a636fb/kube-rbac-proxy/0.log" Jul 08 19:45:22.472093 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:22.472053 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-stgbd_122f6e4d-f1ee-4c19-a39d-f52219a636fb/init-textfile/0.log" Jul 08 19:45:24.529104 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.529068 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m"] Jul 08 19:45:24.529478 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.529400 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f12c9be4-1eba-4951-b895-0d9a13d04f7d" containerName="main" Jul 08 19:45:24.529478 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.529416 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f12c9be4-1eba-4951-b895-0d9a13d04f7d" containerName="main" Jul 08 19:45:24.529478 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.529431 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04357213-7def-4480-a4c5-3f2f10c2839d" containerName="main" Jul 08 19:45:24.529478 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.529436 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="04357213-7def-4480-a4c5-3f2f10c2839d" containerName="main" Jul 08 19:45:24.529641 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.529498 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f12c9be4-1eba-4951-b895-0d9a13d04f7d" containerName="main" Jul 08 19:45:24.529641 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.529507 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="04357213-7def-4480-a4c5-3f2f10c2839d" containerName="main" Jul 08 19:45:24.532479 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.532459 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.533039 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.533016 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/14b8a006-a42f-4eea-badb-6fcffb184565-podres\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.533119 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.533054 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14b8a006-a42f-4eea-badb-6fcffb184565-lib-modules\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.533119 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.533099 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/14b8a006-a42f-4eea-badb-6fcffb184565-proc\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.533192 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.533183 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14b8a006-a42f-4eea-badb-6fcffb184565-sys\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.533243 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.533198 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zdzr\" (UniqueName: \"kubernetes.io/projected/14b8a006-a42f-4eea-badb-6fcffb184565-kube-api-access-9zdzr\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.534934 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.534911 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjlc8\"/\"openshift-service-ca.crt\"" Jul 08 19:45:24.535035 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.534959 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjlc8\"/\"kube-root-ca.crt\"" Jul 08 19:45:24.536346 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.536319 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sjlc8\"/\"default-dockercfg-mwzxk\"" Jul 08 19:45:24.541280 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.541259 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m"] Jul 08 19:45:24.633960 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.633926 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/14b8a006-a42f-4eea-badb-6fcffb184565-proc\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.634144 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.634008 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14b8a006-a42f-4eea-badb-6fcffb184565-sys\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.634144 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.634032 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zdzr\" (UniqueName: \"kubernetes.io/projected/14b8a006-a42f-4eea-badb-6fcffb184565-kube-api-access-9zdzr\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.634144 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.634074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/14b8a006-a42f-4eea-badb-6fcffb184565-podres\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.634144 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.634097 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14b8a006-a42f-4eea-badb-6fcffb184565-lib-modules\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.634144 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.634100 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/14b8a006-a42f-4eea-badb-6fcffb184565-sys\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.634144 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.634100 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/14b8a006-a42f-4eea-badb-6fcffb184565-proc\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.634450 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.634194 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/14b8a006-a42f-4eea-badb-6fcffb184565-podres\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.634450 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.634245 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/14b8a006-a42f-4eea-badb-6fcffb184565-lib-modules\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.641936 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.641909 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zdzr\" (UniqueName: \"kubernetes.io/projected/14b8a006-a42f-4eea-badb-6fcffb184565-kube-api-access-9zdzr\") pod \"perf-node-gather-daemonset-6b62m\" (UID: \"14b8a006-a42f-4eea-badb-6fcffb184565\") " pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.843021 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.842945 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:24.886903 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.886831 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/1.log" Jul 08 19:45:24.896418 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.896392 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8rx2k_7b69a250-2ddf-4409-a5d6-d32e1930554f/console-operator/2.log" Jul 08 19:45:24.977016 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:24.976991 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m"] Jul 08 19:45:24.979545 ip-10-0-138-105 kubenswrapper[2554]: W0708 19:45:24.979518 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod14b8a006_a42f_4eea_badb_6fcffb184565.slice/crio-6b58cd9761cda3e61fafba47a92f1cf61909a9950ceb6313ae1f1ad08d52aafa WatchSource:0}: Error finding container 6b58cd9761cda3e61fafba47a92f1cf61909a9950ceb6313ae1f1ad08d52aafa: Status 404 returned error can't find the container with id 6b58cd9761cda3e61fafba47a92f1cf61909a9950ceb6313ae1f1ad08d52aafa Jul 08 19:45:25.225115 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:25.225079 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" event={"ID":"14b8a006-a42f-4eea-badb-6fcffb184565","Type":"ContainerStarted","Data":"7c62585bc89d05239ce05f352c70f11faa5c1e727f9c959f62d3cad5701e8565"} Jul 08 19:45:25.225283 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:25.225137 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" event={"ID":"14b8a006-a42f-4eea-badb-6fcffb184565","Type":"ContainerStarted","Data":"6b58cd9761cda3e61fafba47a92f1cf61909a9950ceb6313ae1f1ad08d52aafa"} Jul 08 19:45:25.225283 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:25.225166 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:25.243237 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:25.243192 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" podStartSLOduration=1.243178466 podStartE2EDuration="1.243178466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:25.242233532 +0000 UTC m=+2406.955295541" watchObservedRunningTime="2026-07-08 19:45:25.243178466 +0000 UTC m=+2406.956240475" Jul 08 19:45:26.014134 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:26.014095 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-hzg7d_a99ba669-fe7c-4d86-b082-4fb33c727b3b/volume-data-source-validator/0.log" Jul 08 19:45:27.180361 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:27.180325 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d7qds_2679ed35-5fc8-44e5-a711-464cc4147348/dns/0.log" Jul 08 19:45:27.199445 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:27.199418 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d7qds_2679ed35-5fc8-44e5-a711-464cc4147348/kube-rbac-proxy/0.log" Jul 08 19:45:27.282389 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:27.282354 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hrtph_9fc4fdec-4266-4d3f-84f2-d8af4e5b6088/dns-node-resolver/0.log" Jul 08 19:45:27.843137 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:27.843106 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hcvlp_9a7e5565-004d-4074-afba-446e2b1aa5bb/node-ca/0.log" Jul 08 19:45:29.115817 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:29.115789 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-848485689f-bcs5k_67ff27b3-847a-430f-ba0a-c598ea1f84b7/router/0.log" Jul 08 19:45:29.864293 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:29.864266 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jdbfs_f740612f-3c23-4bc5-b121-6066ca21933d/serve-healthcheck-canary/0.log" Jul 08 19:45:30.302866 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:30.302833 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-dt7sg_43812205-6218-459c-9ea3-02fc8c11375f/insights-operator/0.log" Jul 08 19:45:30.303569 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:30.303552 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-dt7sg_43812205-6218-459c-9ea3-02fc8c11375f/insights-operator/1.log" Jul 08 19:45:30.323554 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:30.323535 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxj44_52354b96-af19-4e4a-b38b-a922ba912690/kube-rbac-proxy/0.log" Jul 08 19:45:30.343644 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:30.343623 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxj44_52354b96-af19-4e4a-b38b-a922ba912690/exporter/0.log" Jul 08 19:45:30.365134 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:30.365092 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxj44_52354b96-af19-4e4a-b38b-a922ba912690/extractor/0.log" Jul 08 19:45:31.238770 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:31.238739 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sjlc8/perf-node-gather-daemonset-6b62m" Jul 08 19:45:31.562940 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:31.562858 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:31.665084 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:31.665050 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8bbxh_c448e581-9ca2-401c-a035-4452fda297b2/konnectivity-agent/0.log" limit=1024 Jul 08 19:45:32.782578 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:32.782542 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r48hq_3396f1eb-103f-4818-8303-785e5f8cd947/manager/0.log" Jul 08 19:45:33.185343 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:33.185268 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6667fbd97f-s4wvc_2ae4bb01-23d2-4368-98b9-5af90fa3151b/manager/0.log" Jul 08 19:45:33.201086 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:33.201058 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6667fbd97f-s4wvc_2ae4bb01-23d2-4368-98b9-5af90fa3151b/copy-manifests/0.log" Jul 08 19:45:34.531454 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:34.531422 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f5b6f7879-q9kcz_887eda84-4d64-4caf-a291-7f783f54d23a/manager/0.log" Jul 08 19:45:35.337394 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:35.337369 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-848485689f-bcs5k_67ff27b3-847a-430f-ba0a-c598ea1f84b7/router/0.log" Jul 08 19:45:36.751000 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:36.750968 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-848485689f-bcs5k_67ff27b3-847a-430f-ba0a-c598ea1f84b7/router/0.log" Jul 08 19:45:40.159609 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:40.159561 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-ctxkn_c4c20110-58e2-40d1-8740-de379ef5108a/kube-storage-version-migrator-operator/1.log" Jul 08 19:45:40.161510 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:40.161483 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-ctxkn_c4c20110-58e2-40d1-8740-de379ef5108a/kube-storage-version-migrator-operator/0.log" Jul 08 19:45:41.201296 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:41.201266 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8k58p_2b121dd4-c5ff-4d04-9599-aad1ff354619/kube-multus/0.log" Jul 08 19:45:41.516260 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:41.516234 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zghgb_b0f41c78-6dd9-4703-a789-2e8b8588dd34/kube-multus-additional-cni-plugins/0.log" Jul 08 19:45:41.535036 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:41.535006 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zghgb_b0f41c78-6dd9-4703-a789-2e8b8588dd34/egress-router-binary-copy/0.log" Jul 08 19:45:41.557539 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:41.557513 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zghgb_b0f41c78-6dd9-4703-a789-2e8b8588dd34/cni-plugins/0.log" Jul 08 19:45:41.577639 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:41.577619 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zghgb_b0f41c78-6dd9-4703-a789-2e8b8588dd34/bond-cni-plugin/0.log" Jul 08 19:45:41.600712 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:41.600689 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zghgb_b0f41c78-6dd9-4703-a789-2e8b8588dd34/routeoverride-cni/0.log" Jul 08 19:45:41.621905 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:41.621882 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zghgb_b0f41c78-6dd9-4703-a789-2e8b8588dd34/whereabouts-cni-bincopy/0.log" Jul 08 19:45:41.643270 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:41.643248 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zghgb_b0f41c78-6dd9-4703-a789-2e8b8588dd34/whereabouts-cni/0.log" Jul 08 19:45:41.792800 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:41.792716 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n9cvr_f8410cd6-d550-4965-b769-0e74878b627c/network-metrics-daemon/0.log" Jul 08 19:45:41.810455 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:41.810435 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n9cvr_f8410cd6-d550-4965-b769-0e74878b627c/kube-rbac-proxy/0.log" Jul 08 19:45:42.596728 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:42.596701 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l49h6_8a93ffa9-7327-4a99-b3ba-bff5597b10f7/ovn-controller/0.log" Jul 08 19:45:42.613195 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:42.613172 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l49h6_8a93ffa9-7327-4a99-b3ba-bff5597b10f7/ovn-acl-logging/0.log" Jul 08 19:45:42.636559 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:42.636526 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l49h6_8a93ffa9-7327-4a99-b3ba-bff5597b10f7/kube-rbac-proxy-node/0.log" Jul 08 19:45:42.655901 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:42.655865 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l49h6_8a93ffa9-7327-4a99-b3ba-bff5597b10f7/kube-rbac-proxy-ovn-metrics/0.log" Jul 08 19:45:42.673035 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:42.673015 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l49h6_8a93ffa9-7327-4a99-b3ba-bff5597b10f7/northd/0.log" Jul 08 19:45:42.691652 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:42.691633 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l49h6_8a93ffa9-7327-4a99-b3ba-bff5597b10f7/nbdb/0.log" Jul 08 19:45:42.712076 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:42.712054 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l49h6_8a93ffa9-7327-4a99-b3ba-bff5597b10f7/sbdb/0.log" Jul 08 19:45:42.778813 ip-10-0-138-105 kubenswrapper[2554]: I0708 19:45:42.778777 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l49h6_8a93ffa9-7327-4a99-b3ba-bff5597b10f7/ovnkube-controller/0.log"