Jul 16 19:58:18.535519 ip-10-0-134-169 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 19:58:18.535529 ip-10-0-134-169 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 19:58:18.535537 ip-10-0-134-169 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 19:58:18.535854 ip-10-0-134-169 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 19:58:28.549926 ip-10-0-134-169 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 19:58:28.549947 ip-10-0-134-169 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b641a6d97c8b4bd39f9e4ee5e6e309a2 -- Jul 16 20:00:03.419119 ip-10-0-134-169 systemd[1]: Starting Kubernetes Kubelet... Jul 16 20:00:03.831684 ip-10-0-134-169 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 20:00:03.831684 ip-10-0-134-169 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 20:00:03.831684 ip-10-0-134-169 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 20:00:03.831684 ip-10-0-134-169 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 20:00:03.831684 ip-10-0-134-169 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 20:00:03.832415 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.831775 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 20:00:03.837682 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837658 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 20:00:03.837682 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837680 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 20:00:03.837682 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837684 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837687 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837690 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837693 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837696 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837699 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837701 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837704 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837708 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837710 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837723 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837728 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837732 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837736 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837740 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837744 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837747 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837749 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837753 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 20:00:03.837794 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837756 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837759 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837773 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837776 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837779 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837782 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837784 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837787 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837789 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837792 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837795 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837798 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837803 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837808 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837811 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837814 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837817 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837844 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837848 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837851 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 20:00:03.838245 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837854 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837857 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837860 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837862 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837871 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837874 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837876 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837879 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837881 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837884 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837886 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837889 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837892 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837895 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837898 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837901 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837904 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837907 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837909 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837912 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 20:00:03.838735 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837914 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837917 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837919 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837922 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837925 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837927 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837930 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837932 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837935 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837937 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837940 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837943 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837945 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837948 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837951 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837953 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837956 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837964 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837967 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837971 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 20:00:03.839243 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837973 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837976 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837978 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837981 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837984 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837987 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837990 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837992 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837995 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.837997 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838000 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838002 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838005 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838008 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838010 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838013 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838016 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838018 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838888 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838899 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 20:00:03.839709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838903 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838907 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838911 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838916 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838919 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838922 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838953 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838970 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838974 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838980 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838984 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838989 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838992 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838995 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.838999 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839002 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839004 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839007 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839010 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839013 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 20:00:03.840236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839015 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839018 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839021 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839024 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839031 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839036 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839039 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839042 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839045 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839048 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839051 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839054 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839057 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839060 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839063 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839066 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839069 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839071 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839075 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 20:00:03.840722 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839077 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839080 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839083 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839086 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839088 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839091 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839094 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839096 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839099 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839102 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839104 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839107 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839109 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839112 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839114 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839117 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839119 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839122 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839125 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839128 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 20:00:03.841208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839130 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839132 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839135 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839137 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839141 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839147 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839150 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839152 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839155 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839157 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839160 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839162 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839165 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839168 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839171 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839174 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839176 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839179 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839181 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839184 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 20:00:03.841709 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839187 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839189 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839191 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839194 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839196 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839199 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839201 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839204 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839206 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839208 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839212 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839215 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839218 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839221 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839224 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839227 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839230 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839232 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839664 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839670 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 16 20:00:03.842250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839673 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839676 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839679 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839682 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839685 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839688 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839691 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839694 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839697 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839699 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839702 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839705 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839708 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839710 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839713 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839715 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839718 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839721 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839723 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839726 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 20:00:03.842801 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839729 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839731 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839735 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839739 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839742 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839745 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839749 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839753 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839757 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839760 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839778 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839781 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839785 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839790 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839793 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839797 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839800 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839803 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 20:00:03.843317 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839806 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839809 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839813 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839816 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839819 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839821 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839824 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839827 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839831 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839833 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839836 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839839 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839841 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839844 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839846 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839849 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839852 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839855 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839858 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 20:00:03.843747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839861 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839864 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839867 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839870 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839874 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839876 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839879 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839881 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839884 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839886 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839889 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839892 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839894 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839897 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839899 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839902 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839905 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839907 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839910 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839912 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 20:00:03.844223 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839915 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839917 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839920 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839922 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839925 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839928 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839931 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839934 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839936 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839938 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839945 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839948 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839951 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839953 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839956 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839959 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839961 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839964 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839966 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.839969 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840045 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 20:00:03.844710 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840053 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840059 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840063 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840068 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840071 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840076 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840081 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840084 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840087 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840091 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840094 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840098 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840101 2575 flags.go:64] FLAG: --cgroup-root="" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840104 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840107 2575 flags.go:64] FLAG: --client-ca-file="" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840110 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840113 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840118 2575 flags.go:64] FLAG: --cluster-domain="" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840121 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840124 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840127 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840132 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840146 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 20:00:03.845228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840151 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840155 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840159 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840162 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840166 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840169 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840172 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840175 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840180 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840183 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840186 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840189 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840192 2575 flags.go:64] FLAG: --enable-server="true" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840194 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840199 2575 flags.go:64] FLAG: --event-burst="100" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840202 2575 flags.go:64] FLAG: --event-qps="50" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840205 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840209 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840212 2575 flags.go:64] FLAG: --eviction-hard="" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840216 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840219 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840222 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840225 2575 flags.go:64] FLAG: --eviction-soft="" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840228 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840231 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 20:00:03.845824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840236 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840239 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840242 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840246 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840249 2575 flags.go:64] FLAG: --feature-gates="" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840255 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840258 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840261 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840265 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840268 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840271 2575 flags.go:64] FLAG: --help="false" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840274 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-134-169.ec2.internal" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840277 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840280 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840283 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840287 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840291 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840293 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840296 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840299 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840302 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840305 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840308 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840311 2575 flags.go:64] FLAG: --kube-reserved="" Jul 16 20:00:03.846470 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840314 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840317 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840320 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840323 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840326 2575 flags.go:64] FLAG: --lock-file="" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840329 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840332 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840335 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840342 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840345 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840348 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840351 2575 flags.go:64] FLAG: --logging-format="text" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840355 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840360 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840363 2575 flags.go:64] FLAG: --manifest-url="" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840366 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840370 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840374 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840379 2575 flags.go:64] FLAG: --max-pods="110" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840382 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840385 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840388 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840391 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840394 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840397 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 20:00:03.847075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840400 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840408 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840411 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840414 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840417 2575 flags.go:64] FLAG: --pod-cidr="" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840420 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840425 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840428 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840432 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840434 2575 flags.go:64] FLAG: --port="10250" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840438 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840441 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07dee24b0576ec12f" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840444 2575 flags.go:64] FLAG: --qos-reserved="" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840447 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840450 2575 flags.go:64] FLAG: --register-node="true" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840454 2575 flags.go:64] FLAG: --register-with-taints="" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840458 2575 flags.go:64] FLAG: --registry-burst="10" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840461 2575 flags.go:64] FLAG: --registry-qps="5" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840464 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840466 2575 flags.go:64] FLAG: --reserved-memory="" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840470 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840475 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840478 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840481 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840484 2575 flags.go:64] FLAG: --runonce="false" Jul 16 20:00:03.847751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840487 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840490 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840493 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840496 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840499 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840502 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840506 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840509 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840511 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840514 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840517 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840520 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840523 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840526 2575 flags.go:64] FLAG: --system-cgroups="" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840529 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840534 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840537 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840540 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840543 2575 flags.go:64] FLAG: --tls-min-version="" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840546 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840549 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840552 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840556 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840559 2575 flags.go:64] FLAG: --v="2" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840563 2575 flags.go:64] FLAG: --version="false" Jul 16 20:00:03.848729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840568 2575 flags.go:64] FLAG: --vmodule="" Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840571 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.840575 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840704 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840709 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840712 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840715 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840718 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840722 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840725 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840728 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840731 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840734 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840737 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840739 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840743 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840745 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840748 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840750 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840753 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 20:00:03.849370 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840755 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840758 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840777 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840780 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840783 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840785 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840788 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840791 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840794 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840798 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840801 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840804 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840806 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840809 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840811 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840817 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840820 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840823 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840826 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840828 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 20:00:03.849959 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840831 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840834 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840837 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840840 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840843 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840846 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840849 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840851 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840854 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840857 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840861 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840864 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840868 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840870 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840873 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840876 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840878 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840881 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840883 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840886 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 20:00:03.850446 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840888 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840892 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840895 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840897 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840900 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840903 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840905 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840910 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840913 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840916 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840919 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840921 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840924 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840927 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840930 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840933 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840935 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840939 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840941 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 20:00:03.850955 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840944 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840946 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840949 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840952 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840955 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840958 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840962 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840965 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840968 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840972 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840975 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840978 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840980 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840985 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840991 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840994 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.840997 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.841000 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.841002 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 20:00:03.851457 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.841005 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.841009 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.841011 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.841014 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.841645 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.850515 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.850538 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.851436 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.851448 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851513 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851519 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851523 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851526 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851529 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851532 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 20:00:03.851931 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851535 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851538 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851541 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851544 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851546 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851549 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851552 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851555 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851557 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851560 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851562 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851565 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851568 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851570 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851573 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851576 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851579 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851582 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851584 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851587 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 20:00:03.852314 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851589 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851592 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851595 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851599 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851602 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851605 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851607 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851610 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851612 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851616 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851621 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851624 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851627 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851630 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851633 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851636 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851638 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851641 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851643 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 20:00:03.852795 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851646 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851649 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851652 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851655 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851658 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851660 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851663 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851665 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851668 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851671 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851675 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851679 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851682 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851685 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851687 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851690 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851693 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851696 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851698 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 20:00:03.853250 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851701 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851704 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851706 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851709 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851711 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851714 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851717 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851719 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851722 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851725 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851727 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851730 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851732 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851735 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851737 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851740 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851743 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851745 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851747 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851750 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 20:00:03.853715 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851753 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851756 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851759 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851771 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851774 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851777 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851779 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851782 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851786 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851790 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851793 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851797 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851800 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851803 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851806 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 20:00:03.854212 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.851811 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851933 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851938 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851941 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851945 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851947 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851950 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851953 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851956 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851958 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851961 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851964 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851967 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851970 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851973 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851976 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851978 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851981 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851985 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851987 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 20:00:03.854606 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851990 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851993 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851995 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.851998 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852000 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852003 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852006 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852008 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852011 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852014 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852017 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852020 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852023 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852026 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852030 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852033 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852036 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852039 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852042 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852045 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 20:00:03.855099 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852047 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852050 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852052 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852055 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852058 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852060 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852064 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852067 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852069 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852072 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852075 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852078 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852081 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852083 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852086 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852088 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852091 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852093 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852096 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 20:00:03.855573 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852098 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852101 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852103 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852106 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852108 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852111 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852113 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852116 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852119 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852121 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852124 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852126 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852129 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852131 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852134 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852136 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852139 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852141 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852144 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852146 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 20:00:03.856044 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852150 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852153 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852155 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852158 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852161 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852163 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852167 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852171 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852175 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852178 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852181 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852184 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852187 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852190 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852193 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852195 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852198 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852200 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852203 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 20:00:03.856529 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852205 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 20:00:03.857007 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:03.852207 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 20:00:03.857007 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.852212 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 20:00:03.857007 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.852345 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 20:00:03.857007 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.854450 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 20:00:03.857007 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.855852 2575 server.go:1019] "Starting client certificate rotation" Jul 16 20:00:03.857007 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.855950 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 20:00:03.857007 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.855982 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 20:00:03.859309 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.859293 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 20:00:03.860652 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.860634 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 20:00:03.870621 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.870601 2575 log.go:25] "Validated CRI v1 runtime API" Jul 16 20:00:03.874002 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.873982 2575 log.go:25] "Validated CRI v1 image API" Jul 16 20:00:03.875752 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.875737 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 20:00:03.878343 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.878323 2575 fs.go:135] Filesystem UUIDs: map[738efa10-9da6-44b4-a36e-49c59f84c8ac:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f7042838-93de-41f9-aaa4-6499d102a203:/dev/nvme0n1p3] Jul 16 20:00:03.878391 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.878344 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 20:00:03.884445 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.884311 2575 manager.go:216] Machine: {Timestamp:2026-07-16 20:00:03.883039686 +0000 UTC m=+0.346392708 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108228 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26500a3d57b0970ecd0acd1ba761b2 SystemUUID:ec26500a-3d57-b097-0ecd-0acd1ba761b2 BootID:b641a6d9-7c8b-4bd3-9f9e-4ee5e6e309a2 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:f5:83:f5:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:f5:83:f5:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:97:23:59:59:cb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 20:00:03.884445 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.884427 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 20:00:03.884624 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.884548 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 20:00:03.886618 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.886598 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 20:00:03.887672 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.887643 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 20:00:03.887829 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.887675 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-169.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 20:00:03.888336 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.888320 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 20:00:03.888336 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.888334 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 20:00:03.888336 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.888342 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 20:00:03.889562 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.889550 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 20:00:03.890848 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.890837 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 20:00:03.893497 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.893484 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 16 20:00:03.893677 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.893667 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 20:00:03.893708 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.893700 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 16 20:00:03.893744 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.893713 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 20:00:03.893744 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.893725 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 20:00:03.893744 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.893735 2575 kubelet.go:398] "Adding apiserver pod source" Jul 16 20:00:03.893852 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.893745 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 20:00:03.894157 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.894145 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 20:00:03.894195 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.894164 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 20:00:03.896416 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.896399 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 20:00:03.898231 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.898217 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 20:00:03.898278 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.898248 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 20:00:03.899385 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.899371 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 20:00:03.899438 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.899396 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 20:00:03.899438 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.899405 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 20:00:03.899438 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.899415 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 20:00:03.899438 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.899428 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 20:00:03.899438 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.899436 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 20:00:03.899567 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.899448 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 20:00:03.899567 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.899457 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 20:00:03.899567 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.899468 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 20:00:03.899567 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.899484 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 20:00:03.899567 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.899497 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 20:00:03.899567 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.899505 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 20:00:03.900337 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.900326 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 20:00:03.900377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.900339 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 20:00:03.903424 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.903403 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-169.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 20:00:03.903424 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:03.903416 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-169.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 20:00:03.903553 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:03.903474 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 20:00:03.903710 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.903697 2575 server.go:1268] "Started kubelet" Jul 16 20:00:03.903842 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.903795 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 20:00:03.903916 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.903870 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 20:00:03.904155 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.904124 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 20:00:03.904536 ip-10-0-134-169 systemd[1]: Started Kubernetes Kubelet. Jul 16 20:00:03.905529 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.905500 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 20:00:03.906608 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.906589 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 16 20:00:03.908759 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:03.908740 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 20:00:03.910558 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:03.909710 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-169.ec2.internal.18c2dd8de58fbc6e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-169.ec2.internal,UID:ip-10-0-134-169.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-169.ec2.internal,},FirstTimestamp:2026-07-16 20:00:03.90366731 +0000 UTC m=+0.367020333,LastTimestamp:2026-07-16 20:00:03.90366731 +0000 UTC m=+0.367020333,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-169.ec2.internal,}" Jul 16 20:00:03.911635 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.911617 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 20:00:03.911732 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.911677 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 20:00:03.911798 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:03.911731 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:03.912165 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.912148 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 20:00:03.912701 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.912453 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 20:00:03.912797 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.912703 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 20:00:03.912921 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.912899 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 16 20:00:03.912982 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.912931 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 16 20:00:03.913065 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.913048 2575 factory.go:55] Registering systemd factory Jul 16 20:00:03.913119 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.913071 2575 factory.go:223] Registration of the systemd container factory successfully Jul 16 20:00:03.913378 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.913366 2575 factory.go:153] Registering CRI-O factory Jul 16 20:00:03.913434 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.913382 2575 factory.go:223] Registration of the crio container factory successfully Jul 16 20:00:03.913479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.913437 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 20:00:03.913479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.913461 2575 factory.go:103] Registering Raw factory Jul 16 20:00:03.913479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.913477 2575 manager.go:1196] Started watching for new ooms in manager Jul 16 20:00:03.914169 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.914140 2575 manager.go:349] Starting recovery of all containers Jul 16 20:00:03.916645 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:03.916376 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 20:00:03.916645 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:03.916496 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-169.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 20:00:03.921217 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.921175 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 20:00:03.925971 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.925952 2575 manager.go:354] Recovery completed Jul 16 20:00:03.927787 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:03.927730 2575 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 16 20:00:03.930882 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.930864 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:00:03.931628 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.931609 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zg8j8" Jul 16 20:00:03.932879 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.932864 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:00:03.932937 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.932893 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:00:03.932937 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.932903 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:00:03.933426 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.933411 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 20:00:03.933426 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.933419 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:00:03.933426 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.933425 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 20:00:03.933603 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.933444 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 16 20:00:03.934230 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.934178 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:00:03.934311 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.934246 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:00:03.934311 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.934262 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:00:03.934777 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.934753 2575 policy_none.go:49] "None policy: Start" Jul 16 20:00:03.934834 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.934782 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 20:00:03.934834 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.934793 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 20:00:03.935213 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:03.935132 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-169.ec2.internal.18c2dd8de74d7c44 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-169.ec2.internal,UID:ip-10-0-134-169.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-169.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-169.ec2.internal,},FirstTimestamp:2026-07-16 20:00:03.93287994 +0000 UTC m=+0.396232962,LastTimestamp:2026-07-16 20:00:03.93287994 +0000 UTC m=+0.396232962,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-169.ec2.internal,}" Jul 16 20:00:03.935738 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.935722 2575 policy_none.go:47] "Start" Jul 16 20:00:03.939673 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.939534 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zg8j8" Jul 16 20:00:03.944467 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:03.944397 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-169.ec2.internal.18c2dd8de74dc387 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-169.ec2.internal,UID:ip-10-0-134-169.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-169.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-169.ec2.internal,},FirstTimestamp:2026-07-16 20:00:03.932898183 +0000 UTC m=+0.396251205,LastTimestamp:2026-07-16 20:00:03.932898183 +0000 UTC m=+0.396251205,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-169.ec2.internal,}" Jul 16 20:00:03.970402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.970385 2575 manager.go:337] "Starting Device Plugin manager" Jul 16 20:00:03.979786 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:03.970432 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 20:00:03.979786 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.970446 2575 server.go:87] "Starting device plugin registration server" Jul 16 20:00:03.979786 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.970760 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 20:00:03.979786 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.970787 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 20:00:03.979786 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.970896 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 20:00:03.979786 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.970990 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 20:00:03.979786 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:03.970997 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 20:00:03.979786 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:03.971600 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 20:00:03.979786 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:03.971655 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:04.011667 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.011638 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 20:00:04.011832 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.011688 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 20:00:04.011832 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.011713 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 20:00:04.011832 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:04.011753 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 20:00:04.014173 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.014147 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 20:00:04.071148 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.071120 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:00:04.072093 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.072077 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:00:04.072185 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.072107 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:00:04.072185 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.072117 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:00:04.072185 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.072140 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.078695 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.078679 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.078743 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:04.078702 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-169.ec2.internal\": node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:04.106696 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:04.106612 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:04.112663 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.112632 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal"] Jul 16 20:00:04.112741 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.112707 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:00:04.113196 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.113175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cf01e38c3754b228f401669434c503a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal\" (UID: \"6cf01e38c3754b228f401669434c503a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.113294 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.113201 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cf01e38c3754b228f401669434c503a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal\" (UID: \"6cf01e38c3754b228f401669434c503a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.113686 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.113669 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:00:04.113776 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.113698 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:00:04.113776 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.113708 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:00:04.114924 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.114912 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:00:04.115050 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.115025 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.115093 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.115058 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:00:04.115660 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.115643 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:00:04.115739 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.115671 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:00:04.115739 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.115680 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:00:04.115739 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.115646 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:00:04.115905 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.115753 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:00:04.115905 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.115786 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:00:04.116791 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.116777 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.116838 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.116808 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:00:04.117529 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.117512 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:00:04.117613 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.117537 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:00:04.117613 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.117545 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:00:04.137407 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:04.137386 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-169.ec2.internal\" not found" node="ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.138566 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:04.138552 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-169.ec2.internal\" not found" node="ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.207347 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:04.207308 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:04.213627 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.213600 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cf01e38c3754b228f401669434c503a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal\" (UID: \"6cf01e38c3754b228f401669434c503a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.213735 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.213636 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cf01e38c3754b228f401669434c503a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal\" (UID: \"6cf01e38c3754b228f401669434c503a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.213735 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.213691 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cf01e38c3754b228f401669434c503a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal\" (UID: \"6cf01e38c3754b228f401669434c503a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.213735 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.213710 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cf01e38c3754b228f401669434c503a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal\" (UID: \"6cf01e38c3754b228f401669434c503a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.307877 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:04.307783 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:04.314085 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.314058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63a9f66a5a3b782767a0da7bfdbce0f8-config\") pod \"kube-apiserver-proxy-ip-10-0-134-169.ec2.internal\" (UID: \"63a9f66a5a3b782767a0da7bfdbce0f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.408630 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:04.408535 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:04.414903 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.414874 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63a9f66a5a3b782767a0da7bfdbce0f8-config\") pod \"kube-apiserver-proxy-ip-10-0-134-169.ec2.internal\" (UID: \"63a9f66a5a3b782767a0da7bfdbce0f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.415016 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.414943 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63a9f66a5a3b782767a0da7bfdbce0f8-config\") pod \"kube-apiserver-proxy-ip-10-0-134-169.ec2.internal\" (UID: \"63a9f66a5a3b782767a0da7bfdbce0f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.441056 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.441028 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.441151 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.441028 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal" Jul 16 20:00:04.509384 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:04.509334 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:04.609937 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:04.609900 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:04.710589 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:04.710500 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:04.727681 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.727649 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 20:00:04.810666 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:04.810623 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:04.855129 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.855092 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 20:00:04.855732 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.855279 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 20:00:04.855732 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.855308 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 20:00:04.910819 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:04.910749 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:04.936252 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:04.936218 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf01e38c3754b228f401669434c503a.slice/crio-fdb77c6b1a6f8439b1982154e3e745e259b30f55b918c2893962778a971c2d71 WatchSource:0}: Error finding container fdb77c6b1a6f8439b1982154e3e745e259b30f55b918c2893962778a971c2d71: Status 404 returned error can't find the container with id fdb77c6b1a6f8439b1982154e3e745e259b30f55b918c2893962778a971c2d71 Jul 16 20:00:04.940821 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.940803 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 20:00:04.943627 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.943595 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 19:55:03 +0000 UTC" deadline="2027-12-17 23:15:37.23578008 +0000 UTC" Jul 16 20:00:04.943627 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:04.943627 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12459h15m32.292156099s" Jul 16 20:00:05.010995 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:05.010905 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:05.015318 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.015272 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" event={"ID":"6cf01e38c3754b228f401669434c503a","Type":"ContainerStarted","Data":"fdb77c6b1a6f8439b1982154e3e745e259b30f55b918c2893962778a971c2d71"} Jul 16 20:00:05.110597 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.110561 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:00:05.111082 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:05.111069 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:05.111971 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.111957 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:00:05.112026 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.111986 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:00:05.112026 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.111999 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:00:05.211937 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:05.211901 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-169.ec2.internal\" not found" Jul 16 20:00:05.245992 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.245959 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 20:00:05.279083 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.279012 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 20:00:05.312509 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.312476 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" Jul 16 20:00:05.327168 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.327139 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 20:00:05.328712 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.328695 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal" Jul 16 20:00:05.335279 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.335258 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 20:00:05.895311 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.895277 2575 apiserver.go:52] "Watching apiserver" Jul 16 20:00:05.903587 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.903550 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 20:00:05.904985 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.904959 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-zstjw","openshift-ovn-kubernetes/ovnkube-node-6pgg5","kube-system/global-pull-secret-syncer-fk2vw","kube-system/konnectivity-agent-9c6q8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv","openshift-dns/node-resolver-hs9v2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal","openshift-multus/multus-additional-cni-plugins-pwhmx","openshift-multus/network-metrics-daemon-shcvc","kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal","openshift-cluster-node-tuning-operator/tuned-l9smn","openshift-image-registry/node-ca-k8pmr","openshift-multus/multus-tb28g","openshift-network-diagnostics/network-check-target-dflz4"] Jul 16 20:00:05.906455 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.906428 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.907620 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.907600 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.908976 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.908954 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:05.909091 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:05.909031 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:05.909371 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.909351 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4smtm\"" Jul 16 20:00:05.909818 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.909709 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 20:00:05.909818 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.909723 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 20:00:05.909818 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.909790 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 20:00:05.909818 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.909794 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 20:00:05.910202 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.910187 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9c6q8" Jul 16 20:00:05.911402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.911360 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 20:00:05.911502 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.911480 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 20:00:05.911556 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.911527 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 20:00:05.911651 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.911531 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 20:00:05.912991 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.911641 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 20:00:05.912991 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.912303 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tklct\"" Jul 16 20:00:05.912991 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.912315 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 20:00:05.912991 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.912916 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 20:00:05.913228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.912993 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 20:00:05.913228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.912994 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gc7dg\"" Jul 16 20:00:05.913324 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.913257 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 20:00:05.913856 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.913446 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:05.914817 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.914302 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hs9v2" Jul 16 20:00:05.915712 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.915693 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zstjw" Jul 16 20:00:05.916305 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.916285 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 20:00:05.916528 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.916287 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 20:00:05.916643 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.916303 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 20:00:05.916699 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.916416 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r2jcn\"" Jul 16 20:00:05.917145 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.916949 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 20:00:05.917145 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.917077 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8b2kh\"" Jul 16 20:00:05.917145 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.917139 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 20:00:05.917589 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.917340 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:05.918219 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.918133 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 20:00:05.918725 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.918367 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 20:00:05.918725 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.918595 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 20:00:05.918878 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.918728 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:05.918878 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.918807 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v9cdl\"" Jul 16 20:00:05.918878 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:05.918816 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:05.920021 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.920001 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 20:00:05.920136 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.920095 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 20:00:05.920388 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.920369 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:05.920497 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:05.920447 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:05.920777 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.920745 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-58v9s\"" Jul 16 20:00:05.921845 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.921827 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:05.922074 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-registration-dir\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:05.922183 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-cnibin\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.922183 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-multus-conf-dir\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.922183 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-kubelet\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.922334 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63c4b887-082c-4c31-b721-c9ee009e0195-env-overrides\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.922334 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922218 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ffws\" (UniqueName: \"kubernetes.io/projected/63c4b887-082c-4c31-b721-c9ee009e0195-kube-api-access-4ffws\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.922334 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922258 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/115a161c-beda-456d-b996-3eb637a04e98-agent-certs\") pod \"konnectivity-agent-9c6q8\" (UID: \"115a161c-beda-456d-b996-3eb637a04e98\") " pod="kube-system/konnectivity-agent-9c6q8" Jul 16 20:00:05.922334 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922294 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-var-lib-openvswitch\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.922334 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922319 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:05.922569 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922340 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-device-dir\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:05.922569 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922362 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-etc-selinux\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:05.922569 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922396 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a935900-aa47-440f-b2e7-03b2161b16e9-cni-binary-copy\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.922569 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-multus-socket-dir-parent\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.922569 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztcwr\" (UniqueName: \"kubernetes.io/projected/6a935900-aa47-440f-b2e7-03b2161b16e9-kube-api-access-ztcwr\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.922569 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1d737e2-027f-4074-b311-f888a3d6c24a-kubelet-config\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:05.922569 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:05.922569 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922534 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9k7m\" (UniqueName: \"kubernetes.io/projected/39dc1420-5600-4ce3-9b1a-17327be79793-kube-api-access-r9k7m\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:05.922917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-run-k8s-cni-cncf-io\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.922917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922679 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-hostroot\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.922917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-etc-kubernetes\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.922917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922721 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-run-ovn\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.922917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922743 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-node-log\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.922917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.922917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922826 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-run-multus-certs\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.922917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922858 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-systemd-units\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.922917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-log-socket\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.922917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922907 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-cni-bin\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.923268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922929 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-cni-netd\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.923268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922953 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63c4b887-082c-4c31-b721-c9ee009e0195-ovn-node-metrics-cert\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.923268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.922979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1d737e2-027f-4074-b311-f888a3d6c24a-dbus\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:05.923268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/115a161c-beda-456d-b996-3eb637a04e98-konnectivity-ca\") pod \"konnectivity-agent-9c6q8\" (UID: \"115a161c-beda-456d-b996-3eb637a04e98\") " pod="kube-system/konnectivity-agent-9c6q8" Jul 16 20:00:05.923268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923045 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-run-netns\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.923268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923091 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-var-lib-cni-bin\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.923268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923116 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63c4b887-082c-4c31-b721-c9ee009e0195-ovnkube-config\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.923268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923142 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63c4b887-082c-4c31-b721-c9ee009e0195-ovnkube-script-lib\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.923268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc797cd1-de45-4071-85e2-8c551bee19af-hosts-file\") pod \"node-resolver-hs9v2\" (UID: \"dc797cd1-de45-4071-85e2-8c551bee19af\") " pod="openshift-dns/node-resolver-hs9v2" Jul 16 20:00:05.923268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923195 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k8pmr" Jul 16 20:00:05.923268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923222 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc797cd1-de45-4071-85e2-8c551bee19af-tmp-dir\") pod \"node-resolver-hs9v2\" (UID: \"dc797cd1-de45-4071-85e2-8c551bee19af\") " pod="openshift-dns/node-resolver-hs9v2" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923281 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfx97\" (UniqueName: \"kubernetes.io/projected/dc797cd1-de45-4071-85e2-8c551bee19af-kube-api-access-cfx97\") pod \"node-resolver-hs9v2\" (UID: \"dc797cd1-de45-4071-85e2-8c551bee19af\") " pod="openshift-dns/node-resolver-hs9v2" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-system-cni-dir\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a935900-aa47-440f-b2e7-03b2161b16e9-multus-daemon-config\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923383 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-slash\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-run-systemd\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-run-openvswitch\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923454 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-run-ovn-kubernetes\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-socket-dir\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923586 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-sys-fs\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923629 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-etc-openvswitch\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-multus-cni-dir\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923677 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-os-release\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923683 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923719 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-var-lib-cni-multus\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923750 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-var-lib-kubelet\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:05.923907 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.923790 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-run-netns\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:05.924633 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.924082 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 20:00:05.924633 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.924310 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 20:00:05.924633 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.924328 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pp4gc\"" Jul 16 20:00:05.925304 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.925286 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 20:00:05.925632 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.925606 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 20:00:05.925890 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.925871 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wcg4k\"" Jul 16 20:00:05.925950 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.925912 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 20:00:05.942963 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.942938 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p4xkc" Jul 16 20:00:05.950623 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:05.950583 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p4xkc" Jul 16 20:00:06.013875 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.013846 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 20:00:06.024147 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024114 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bxcr\" (UniqueName: \"kubernetes.io/projected/77b2afb3-a310-4f8b-afc1-e7866f997196-kube-api-access-5bxcr\") pod \"network-metrics-daemon-shcvc\" (UID: \"77b2afb3-a310-4f8b-afc1-e7866f997196\") " pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:06.024147 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-hostroot\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.024402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024188 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-etc-kubernetes\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.024402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.024402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024233 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/034aaa90-6ffb-454d-9c1b-8c43d45e428f-host\") pod \"node-ca-k8pmr\" (UID: \"034aaa90-6ffb-454d-9c1b-8c43d45e428f\") " pod="openshift-image-registry/node-ca-k8pmr" Jul 16 20:00:06.024402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024289 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-etc-kubernetes\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.024402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024307 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.024402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024329 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-cni-bin\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.024402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024348 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-hostroot\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.024402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024352 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-cni-netd\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.024402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024376 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1d737e2-027f-4074-b311-f888a3d6c24a-dbus\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:06.024402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024386 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-cni-bin\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.024402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024394 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/115a161c-beda-456d-b996-3eb637a04e98-konnectivity-ca\") pod \"konnectivity-agent-9c6q8\" (UID: \"115a161c-beda-456d-b996-3eb637a04e98\") " pod="kube-system/konnectivity-agent-9c6q8" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024428 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-cni-netd\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024455 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfx97\" (UniqueName: \"kubernetes.io/projected/dc797cd1-de45-4071-85e2-8c551bee19af-kube-api-access-cfx97\") pod \"node-resolver-hs9v2\" (UID: \"dc797cd1-de45-4071-85e2-8c551bee19af\") " pod="openshift-dns/node-resolver-hs9v2" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01f639df-639a-4d2c-a211-08c940b1eaa5-os-release\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-lib-modules\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024530 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-run-netns\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024555 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-var-lib-cni-bin\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024578 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63c4b887-082c-4c31-b721-c9ee009e0195-ovnkube-config\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024604 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63c4b887-082c-4c31-b721-c9ee009e0195-ovnkube-script-lib\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024629 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc797cd1-de45-4071-85e2-8c551bee19af-hosts-file\") pod \"node-resolver-hs9v2\" (UID: \"dc797cd1-de45-4071-85e2-8c551bee19af\") " pod="openshift-dns/node-resolver-hs9v2" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024668 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01f639df-639a-4d2c-a211-08c940b1eaa5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024693 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-run-netns\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-sys\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024732 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-var-lib-cni-bin\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024736 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-run-systemd\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.024931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024803 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-run-systemd\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.024979 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc797cd1-de45-4071-85e2-8c551bee19af-hosts-file\") pod \"node-resolver-hs9v2\" (UID: \"dc797cd1-de45-4071-85e2-8c551bee19af\") " pod="openshift-dns/node-resolver-hs9v2" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-systemd\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025067 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-etc-openvswitch\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-multus-cni-dir\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025093 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/115a161c-beda-456d-b996-3eb637a04e98-konnectivity-ca\") pod \"konnectivity-agent-9c6q8\" (UID: \"115a161c-beda-456d-b996-3eb637a04e98\") " pod="kube-system/konnectivity-agent-9c6q8" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025114 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-os-release\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025141 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-var-lib-cni-multus\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025148 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-etc-openvswitch\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025165 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs\") pod \"network-metrics-daemon-shcvc\" (UID: \"77b2afb3-a310-4f8b-afc1-e7866f997196\") " pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025167 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1d737e2-027f-4074-b311-f888a3d6c24a-dbus\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025198 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/034aaa90-6ffb-454d-9c1b-8c43d45e428f-serviceca\") pod \"node-ca-k8pmr\" (UID: \"034aaa90-6ffb-454d-9c1b-8c43d45e428f\") " pod="openshift-image-registry/node-ca-k8pmr" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025221 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-multus-cni-dir\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025230 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-os-release\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025232 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-cnibin\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025230 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-var-lib-cni-multus\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-multus-conf-dir\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025274 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-cnibin\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.025546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025298 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-multus-conf-dir\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ffws\" (UniqueName: \"kubernetes.io/projected/63c4b887-082c-4c31-b721-c9ee009e0195-kube-api-access-4ffws\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025309 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63c4b887-082c-4c31-b721-c9ee009e0195-ovnkube-config\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025309 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63c4b887-082c-4c31-b721-c9ee009e0195-ovnkube-script-lib\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025329 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-device-dir\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025471 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-etc-selinux\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025490 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-device-dir\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025571 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a78097b7-2778-4e04-bc8a-eded50648759-host-slash\") pod \"iptables-alerter-zstjw\" (UID: \"a78097b7-2778-4e04-bc8a-eded50648759\") " pod="openshift-network-operator/iptables-alerter-zstjw" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025598 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01f639df-639a-4d2c-a211-08c940b1eaa5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025634 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/056a329d-1bff-489d-8eb2-979a88f62d95-etc-tuned\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025665 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025689 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-kubernetes\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025700 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-etc-selinux\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025700 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025714 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjvdv\" (UniqueName: \"kubernetes.io/projected/056a329d-1bff-489d-8eb2-979a88f62d95-kube-api-access-wjvdv\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025739 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnlfl\" (UniqueName: \"kubernetes.io/projected/034aaa90-6ffb-454d-9c1b-8c43d45e428f-kube-api-access-rnlfl\") pod \"node-ca-k8pmr\" (UID: \"034aaa90-6ffb-454d-9c1b-8c43d45e428f\") " pod="openshift-image-registry/node-ca-k8pmr" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a935900-aa47-440f-b2e7-03b2161b16e9-cni-binary-copy\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.026377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025800 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztcwr\" (UniqueName: \"kubernetes.io/projected/6a935900-aa47-440f-b2e7-03b2161b16e9-kube-api-access-ztcwr\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025882 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1d737e2-027f-4074-b311-f888a3d6c24a-kubelet-config\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025911 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025935 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a78097b7-2778-4e04-bc8a-eded50648759-iptables-alerter-script\") pod \"iptables-alerter-zstjw\" (UID: \"a78097b7-2778-4e04-bc8a-eded50648759\") " pod="openshift-network-operator/iptables-alerter-zstjw" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-host\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.025983 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-run-k8s-cni-cncf-io\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026039 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-run-ovn\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-node-log\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026084 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1d737e2-027f-4074-b311-f888a3d6c24a-kubelet-config\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-run-multus-certs\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.026040 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026111 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-run-k8s-cni-cncf-io\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026158 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-systemd-units\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026169 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-node-log\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-systemd-units\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.026188 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret podName:e1d737e2-027f-4074-b311-f888a3d6c24a nodeName:}" failed. No retries permitted until 2026-07-16 20:00:06.526146402 +0000 UTC m=+2.989499446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret") pod "global-pull-secret-syncer-fk2vw" (UID: "e1d737e2-027f-4074-b311-f888a3d6c24a") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026206 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-run-multus-certs\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.027009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-log-socket\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63c4b887-082c-4c31-b721-c9ee009e0195-ovn-node-metrics-cert\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026254 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-run-ovn\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026274 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01f639df-639a-4d2c-a211-08c940b1eaa5-system-cni-dir\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026286 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a935900-aa47-440f-b2e7-03b2161b16e9-cni-binary-copy\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026302 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01f639df-639a-4d2c-a211-08c940b1eaa5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026295 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-log-socket\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc797cd1-de45-4071-85e2-8c551bee19af-tmp-dir\") pod \"node-resolver-hs9v2\" (UID: \"dc797cd1-de45-4071-85e2-8c551bee19af\") " pod="openshift-dns/node-resolver-hs9v2" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026352 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01f639df-639a-4d2c-a211-08c940b1eaa5-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026375 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-sysctl-conf\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026395 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-run\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026432 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-system-cni-dir\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026460 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a935900-aa47-440f-b2e7-03b2161b16e9-multus-daemon-config\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-slash\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026530 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-run-openvswitch\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-run-ovn-kubernetes\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026564 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc797cd1-de45-4071-85e2-8c551bee19af-tmp-dir\") pod \"node-resolver-hs9v2\" (UID: \"dc797cd1-de45-4071-85e2-8c551bee19af\") " pod="openshift-dns/node-resolver-hs9v2" Jul 16 20:00:06.027850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026578 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-socket-dir\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026530 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-system-cni-dir\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-sys-fs\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026608 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-run-openvswitch\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01f639df-639a-4d2c-a211-08c940b1eaa5-cnibin\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026654 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-run-ovn-kubernetes\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026663 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-sys-fs\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-var-lib-kubelet\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026678 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-slash\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-run-netns\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026710 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-host-var-lib-kubelet\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026719 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-registration-dir\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29x5p\" (UniqueName: \"kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p\") pod \"network-check-target-dflz4\" (UID: \"34e42184-3345-497c-b72f-e09222e9bd3a\") " pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026745 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-run-netns\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-modprobe-d\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026800 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-socket-dir\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.028638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026803 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39dc1420-5600-4ce3-9b1a-17327be79793-registration-dir\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026808 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-sysctl-d\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-kubelet\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63c4b887-082c-4c31-b721-c9ee009e0195-env-overrides\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/115a161c-beda-456d-b996-3eb637a04e98-agent-certs\") pod \"konnectivity-agent-9c6q8\" (UID: \"115a161c-beda-456d-b996-3eb637a04e98\") " pod="kube-system/konnectivity-agent-9c6q8" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.026925 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-host-kubelet\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.027046 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-var-lib-kubelet\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.027072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/056a329d-1bff-489d-8eb2-979a88f62d95-tmp\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.027100 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-var-lib-openvswitch\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.027125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jvkg\" (UniqueName: \"kubernetes.io/projected/a78097b7-2778-4e04-bc8a-eded50648759-kube-api-access-9jvkg\") pod \"iptables-alerter-zstjw\" (UID: \"a78097b7-2778-4e04-bc8a-eded50648759\") " pod="openshift-network-operator/iptables-alerter-zstjw" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.027156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89w6j\" (UniqueName: \"kubernetes.io/projected/01f639df-639a-4d2c-a211-08c940b1eaa5-kube-api-access-89w6j\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.027180 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-sysconfig\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.027204 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-multus-socket-dir-parent\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.027227 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9k7m\" (UniqueName: \"kubernetes.io/projected/39dc1420-5600-4ce3-9b1a-17327be79793-kube-api-access-r9k7m\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.027243 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63c4b887-082c-4c31-b721-c9ee009e0195-env-overrides\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.027360 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a935900-aa47-440f-b2e7-03b2161b16e9-multus-socket-dir-parent\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.027355 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63c4b887-082c-4c31-b721-c9ee009e0195-var-lib-openvswitch\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.029439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.027949 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a935900-aa47-440f-b2e7-03b2161b16e9-multus-daemon-config\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.030249 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.030058 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63c4b887-082c-4c31-b721-c9ee009e0195-ovn-node-metrics-cert\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.030301 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.030249 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/115a161c-beda-456d-b996-3eb637a04e98-agent-certs\") pod \"konnectivity-agent-9c6q8\" (UID: \"115a161c-beda-456d-b996-3eb637a04e98\") " pod="kube-system/konnectivity-agent-9c6q8" Jul 16 20:00:06.033755 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.033650 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfx97\" (UniqueName: \"kubernetes.io/projected/dc797cd1-de45-4071-85e2-8c551bee19af-kube-api-access-cfx97\") pod \"node-resolver-hs9v2\" (UID: \"dc797cd1-de45-4071-85e2-8c551bee19af\") " pod="openshift-dns/node-resolver-hs9v2" Jul 16 20:00:06.035018 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.034994 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztcwr\" (UniqueName: \"kubernetes.io/projected/6a935900-aa47-440f-b2e7-03b2161b16e9-kube-api-access-ztcwr\") pod \"multus-tb28g\" (UID: \"6a935900-aa47-440f-b2e7-03b2161b16e9\") " pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.035307 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.035289 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9k7m\" (UniqueName: \"kubernetes.io/projected/39dc1420-5600-4ce3-9b1a-17327be79793-kube-api-access-r9k7m\") pod \"aws-ebs-csi-driver-node-6d9tv\" (UID: \"39dc1420-5600-4ce3-9b1a-17327be79793\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.035501 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.035484 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ffws\" (UniqueName: \"kubernetes.io/projected/63c4b887-082c-4c31-b721-c9ee009e0195-kube-api-access-4ffws\") pod \"ovnkube-node-6pgg5\" (UID: \"63c4b887-082c-4c31-b721-c9ee009e0195\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.128141 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128079 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01f639df-639a-4d2c-a211-08c940b1eaa5-os-release\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.128329 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.127973 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01f639df-639a-4d2c-a211-08c940b1eaa5-os-release\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.128329 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128222 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-lib-modules\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.128329 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01f639df-639a-4d2c-a211-08c940b1eaa5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.128329 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128304 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-sys\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.128533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128339 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-systemd\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.128533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128356 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-lib-modules\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.128533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128372 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs\") pod \"network-metrics-daemon-shcvc\" (UID: \"77b2afb3-a310-4f8b-afc1-e7866f997196\") " pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:06.128533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128415 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/034aaa90-6ffb-454d-9c1b-8c43d45e428f-serviceca\") pod \"node-ca-k8pmr\" (UID: \"034aaa90-6ffb-454d-9c1b-8c43d45e428f\") " pod="openshift-image-registry/node-ca-k8pmr" Jul 16 20:00:06.128533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a78097b7-2778-4e04-bc8a-eded50648759-host-slash\") pod \"iptables-alerter-zstjw\" (UID: \"a78097b7-2778-4e04-bc8a-eded50648759\") " pod="openshift-network-operator/iptables-alerter-zstjw" Jul 16 20:00:06.128533 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.128488 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:06.128533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128495 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01f639df-639a-4d2c-a211-08c940b1eaa5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.128533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128529 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/056a329d-1bff-489d-8eb2-979a88f62d95-etc-tuned\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.128912 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.128555 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs podName:77b2afb3-a310-4f8b-afc1-e7866f997196 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:06.628533884 +0000 UTC m=+3.091886899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs") pod "network-metrics-daemon-shcvc" (UID: "77b2afb3-a310-4f8b-afc1-e7866f997196") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:06.128912 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128591 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-kubernetes\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.128912 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128620 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a78097b7-2778-4e04-bc8a-eded50648759-host-slash\") pod \"iptables-alerter-zstjw\" (UID: \"a78097b7-2778-4e04-bc8a-eded50648759\") " pod="openshift-network-operator/iptables-alerter-zstjw" Jul 16 20:00:06.128912 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128625 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjvdv\" (UniqueName: \"kubernetes.io/projected/056a329d-1bff-489d-8eb2-979a88f62d95-kube-api-access-wjvdv\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.128912 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128660 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnlfl\" (UniqueName: \"kubernetes.io/projected/034aaa90-6ffb-454d-9c1b-8c43d45e428f-kube-api-access-rnlfl\") pod \"node-ca-k8pmr\" (UID: \"034aaa90-6ffb-454d-9c1b-8c43d45e428f\") " pod="openshift-image-registry/node-ca-k8pmr" Jul 16 20:00:06.128912 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128716 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a78097b7-2778-4e04-bc8a-eded50648759-iptables-alerter-script\") pod \"iptables-alerter-zstjw\" (UID: \"a78097b7-2778-4e04-bc8a-eded50648759\") " pod="openshift-network-operator/iptables-alerter-zstjw" Jul 16 20:00:06.128912 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-host\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.128912 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01f639df-639a-4d2c-a211-08c940b1eaa5-system-cni-dir\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.128912 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01f639df-639a-4d2c-a211-08c940b1eaa5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.128912 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01f639df-639a-4d2c-a211-08c940b1eaa5-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.128912 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128909 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-sysctl-conf\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128946 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-run\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.128999 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01f639df-639a-4d2c-a211-08c940b1eaa5-cnibin\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129034 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29x5p\" (UniqueName: \"kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p\") pod \"network-check-target-dflz4\" (UID: \"34e42184-3345-497c-b72f-e09222e9bd3a\") " pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129100 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-modprobe-d\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-sysctl-d\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-var-lib-kubelet\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129210 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/056a329d-1bff-489d-8eb2-979a88f62d95-tmp\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129210 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-sysctl-conf\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129230 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01f639df-639a-4d2c-a211-08c940b1eaa5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129277 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01f639df-639a-4d2c-a211-08c940b1eaa5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129299 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-systemd\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129301 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jvkg\" (UniqueName: \"kubernetes.io/projected/a78097b7-2778-4e04-bc8a-eded50648759-kube-api-access-9jvkg\") pod \"iptables-alerter-zstjw\" (UID: \"a78097b7-2778-4e04-bc8a-eded50648759\") " pod="openshift-network-operator/iptables-alerter-zstjw" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129353 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89w6j\" (UniqueName: \"kubernetes.io/projected/01f639df-639a-4d2c-a211-08c940b1eaa5-kube-api-access-89w6j\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129379 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-sysconfig\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129375 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-kubernetes\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.129447 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bxcr\" (UniqueName: \"kubernetes.io/projected/77b2afb3-a310-4f8b-afc1-e7866f997196-kube-api-access-5bxcr\") pod \"network-metrics-daemon-shcvc\" (UID: \"77b2afb3-a310-4f8b-afc1-e7866f997196\") " pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:06.130252 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129496 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-run\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.130252 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.129551 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01f639df-639a-4d2c-a211-08c940b1eaa5-cnibin\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.130252 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.130039 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01f639df-639a-4d2c-a211-08c940b1eaa5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.130252 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.130165 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01f639df-639a-4d2c-a211-08c940b1eaa5-system-cni-dir\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.130252 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.130231 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-host\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.132015 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.130524 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/034aaa90-6ffb-454d-9c1b-8c43d45e428f-serviceca\") pod \"node-ca-k8pmr\" (UID: \"034aaa90-6ffb-454d-9c1b-8c43d45e428f\") " pod="openshift-image-registry/node-ca-k8pmr" Jul 16 20:00:06.132015 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.130655 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a78097b7-2778-4e04-bc8a-eded50648759-iptables-alerter-script\") pod \"iptables-alerter-zstjw\" (UID: \"a78097b7-2778-4e04-bc8a-eded50648759\") " pod="openshift-network-operator/iptables-alerter-zstjw" Jul 16 20:00:06.132015 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.130688 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01f639df-639a-4d2c-a211-08c940b1eaa5-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.132015 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.130797 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-sysconfig\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.132015 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.130922 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-modprobe-d\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.132015 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.130929 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-etc-sysctl-d\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.132015 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.130994 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-var-lib-kubelet\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.132015 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.130996 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/056a329d-1bff-489d-8eb2-979a88f62d95-sys\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.132015 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.131028 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/034aaa90-6ffb-454d-9c1b-8c43d45e428f-host\") pod \"node-ca-k8pmr\" (UID: \"034aaa90-6ffb-454d-9c1b-8c43d45e428f\") " pod="openshift-image-registry/node-ca-k8pmr" Jul 16 20:00:06.132015 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.131066 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/034aaa90-6ffb-454d-9c1b-8c43d45e428f-host\") pod \"node-ca-k8pmr\" (UID: \"034aaa90-6ffb-454d-9c1b-8c43d45e428f\") " pod="openshift-image-registry/node-ca-k8pmr" Jul 16 20:00:06.132641 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.132174 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/056a329d-1bff-489d-8eb2-979a88f62d95-tmp\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.132944 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.132918 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/056a329d-1bff-489d-8eb2-979a88f62d95-etc-tuned\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.136018 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.135993 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:00:06.136018 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.136021 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:00:06.136198 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.136035 2575 projected.go:196] Error preparing data for projected volume kube-api-access-29x5p for pod openshift-network-diagnostics/network-check-target-dflz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:06.136198 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.136122 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p podName:34e42184-3345-497c-b72f-e09222e9bd3a nodeName:}" failed. No retries permitted until 2026-07-16 20:00:06.636101882 +0000 UTC m=+3.099454910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-29x5p" (UniqueName: "kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p") pod "network-check-target-dflz4" (UID: "34e42184-3345-497c-b72f-e09222e9bd3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:06.138717 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.138656 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnlfl\" (UniqueName: \"kubernetes.io/projected/034aaa90-6ffb-454d-9c1b-8c43d45e428f-kube-api-access-rnlfl\") pod \"node-ca-k8pmr\" (UID: \"034aaa90-6ffb-454d-9c1b-8c43d45e428f\") " pod="openshift-image-registry/node-ca-k8pmr" Jul 16 20:00:06.139568 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.139522 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjvdv\" (UniqueName: \"kubernetes.io/projected/056a329d-1bff-489d-8eb2-979a88f62d95-kube-api-access-wjvdv\") pod \"tuned-l9smn\" (UID: \"056a329d-1bff-489d-8eb2-979a88f62d95\") " pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.139778 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.139742 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89w6j\" (UniqueName: \"kubernetes.io/projected/01f639df-639a-4d2c-a211-08c940b1eaa5-kube-api-access-89w6j\") pod \"multus-additional-cni-plugins-pwhmx\" (UID: \"01f639df-639a-4d2c-a211-08c940b1eaa5\") " pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.139919 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.139899 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bxcr\" (UniqueName: \"kubernetes.io/projected/77b2afb3-a310-4f8b-afc1-e7866f997196-kube-api-access-5bxcr\") pod \"network-metrics-daemon-shcvc\" (UID: \"77b2afb3-a310-4f8b-afc1-e7866f997196\") " pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:06.140215 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.140190 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jvkg\" (UniqueName: \"kubernetes.io/projected/a78097b7-2778-4e04-bc8a-eded50648759-kube-api-access-9jvkg\") pod \"iptables-alerter-zstjw\" (UID: \"a78097b7-2778-4e04-bc8a-eded50648759\") " pod="openshift-network-operator/iptables-alerter-zstjw" Jul 16 20:00:06.221305 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.221279 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tb28g" Jul 16 20:00:06.228793 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.228748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:06.230236 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:06.230211 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a935900_aa47_440f_b2e7_03b2161b16e9.slice/crio-8e0f95c86d8096af55d4ac72e756c3d7aab01dbb7de2f68e28594bd192c51971 WatchSource:0}: Error finding container 8e0f95c86d8096af55d4ac72e756c3d7aab01dbb7de2f68e28594bd192c51971: Status 404 returned error can't find the container with id 8e0f95c86d8096af55d4ac72e756c3d7aab01dbb7de2f68e28594bd192c51971 Jul 16 20:00:06.237102 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.237078 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9c6q8" Jul 16 20:00:06.238144 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:06.238116 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c4b887_082c_4c31_b721_c9ee009e0195.slice/crio-942f5129f2f88ece41c4540ac5d7b8dfe1d622707b8df25a66ed0074d4eafbb4 WatchSource:0}: Error finding container 942f5129f2f88ece41c4540ac5d7b8dfe1d622707b8df25a66ed0074d4eafbb4: Status 404 returned error can't find the container with id 942f5129f2f88ece41c4540ac5d7b8dfe1d622707b8df25a66ed0074d4eafbb4 Jul 16 20:00:06.241924 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.241905 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" Jul 16 20:00:06.248450 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.248420 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hs9v2" Jul 16 20:00:06.249278 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:06.249250 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod115a161c_beda_456d_b996_3eb637a04e98.slice/crio-fba447b9c658e2b42085ba52b23823684eb13ea999ce08ec9991a25e4879a196 WatchSource:0}: Error finding container fba447b9c658e2b42085ba52b23823684eb13ea999ce08ec9991a25e4879a196: Status 404 returned error can't find the container with id fba447b9c658e2b42085ba52b23823684eb13ea999ce08ec9991a25e4879a196 Jul 16 20:00:06.252066 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:06.252044 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39dc1420_5600_4ce3_9b1a_17327be79793.slice/crio-20160e1cb384d58e03e1fc9c98be685cd569c6148d20869417de35914f96b2b4 WatchSource:0}: Error finding container 20160e1cb384d58e03e1fc9c98be685cd569c6148d20869417de35914f96b2b4: Status 404 returned error can't find the container with id 20160e1cb384d58e03e1fc9c98be685cd569c6148d20869417de35914f96b2b4 Jul 16 20:00:06.255832 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.255753 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zstjw" Jul 16 20:00:06.257205 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:06.257176 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc797cd1_de45_4071_85e2_8c551bee19af.slice/crio-dd94db7187f9254fa369d41e80e16345397193e2252d1abadaa6731a2b1acacc WatchSource:0}: Error finding container dd94db7187f9254fa369d41e80e16345397193e2252d1abadaa6731a2b1acacc: Status 404 returned error can't find the container with id dd94db7187f9254fa369d41e80e16345397193e2252d1abadaa6731a2b1acacc Jul 16 20:00:06.262223 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.262206 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwhmx" Jul 16 20:00:06.265792 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:06.265745 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda78097b7_2778_4e04_bc8a_eded50648759.slice/crio-482e4eba2dcb83c9804d7df3ff51f6e59514710973bf44e2da0513de4e0b19e7 WatchSource:0}: Error finding container 482e4eba2dcb83c9804d7df3ff51f6e59514710973bf44e2da0513de4e0b19e7: Status 404 returned error can't find the container with id 482e4eba2dcb83c9804d7df3ff51f6e59514710973bf44e2da0513de4e0b19e7 Jul 16 20:00:06.269431 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.269414 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l9smn" Jul 16 20:00:06.271853 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:06.271829 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f639df_639a_4d2c_a211_08c940b1eaa5.slice/crio-99ce8918611bd8677cf183eb3e12b0c66c8e0c853f1802073f1a517964bde5bd WatchSource:0}: Error finding container 99ce8918611bd8677cf183eb3e12b0c66c8e0c853f1802073f1a517964bde5bd: Status 404 returned error can't find the container with id 99ce8918611bd8677cf183eb3e12b0c66c8e0c853f1802073f1a517964bde5bd Jul 16 20:00:06.274842 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.274637 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k8pmr" Jul 16 20:00:06.281438 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:06.281414 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056a329d_1bff_489d_8eb2_979a88f62d95.slice/crio-1e6bbd244f583dbc1dbdc7e71af35a5430e391628201ac4effd569cb5c342d5c WatchSource:0}: Error finding container 1e6bbd244f583dbc1dbdc7e71af35a5430e391628201ac4effd569cb5c342d5c: Status 404 returned error can't find the container with id 1e6bbd244f583dbc1dbdc7e71af35a5430e391628201ac4effd569cb5c342d5c Jul 16 20:00:06.283544 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:06.283517 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034aaa90_6ffb_454d_9c1b_8c43d45e428f.slice/crio-1931d3bab33cd97b55980a49200f605c7312c6bf7f57ad23155df78f81da2d62 WatchSource:0}: Error finding container 1931d3bab33cd97b55980a49200f605c7312c6bf7f57ad23155df78f81da2d62: Status 404 returned error can't find the container with id 1931d3bab33cd97b55980a49200f605c7312c6bf7f57ad23155df78f81da2d62 Jul 16 20:00:06.392009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.391971 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 20:00:06.521596 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:06.521564 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a9f66a5a3b782767a0da7bfdbce0f8.slice/crio-a84bc82f07b4d7fe1f8280c953f966d49b61734fddc531ebe441b6c3d9a17d52 WatchSource:0}: Error finding container a84bc82f07b4d7fe1f8280c953f966d49b61734fddc531ebe441b6c3d9a17d52: Status 404 returned error can't find the container with id a84bc82f07b4d7fe1f8280c953f966d49b61734fddc531ebe441b6c3d9a17d52 Jul 16 20:00:06.534249 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.534218 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:06.534378 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.534342 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:06.534417 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.534397 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret podName:e1d737e2-027f-4074-b311-f888a3d6c24a nodeName:}" failed. No retries permitted until 2026-07-16 20:00:07.534383891 +0000 UTC m=+3.997736899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret") pod "global-pull-secret-syncer-fk2vw" (UID: "e1d737e2-027f-4074-b311-f888a3d6c24a") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:06.635404 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.635373 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs\") pod \"network-metrics-daemon-shcvc\" (UID: \"77b2afb3-a310-4f8b-afc1-e7866f997196\") " pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:06.635541 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.635527 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:06.635589 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.635583 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs podName:77b2afb3-a310-4f8b-afc1-e7866f997196 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:07.635570224 +0000 UTC m=+4.098923233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs") pod "network-metrics-daemon-shcvc" (UID: "77b2afb3-a310-4f8b-afc1-e7866f997196") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:06.738691 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.737325 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29x5p\" (UniqueName: \"kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p\") pod \"network-check-target-dflz4\" (UID: \"34e42184-3345-497c-b72f-e09222e9bd3a\") " pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:06.738691 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.737495 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:00:06.738691 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.737516 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:00:06.738691 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.737549 2575 projected.go:196] Error preparing data for projected volume kube-api-access-29x5p for pod openshift-network-diagnostics/network-check-target-dflz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:06.738691 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:06.737610 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p podName:34e42184-3345-497c-b72f-e09222e9bd3a nodeName:}" failed. No retries permitted until 2026-07-16 20:00:07.737590962 +0000 UTC m=+4.200943990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-29x5p" (UniqueName: "kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p") pod "network-check-target-dflz4" (UID: "34e42184-3345-497c-b72f-e09222e9bd3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:06.864284 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.864060 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 20:00:06.953061 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.952995 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 19:55:05 +0000 UTC" deadline="2028-01-18 00:20:55.753614629 +0000 UTC" Jul 16 20:00:06.953061 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:06.953053 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13204h20m48.800565431s" Jul 16 20:00:07.012746 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.012452 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:07.012921 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.012495 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:07.012921 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:07.012838 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:07.012921 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:07.012910 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:07.022564 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.022516 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k8pmr" event={"ID":"034aaa90-6ffb-454d-9c1b-8c43d45e428f","Type":"ContainerStarted","Data":"1931d3bab33cd97b55980a49200f605c7312c6bf7f57ad23155df78f81da2d62"} Jul 16 20:00:07.024859 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.024727 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwhmx" event={"ID":"01f639df-639a-4d2c-a211-08c940b1eaa5","Type":"ContainerStarted","Data":"99ce8918611bd8677cf183eb3e12b0c66c8e0c853f1802073f1a517964bde5bd"} Jul 16 20:00:07.028337 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.028231 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zstjw" event={"ID":"a78097b7-2778-4e04-bc8a-eded50648759","Type":"ContainerStarted","Data":"482e4eba2dcb83c9804d7df3ff51f6e59514710973bf44e2da0513de4e0b19e7"} Jul 16 20:00:07.031789 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.031743 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hs9v2" event={"ID":"dc797cd1-de45-4071-85e2-8c551bee19af","Type":"ContainerStarted","Data":"dd94db7187f9254fa369d41e80e16345397193e2252d1abadaa6731a2b1acacc"} Jul 16 20:00:07.033787 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.033699 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" event={"ID":"39dc1420-5600-4ce3-9b1a-17327be79793","Type":"ContainerStarted","Data":"20160e1cb384d58e03e1fc9c98be685cd569c6148d20869417de35914f96b2b4"} Jul 16 20:00:07.035302 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.035276 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9c6q8" event={"ID":"115a161c-beda-456d-b996-3eb637a04e98","Type":"ContainerStarted","Data":"fba447b9c658e2b42085ba52b23823684eb13ea999ce08ec9991a25e4879a196"} Jul 16 20:00:07.044224 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.044174 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" event={"ID":"63c4b887-082c-4c31-b721-c9ee009e0195","Type":"ContainerStarted","Data":"942f5129f2f88ece41c4540ac5d7b8dfe1d622707b8df25a66ed0074d4eafbb4"} Jul 16 20:00:07.046759 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.046721 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal" event={"ID":"63a9f66a5a3b782767a0da7bfdbce0f8","Type":"ContainerStarted","Data":"a84bc82f07b4d7fe1f8280c953f966d49b61734fddc531ebe441b6c3d9a17d52"} Jul 16 20:00:07.048526 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.048495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l9smn" event={"ID":"056a329d-1bff-489d-8eb2-979a88f62d95","Type":"ContainerStarted","Data":"1e6bbd244f583dbc1dbdc7e71af35a5430e391628201ac4effd569cb5c342d5c"} Jul 16 20:00:07.051039 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.051009 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tb28g" event={"ID":"6a935900-aa47-440f-b2e7-03b2161b16e9","Type":"ContainerStarted","Data":"8e0f95c86d8096af55d4ac72e756c3d7aab01dbb7de2f68e28594bd192c51971"} Jul 16 20:00:07.054971 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.054936 2575 generic.go:356] "Generic (PLEG): container finished" podID="6cf01e38c3754b228f401669434c503a" containerID="a05b4c855a9cc1fa06044f8c9280f19b66cfb25783d1b971f92c6992bd834e82" exitCode=0 Jul 16 20:00:07.055107 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.054983 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" event={"ID":"6cf01e38c3754b228f401669434c503a","Type":"ContainerDied","Data":"a05b4c855a9cc1fa06044f8c9280f19b66cfb25783d1b971f92c6992bd834e82"} Jul 16 20:00:07.543633 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.543486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:07.543845 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:07.543677 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:07.543845 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:07.543755 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret podName:e1d737e2-027f-4074-b311-f888a3d6c24a nodeName:}" failed. No retries permitted until 2026-07-16 20:00:09.543734306 +0000 UTC m=+6.007087318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret") pod "global-pull-secret-syncer-fk2vw" (UID: "e1d737e2-027f-4074-b311-f888a3d6c24a") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:07.645046 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.645004 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs\") pod \"network-metrics-daemon-shcvc\" (UID: \"77b2afb3-a310-4f8b-afc1-e7866f997196\") " pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:07.645241 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:07.645220 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:07.645300 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:07.645295 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs podName:77b2afb3-a310-4f8b-afc1-e7866f997196 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:09.645274796 +0000 UTC m=+6.108627810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs") pod "network-metrics-daemon-shcvc" (UID: "77b2afb3-a310-4f8b-afc1-e7866f997196") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:07.745614 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.745565 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29x5p\" (UniqueName: \"kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p\") pod \"network-check-target-dflz4\" (UID: \"34e42184-3345-497c-b72f-e09222e9bd3a\") " pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:07.745827 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:07.745795 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:00:07.745827 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:07.745820 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:00:07.745965 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:07.745834 2575 projected.go:196] Error preparing data for projected volume kube-api-access-29x5p for pod openshift-network-diagnostics/network-check-target-dflz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:07.745965 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:07.745894 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p podName:34e42184-3345-497c-b72f-e09222e9bd3a nodeName:}" failed. No retries permitted until 2026-07-16 20:00:09.745875719 +0000 UTC m=+6.209228732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-29x5p" (UniqueName: "kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p") pod "network-check-target-dflz4" (UID: "34e42184-3345-497c-b72f-e09222e9bd3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:07.956024 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.954022 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 19:55:05 +0000 UTC" deadline="2027-12-29 16:38:16.017751811 +0000 UTC" Jul 16 20:00:07.956024 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:07.954083 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12740h38m8.06367204s" Jul 16 20:00:08.015049 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:08.015014 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:08.015215 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:08.015151 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:08.082336 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:08.082296 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" event={"ID":"6cf01e38c3754b228f401669434c503a","Type":"ContainerStarted","Data":"30250d496a73854b78307e7761e5b8b3b74ef7731941748f7b1910cac670ce9f"} Jul 16 20:00:09.012782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:09.012043 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:09.012782 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:09.012187 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:09.012782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:09.012593 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:09.012782 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:09.012696 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:09.560285 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:09.560252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:09.560489 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:09.560387 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:09.560489 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:09.560452 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret podName:e1d737e2-027f-4074-b311-f888a3d6c24a nodeName:}" failed. No retries permitted until 2026-07-16 20:00:13.56043355 +0000 UTC m=+10.023786580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret") pod "global-pull-secret-syncer-fk2vw" (UID: "e1d737e2-027f-4074-b311-f888a3d6c24a") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:09.661276 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:09.661236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs\") pod \"network-metrics-daemon-shcvc\" (UID: \"77b2afb3-a310-4f8b-afc1-e7866f997196\") " pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:09.661473 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:09.661406 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:09.661537 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:09.661485 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs podName:77b2afb3-a310-4f8b-afc1-e7866f997196 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:13.661465963 +0000 UTC m=+10.124818972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs") pod "network-metrics-daemon-shcvc" (UID: "77b2afb3-a310-4f8b-afc1-e7866f997196") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:09.762064 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:09.762010 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29x5p\" (UniqueName: \"kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p\") pod \"network-check-target-dflz4\" (UID: \"34e42184-3345-497c-b72f-e09222e9bd3a\") " pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:09.762260 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:09.762202 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:00:09.762260 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:09.762222 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:00:09.762260 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:09.762233 2575 projected.go:196] Error preparing data for projected volume kube-api-access-29x5p for pod openshift-network-diagnostics/network-check-target-dflz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:09.762444 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:09.762297 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p podName:34e42184-3345-497c-b72f-e09222e9bd3a nodeName:}" failed. No retries permitted until 2026-07-16 20:00:13.762275686 +0000 UTC m=+10.225628705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-29x5p" (UniqueName: "kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p") pod "network-check-target-dflz4" (UID: "34e42184-3345-497c-b72f-e09222e9bd3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:10.012327 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:10.012237 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:10.012459 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:10.012409 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:11.012816 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:11.012193 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:11.012816 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:11.012233 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:11.012816 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:11.012340 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:11.012816 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:11.012758 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:12.012244 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:12.012214 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:12.012431 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:12.012339 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:13.012692 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:13.012597 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:13.012692 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:13.012623 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:13.013221 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:13.012745 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:13.013221 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:13.012883 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:13.595125 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:13.594485 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:13.595125 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:13.594683 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:13.595125 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:13.594750 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret podName:e1d737e2-027f-4074-b311-f888a3d6c24a nodeName:}" failed. No retries permitted until 2026-07-16 20:00:21.594730848 +0000 UTC m=+18.058083857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret") pod "global-pull-secret-syncer-fk2vw" (UID: "e1d737e2-027f-4074-b311-f888a3d6c24a") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:13.694900 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:13.694858 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs\") pod \"network-metrics-daemon-shcvc\" (UID: \"77b2afb3-a310-4f8b-afc1-e7866f997196\") " pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:13.695096 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:13.695062 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:13.695164 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:13.695132 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs podName:77b2afb3-a310-4f8b-afc1-e7866f997196 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:21.695112605 +0000 UTC m=+18.158465618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs") pod "network-metrics-daemon-shcvc" (UID: "77b2afb3-a310-4f8b-afc1-e7866f997196") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:13.795517 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:13.795478 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29x5p\" (UniqueName: \"kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p\") pod \"network-check-target-dflz4\" (UID: \"34e42184-3345-497c-b72f-e09222e9bd3a\") " pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:13.796024 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:13.795699 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:00:13.796024 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:13.795724 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:00:13.796024 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:13.795738 2575 projected.go:196] Error preparing data for projected volume kube-api-access-29x5p for pod openshift-network-diagnostics/network-check-target-dflz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:13.796024 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:13.795822 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p podName:34e42184-3345-497c-b72f-e09222e9bd3a nodeName:}" failed. No retries permitted until 2026-07-16 20:00:21.795803043 +0000 UTC m=+18.259156095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-29x5p" (UniqueName: "kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p") pod "network-check-target-dflz4" (UID: "34e42184-3345-497c-b72f-e09222e9bd3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:14.017256 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:14.017179 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:14.017710 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:14.017311 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:15.012105 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:15.012058 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:15.012285 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:15.012116 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:15.012285 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:15.012209 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:15.012390 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:15.012358 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:16.016986 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:16.016904 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:16.017471 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:16.017087 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:17.012986 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:17.012905 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:17.012986 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:17.012933 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:17.013188 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:17.013056 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:17.013237 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:17.013179 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:18.012455 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:18.012419 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:18.012895 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:18.012562 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:19.012488 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:19.012447 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:19.012949 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:19.012460 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:19.012949 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:19.012597 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:19.012949 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:19.012674 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:20.012466 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:20.012432 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:20.012628 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:20.012566 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:21.012169 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:21.012133 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:21.012446 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:21.012180 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:21.012446 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:21.012276 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:21.012446 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:21.012417 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:21.655997 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:21.655950 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:21.656528 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:21.656088 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:21.656528 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:21.656164 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret podName:e1d737e2-027f-4074-b311-f888a3d6c24a nodeName:}" failed. No retries permitted until 2026-07-16 20:00:37.6561432 +0000 UTC m=+34.119496232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret") pod "global-pull-secret-syncer-fk2vw" (UID: "e1d737e2-027f-4074-b311-f888a3d6c24a") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:21.757183 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:21.757092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs\") pod \"network-metrics-daemon-shcvc\" (UID: \"77b2afb3-a310-4f8b-afc1-e7866f997196\") " pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:21.757334 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:21.757250 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:21.757334 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:21.757332 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs podName:77b2afb3-a310-4f8b-afc1-e7866f997196 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:37.757309804 +0000 UTC m=+34.220662818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs") pod "network-metrics-daemon-shcvc" (UID: "77b2afb3-a310-4f8b-afc1-e7866f997196") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:21.858344 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:21.858237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29x5p\" (UniqueName: \"kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p\") pod \"network-check-target-dflz4\" (UID: \"34e42184-3345-497c-b72f-e09222e9bd3a\") " pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:21.858534 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:21.858387 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:00:21.858534 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:21.858411 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:00:21.858534 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:21.858424 2575 projected.go:196] Error preparing data for projected volume kube-api-access-29x5p for pod openshift-network-diagnostics/network-check-target-dflz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:21.858534 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:21.858482 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p podName:34e42184-3345-497c-b72f-e09222e9bd3a nodeName:}" failed. No retries permitted until 2026-07-16 20:00:37.858464039 +0000 UTC m=+34.321817048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-29x5p" (UniqueName: "kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p") pod "network-check-target-dflz4" (UID: "34e42184-3345-497c-b72f-e09222e9bd3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:22.012382 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:22.012291 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:22.012557 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:22.012429 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:23.012790 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:23.012742 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:23.013271 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:23.012798 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:23.013271 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:23.012901 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:23.013271 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:23.013070 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:24.013700 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:24.013667 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:24.014187 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:24.013794 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:25.011952 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:25.011912 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:25.012143 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:25.011962 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:25.012143 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:25.012058 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:25.012307 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:25.012224 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:26.012244 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.011993 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:26.012900 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:26.012361 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:26.119829 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.119798 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k8pmr" event={"ID":"034aaa90-6ffb-454d-9c1b-8c43d45e428f","Type":"ContainerStarted","Data":"9a67663023ad0313c6d2c59eb081d4e9a0c638af15ea3f1449f0008f8da17536"} Jul 16 20:00:26.121132 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.121109 2575 generic.go:356] "Generic (PLEG): container finished" podID="01f639df-639a-4d2c-a211-08c940b1eaa5" containerID="f1f2f00bf98563184aab2538de7e9af0ca9a408ed3ed5672e7eea55a52781980" exitCode=0 Jul 16 20:00:26.121253 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.121168 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwhmx" event={"ID":"01f639df-639a-4d2c-a211-08c940b1eaa5","Type":"ContainerDied","Data":"f1f2f00bf98563184aab2538de7e9af0ca9a408ed3ed5672e7eea55a52781980"} Jul 16 20:00:26.122573 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.122550 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hs9v2" event={"ID":"dc797cd1-de45-4071-85e2-8c551bee19af","Type":"ContainerStarted","Data":"20200f927a1b6cd69a453d4bdcff59692ec85a438e638c6e733c35183651819d"} Jul 16 20:00:26.124189 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.124154 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" event={"ID":"39dc1420-5600-4ce3-9b1a-17327be79793","Type":"ContainerStarted","Data":"26ae0723a76f1fd90cf7f5e343f3634ab4e0b5952f05629123ae7ffef15f1b9d"} Jul 16 20:00:26.126983 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.126041 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9c6q8" event={"ID":"115a161c-beda-456d-b996-3eb637a04e98","Type":"ContainerStarted","Data":"cfaf3cdfc63201402937bf726045a713b5515e17e4366254470c7101e3bfb40a"} Jul 16 20:00:26.131570 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.131544 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" event={"ID":"63c4b887-082c-4c31-b721-c9ee009e0195","Type":"ContainerStarted","Data":"e4e0d98d9e23909959a84e84b88b1e954216d3eb31eff041e62112eb899511da"} Jul 16 20:00:26.131724 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.131637 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" event={"ID":"63c4b887-082c-4c31-b721-c9ee009e0195","Type":"ContainerStarted","Data":"024afc32fb0e08290f5129fef74b973081e5e90b984a04211f5bb0bb3668594c"} Jul 16 20:00:26.131724 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.131683 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" event={"ID":"63c4b887-082c-4c31-b721-c9ee009e0195","Type":"ContainerStarted","Data":"5b21c9c896741c8ed31aa00a734cc1a68ba8f12504e5a9ee1f17947d5626d8c0"} Jul 16 20:00:26.131724 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.131711 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" event={"ID":"63c4b887-082c-4c31-b721-c9ee009e0195","Type":"ContainerStarted","Data":"ab4fbf3766970d8c9c8c2affd4e54782f797d58543915a61f080d687f23ace86"} Jul 16 20:00:26.131857 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.131747 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" event={"ID":"63c4b887-082c-4c31-b721-c9ee009e0195","Type":"ContainerStarted","Data":"bd0d3037043bf9d29bce80e514cf8961902bf76980907dcb181cb9d27c609373"} Jul 16 20:00:26.132903 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.132885 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal" event={"ID":"63a9f66a5a3b782767a0da7bfdbce0f8","Type":"ContainerStarted","Data":"880b9d1515bbff3460c1041b2b1af3e637643de2b6dedbbc0c9d5bd0c9b3d9df"} Jul 16 20:00:26.133750 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.133710 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-169.ec2.internal" podStartSLOduration=21.133699347 podStartE2EDuration="21.133699347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:00:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:08.100599509 +0000 UTC m=+4.563952544" watchObservedRunningTime="2026-07-16 20:00:26.133699347 +0000 UTC m=+22.597052378" Jul 16 20:00:26.133999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.133974 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k8pmr" podStartSLOduration=2.970386962 podStartE2EDuration="22.133967269s" totalImagesPullingTime="19.163580307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:26.133428663 +0000 UTC m=+22.596781693" watchObservedRunningTime="2026-07-16 20:00:26.133967269 +0000 UTC m=+22.597320299" Jul 16 20:00:26.134460 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.134443 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l9smn" event={"ID":"056a329d-1bff-489d-8eb2-979a88f62d95","Type":"ContainerStarted","Data":"db3a92cd5dc73e7b20f45b00cf67f787dd025e058717f57fa2cfadb838d536fb"} Jul 16 20:00:26.135719 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.135700 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tb28g" event={"ID":"6a935900-aa47-440f-b2e7-03b2161b16e9","Type":"ContainerStarted","Data":"240ba4f86cc17af568b863e2d22f7a53a08b8e64d1059e6911a7507bcae77ec3"} Jul 16 20:00:26.165423 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.165364 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9c6q8" podStartSLOduration=2.966607094 podStartE2EDuration="22.165344138s" totalImagesPullingTime="19.198737044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:26.165188196 +0000 UTC m=+22.628541249" watchObservedRunningTime="2026-07-16 20:00:26.165344138 +0000 UTC m=+22.628697170" Jul 16 20:00:26.166073 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.165751 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-169.ec2.internal" podStartSLOduration=21.165741753 podStartE2EDuration="21.165741753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:00:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:26.146607714 +0000 UTC m=+22.609960745" watchObservedRunningTime="2026-07-16 20:00:26.165741753 +0000 UTC m=+22.629094846" Jul 16 20:00:26.181890 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.181826 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hs9v2" podStartSLOduration=3.2922786 podStartE2EDuration="22.181808958s" totalImagesPullingTime="18.889530358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:26.181488134 +0000 UTC m=+22.644841165" watchObservedRunningTime="2026-07-16 20:00:26.181808958 +0000 UTC m=+22.645161988" Jul 16 20:00:26.220158 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.220054 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l9smn" podStartSLOduration=3.354894572 podStartE2EDuration="22.220036075s" totalImagesPullingTime="18.865141503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:26.219746065 +0000 UTC m=+22.683099094" watchObservedRunningTime="2026-07-16 20:00:26.220036075 +0000 UTC m=+22.683389105" Jul 16 20:00:26.242465 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.242370 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tb28g" podStartSLOduration=2.959201454 podStartE2EDuration="22.242346405s" totalImagesPullingTime="19.283144951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:26.24182998 +0000 UTC m=+22.705183015" watchObservedRunningTime="2026-07-16 20:00:26.242346405 +0000 UTC m=+22.705699436" Jul 16 20:00:26.931682 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.931626 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 20:00:26.982964 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.982851 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T20:00:26.931656781Z","UUID":"8fee0910-d038-4b2b-b750-e933f6394442","Handler":null,"Name":"","Endpoint":""} Jul 16 20:00:26.984502 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.984481 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 20:00:26.984652 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:26.984527 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 20:00:27.012964 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:27.012918 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:27.012964 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:27.012943 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:27.013448 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:27.013048 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:27.013448 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:27.013219 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:27.139604 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:27.139512 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zstjw" event={"ID":"a78097b7-2778-4e04-bc8a-eded50648759","Type":"ContainerStarted","Data":"668070b335749fc022124385ae65c85cec1b6f1f0a3469427635e5f2415569c2"} Jul 16 20:00:27.141506 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:27.141461 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" event={"ID":"39dc1420-5600-4ce3-9b1a-17327be79793","Type":"ContainerStarted","Data":"500d31991d7599afb1321e8605499d477c76c8a91fdc628cd55cd5b06a0c62dc"} Jul 16 20:00:27.144846 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:27.144819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" event={"ID":"63c4b887-082c-4c31-b721-c9ee009e0195","Type":"ContainerStarted","Data":"81f6aef94f1e45de505714a0285848d0d63153ce357582f65ff9299ccd8642d4"} Jul 16 20:00:27.157009 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:27.156693 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zstjw" podStartSLOduration=7.95487179 podStartE2EDuration="23.156671936s" totalImagesPullingTime="15.201800146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:27.155931451 +0000 UTC m=+23.619284483" watchObservedRunningTime="2026-07-16 20:00:27.156671936 +0000 UTC m=+23.620024968" Jul 16 20:00:28.012735 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:28.012694 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:28.012923 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:28.012825 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:28.149422 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:28.149372 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" event={"ID":"39dc1420-5600-4ce3-9b1a-17327be79793","Type":"ContainerStarted","Data":"53e90d3274d899bdcafc4e0c256c7b454600a8cbda565f695b762bad51d96130"} Jul 16 20:00:28.168712 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:28.168644 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d9tv" podStartSLOduration=6.804502878 podStartE2EDuration="24.168620894s" totalImagesPullingTime="17.364118016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:00:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:28.167871092 +0000 UTC m=+24.631224119" watchObservedRunningTime="2026-07-16 20:00:28.168620894 +0000 UTC m=+24.631973927" Jul 16 20:00:28.572961 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:28.572880 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9c6q8" Jul 16 20:00:28.573492 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:28.573470 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9c6q8" Jul 16 20:00:29.012462 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:29.012375 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:29.012607 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:29.012375 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:29.012607 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:29.012492 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:29.012607 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:29.012565 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:29.156499 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:29.156463 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" event={"ID":"63c4b887-082c-4c31-b721-c9ee009e0195","Type":"ContainerStarted","Data":"259e6d2820053c9695a3c546ba91c665900baf129365e2a86897adc952af9cff"} Jul 16 20:00:30.012560 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:30.012313 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:30.012712 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:30.012659 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:31.013014 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:31.012915 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:31.013014 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:31.012915 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:31.013684 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:31.013040 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:31.013684 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:31.013099 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:31.162045 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:31.162013 2575 generic.go:356] "Generic (PLEG): container finished" podID="01f639df-639a-4d2c-a211-08c940b1eaa5" containerID="15d235aac235118fc8e2c79d0df9551ad120823f27901a5723bcb6e51d35ef06" exitCode=0 Jul 16 20:00:31.162202 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:31.162105 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwhmx" event={"ID":"01f639df-639a-4d2c-a211-08c940b1eaa5","Type":"ContainerDied","Data":"15d235aac235118fc8e2c79d0df9551ad120823f27901a5723bcb6e51d35ef06"} Jul 16 20:00:31.165714 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:31.165689 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" event={"ID":"63c4b887-082c-4c31-b721-c9ee009e0195","Type":"ContainerStarted","Data":"c505aabc180119821fd3aff6ec3dbd72d650580520bf38711e800930e55226d6"} Jul 16 20:00:31.165994 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:31.165974 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:31.166104 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:31.166043 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:31.180904 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:31.180877 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:31.211606 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:31.211543 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" podStartSLOduration=7.959993225 podStartE2EDuration="27.2115278s" totalImagesPullingTime="19.251534575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:31.210105156 +0000 UTC m=+27.673458190" watchObservedRunningTime="2026-07-16 20:00:31.2115278 +0000 UTC m=+27.674880857" Jul 16 20:00:32.012790 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:32.012750 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:32.012953 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:32.012875 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:32.169243 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:32.169044 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:32.184425 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:32.184397 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:00:32.669853 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:32.669758 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dflz4"] Jul 16 20:00:32.669984 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:32.669912 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:32.670026 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:32.669991 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:32.671837 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:32.671813 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fk2vw"] Jul 16 20:00:32.671969 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:32.671909 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:32.672012 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:32.671980 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:32.674655 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:32.674624 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-shcvc"] Jul 16 20:00:32.674796 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:32.674735 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:32.674893 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:32.674866 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:33.173012 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:33.172983 2575 generic.go:356] "Generic (PLEG): container finished" podID="01f639df-639a-4d2c-a211-08c940b1eaa5" containerID="18bb18bdb90ebbfe676548d30a34ae82a9f07c09fde2cfbdceb279fe97418e77" exitCode=0 Jul 16 20:00:33.173404 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:33.173072 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwhmx" event={"ID":"01f639df-639a-4d2c-a211-08c940b1eaa5","Type":"ContainerDied","Data":"18bb18bdb90ebbfe676548d30a34ae82a9f07c09fde2cfbdceb279fe97418e77"} Jul 16 20:00:34.015003 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:34.014913 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:34.015893 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:34.015785 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:34.016007 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:34.015941 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:34.016060 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:34.015985 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:34.177615 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:34.177581 2575 generic.go:356] "Generic (PLEG): container finished" podID="01f639df-639a-4d2c-a211-08c940b1eaa5" containerID="1c9b13a934878d89ab2f1368957882481823006633166e097fc9a2be1fb474d1" exitCode=0 Jul 16 20:00:34.178098 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:34.177675 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwhmx" event={"ID":"01f639df-639a-4d2c-a211-08c940b1eaa5","Type":"ContainerDied","Data":"1c9b13a934878d89ab2f1368957882481823006633166e097fc9a2be1fb474d1"} Jul 16 20:00:35.012616 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:35.012581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:35.012791 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:35.012698 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:35.562132 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:35.562097 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9c6q8" Jul 16 20:00:35.562598 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:35.562229 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 16 20:00:35.562751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:35.562737 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9c6q8" Jul 16 20:00:36.012010 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:36.011964 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:36.012162 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:36.012082 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:36.012162 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:36.011975 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:36.012275 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:36.012233 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:37.012671 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:37.012582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:37.013045 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:37.012711 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shcvc" podUID="77b2afb3-a310-4f8b-afc1-e7866f997196" Jul 16 20:00:37.674800 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:37.674739 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:37.675018 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:37.674878 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:37.675018 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:37.674937 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret podName:e1d737e2-027f-4074-b311-f888a3d6c24a nodeName:}" failed. No retries permitted until 2026-07-16 20:01:09.674922207 +0000 UTC m=+66.138275219 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret") pod "global-pull-secret-syncer-fk2vw" (UID: "e1d737e2-027f-4074-b311-f888a3d6c24a") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:00:37.775745 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:37.775706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs\") pod \"network-metrics-daemon-shcvc\" (UID: \"77b2afb3-a310-4f8b-afc1-e7866f997196\") " pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:37.775993 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:37.775867 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:37.775993 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:37.775931 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs podName:77b2afb3-a310-4f8b-afc1-e7866f997196 nodeName:}" failed. No retries permitted until 2026-07-16 20:01:09.775916275 +0000 UTC m=+66.239269284 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs") pod "network-metrics-daemon-shcvc" (UID: "77b2afb3-a310-4f8b-afc1-e7866f997196") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:00:37.876405 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:37.876369 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29x5p\" (UniqueName: \"kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p\") pod \"network-check-target-dflz4\" (UID: \"34e42184-3345-497c-b72f-e09222e9bd3a\") " pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:37.876603 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:37.876554 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:00:37.876603 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:37.876577 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:00:37.876603 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:37.876587 2575 projected.go:196] Error preparing data for projected volume kube-api-access-29x5p for pod openshift-network-diagnostics/network-check-target-dflz4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:37.876759 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:37.876639 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p podName:34e42184-3345-497c-b72f-e09222e9bd3a nodeName:}" failed. No retries permitted until 2026-07-16 20:01:09.876623935 +0000 UTC m=+66.339976943 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-29x5p" (UniqueName: "kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p") pod "network-check-target-dflz4" (UID: "34e42184-3345-497c-b72f-e09222e9bd3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:00:38.012104 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.012068 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:38.012104 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.012094 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:38.012361 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.012217 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk2vw" podUID="e1d737e2-027f-4074-b311-f888a3d6c24a" Jul 16 20:00:38.012361 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.012344 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflz4" podUID="34e42184-3345-497c-b72f-e09222e9bd3a" Jul 16 20:00:38.351640 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.351606 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-169.ec2.internal" event="NodeReady" Jul 16 20:00:38.352078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.351785 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 20:00:38.390749 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.390467 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f96d567d6-zvmsr"] Jul 16 20:00:38.405632 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.405597 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.408481 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.408281 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-472fn"] Jul 16 20:00:38.408917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.408893 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 20:00:38.409564 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.409531 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 20:00:38.409725 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.409694 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vjpvn\"" Jul 16 20:00:38.410687 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.410575 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 20:00:38.417563 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.417382 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 20:00:38.425816 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.425603 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b"] Jul 16 20:00:38.425816 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.425789 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-472fn" Jul 16 20:00:38.433642 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.433611 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 20:00:38.433967 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.433948 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fkb6w\"" Jul 16 20:00:38.434054 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.433990 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 20:00:38.441748 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.441703 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf"] Jul 16 20:00:38.441961 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.441875 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:00:38.445795 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.445740 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 16 20:00:38.446111 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.446093 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 16 20:00:38.446218 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.446193 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 16 20:00:38.446431 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.446417 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dw7gq\"" Jul 16 20:00:38.459748 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.459718 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-hlv9f"] Jul 16 20:00:38.459962 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.459867 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" Jul 16 20:00:38.462809 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.462785 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 16 20:00:38.464517 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.463648 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 16 20:00:38.464517 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.463951 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 16 20:00:38.464517 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.464157 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7ph75\"" Jul 16 20:00:38.464517 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.464360 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 16 20:00:38.477887 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.477849 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rjkcf"] Jul 16 20:00:38.478074 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.477986 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.480952 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.480906 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/322cb2da-6e27-4845-9081-0fec18abf287-ca-trust-extracted\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.482078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.481223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/322cb2da-6e27-4845-9081-0fec18abf287-image-registry-private-configuration\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.482078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.481284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/322cb2da-6e27-4845-9081-0fec18abf287-registry-certificates\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.482078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.481335 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/322cb2da-6e27-4845-9081-0fec18abf287-installation-pull-secrets\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.482078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.481370 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/322cb2da-6e27-4845-9081-0fec18abf287-trusted-ca\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.482078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.481444 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-bound-sa-token\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.482078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.481494 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.482078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.481545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m27x\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-kube-api-access-5m27x\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.482078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.481602 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 16 20:00:38.482078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.481639 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-b9sf8\"" Jul 16 20:00:38.482078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.481698 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 16 20:00:38.482078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.481887 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 16 20:00:38.482737 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.482224 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 16 20:00:38.486258 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.486232 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 16 20:00:38.490487 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.490410 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q"] Jul 16 20:00:38.490624 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.490547 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rjkcf" Jul 16 20:00:38.492938 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.492915 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 16 20:00:38.493421 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.493364 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fqttq\"" Jul 16 20:00:38.493541 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.493442 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 16 20:00:38.502101 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.502062 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-lpkxh"] Jul 16 20:00:38.502262 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.502205 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" Jul 16 20:00:38.505235 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.505207 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 16 20:00:38.505400 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.505380 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 16 20:00:38.505567 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.505546 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 16 20:00:38.506434 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.505292 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 16 20:00:38.506434 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.506195 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cm6m8\"" Jul 16 20:00:38.516092 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.516045 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f96d567d6-zvmsr"] Jul 16 20:00:38.516092 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.516086 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl"] Jul 16 20:00:38.516282 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.516203 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.518996 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.518838 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 16 20:00:38.518996 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.518852 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 16 20:00:38.518996 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.518943 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 20:00:38.518996 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.518967 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 20:00:38.519292 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.519271 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qzcwp\"" Jul 16 20:00:38.526229 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.526203 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 16 20:00:38.530442 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.530416 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56cbd95bbb-tngbx"] Jul 16 20:00:38.530581 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.530559 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:38.533221 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.533191 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 16 20:00:38.533372 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.533352 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 20:00:38.534479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.534460 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 16 20:00:38.534647 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.534624 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 20:00:38.534740 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.534626 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kqk9x\"" Jul 16 20:00:38.540261 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.540232 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-wb7gg"] Jul 16 20:00:38.540381 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.540355 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.544733 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.544710 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2x6nk\"" Jul 16 20:00:38.544995 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.544973 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 16 20:00:38.545095 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.544719 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 20:00:38.545095 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.544750 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 16 20:00:38.545181 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.544845 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 16 20:00:38.545181 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.544855 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 16 20:00:38.545181 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.544750 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 20:00:38.554368 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.554340 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn"] Jul 16 20:00:38.554506 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.554423 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wb7gg" Jul 16 20:00:38.557119 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.557096 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 20:00:38.557271 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.557097 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-t7jb2\"" Jul 16 20:00:38.557420 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.557399 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 20:00:38.566637 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.566611 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc"] Jul 16 20:00:38.566782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.566731 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.569191 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.569169 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 20:00:38.569313 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.569270 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 16 20:00:38.569373 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.569310 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 16 20:00:38.569373 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.569334 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 16 20:00:38.569373 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.569327 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 20:00:38.569513 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.569386 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 20:00:38.569615 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.569599 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 16 20:00:38.582543 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.582504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-tmp\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.582543 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.582543 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.582795 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.582562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/704043dc-663b-4a9f-a7aa-f80384bdbb39-config-volume\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:38.582795 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.582592 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r"] Jul 16 20:00:38.582795 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.582628 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m27x\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-kube-api-access-5m27x\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.582795 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.582663 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd78c5ca-602a-4ec2-8614-d9de444124e8-serving-cert\") pod \"console-operator-565b7b569d-hlv9f\" (UID: \"dd78c5ca-602a-4ec2-8614-d9de444124e8\") " pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.582795 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.582676 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 20:00:38.582795 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.582694 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f96d567d6-zvmsr: secret "image-registry-tls" not found Jul 16 20:00:38.582795 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.582691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd78c5ca-602a-4ec2-8614-d9de444124e8-trusted-ca\") pod \"console-operator-565b7b569d-hlv9f\" (UID: \"dd78c5ca-602a-4ec2-8614-d9de444124e8\") " pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.582795 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.582719 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vjl9b\" (UID: \"a6221479-7896-430d-bfc5-49b19d84a422\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:00:38.582795 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.582760 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls podName:322cb2da-6e27-4845-9081-0fec18abf287 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:39.08274002 +0000 UTC m=+35.546093051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls") pod "image-registry-f96d567d6-zvmsr" (UID: "322cb2da-6e27-4845-9081-0fec18abf287") : secret "image-registry-tls" not found Jul 16 20:00:38.583208 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.582822 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/322cb2da-6e27-4845-9081-0fec18abf287-ca-trust-extracted\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.583208 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.582849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/322cb2da-6e27-4845-9081-0fec18abf287-image-registry-private-configuration\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.583208 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.582928 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk5c8\" (UniqueName: \"kubernetes.io/projected/a6107c67-4cd3-4a39-8c05-98e0275776ac-kube-api-access-fk5c8\") pod \"kube-storage-version-migrator-operator-7658d9b749-zsw8q\" (UID: \"a6107c67-4cd3-4a39-8c05-98e0275776ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" Jul 16 20:00:38.583208 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.582979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/704043dc-663b-4a9f-a7aa-f80384bdbb39-tmp-dir\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:38.583208 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583004 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-serving-cert\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.583208 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583051 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6107c67-4cd3-4a39-8c05-98e0275776ac-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zsw8q\" (UID: \"a6107c67-4cd3-4a39-8c05-98e0275776ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" Jul 16 20:00:38.583208 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw72k\" (UniqueName: \"kubernetes.io/projected/704043dc-663b-4a9f-a7aa-f80384bdbb39-kube-api-access-qw72k\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:38.583208 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583132 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/322cb2da-6e27-4845-9081-0fec18abf287-registry-certificates\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.583208 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8a3e0f2-ab4d-472c-9495-b68e50de68c8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4gnqf\" (UID: \"d8a3e0f2-ab4d-472c-9495-b68e50de68c8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583239 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/322cb2da-6e27-4845-9081-0fec18abf287-trusted-ca\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583264 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tncrt\" (UniqueName: \"kubernetes.io/projected/d8a3e0f2-ab4d-472c-9495-b68e50de68c8-kube-api-access-tncrt\") pod \"service-ca-operator-5bcbc94c78-4gnqf\" (UID: \"d8a3e0f2-ab4d-472c-9495-b68e50de68c8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583308 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-bound-sa-token\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583320 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/322cb2da-6e27-4845-9081-0fec18abf287-ca-trust-extracted\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs5st\" (UniqueName: \"kubernetes.io/projected/a6221479-7896-430d-bfc5-49b19d84a422-kube-api-access-vs5st\") pod \"cluster-samples-operator-79b7c55f87-vjl9b\" (UID: \"a6221479-7896-430d-bfc5-49b19d84a422\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583355 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8a3e0f2-ab4d-472c-9495-b68e50de68c8-config\") pod \"service-ca-operator-5bcbc94c78-4gnqf\" (UID: \"d8a3e0f2-ab4d-472c-9495-b68e50de68c8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-service-ca-bundle\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583410 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6107c67-4cd3-4a39-8c05-98e0275776ac-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zsw8q\" (UID: \"a6107c67-4cd3-4a39-8c05-98e0275776ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-snapshots\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt9vq\" (UniqueName: \"kubernetes.io/projected/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-kube-api-access-rt9vq\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583519 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/322cb2da-6e27-4845-9081-0fec18abf287-installation-pull-secrets\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583591 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz9lk\" (UniqueName: \"kubernetes.io/projected/dd78c5ca-602a-4ec2-8614-d9de444124e8-kube-api-access-tz9lk\") pod \"console-operator-565b7b569d-hlv9f\" (UID: \"dd78c5ca-602a-4ec2-8614-d9de444124e8\") " pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.583609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583597 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc" Jul 16 20:00:38.584281 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583616 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxwtc\" (UniqueName: \"kubernetes.io/projected/92546ba6-c8be-4bca-bdd4-a4f1d283bdb7-kube-api-access-hxwtc\") pod \"volume-data-source-validator-78cf4c6f6-rjkcf\" (UID: \"92546ba6-c8be-4bca-bdd4-a4f1d283bdb7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rjkcf" Jul 16 20:00:38.584281 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd78c5ca-602a-4ec2-8614-d9de444124e8-config\") pod \"console-operator-565b7b569d-hlv9f\" (UID: \"dd78c5ca-602a-4ec2-8614-d9de444124e8\") " pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.584281 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.583873 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/322cb2da-6e27-4845-9081-0fec18abf287-registry-certificates\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.584659 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.584636 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/322cb2da-6e27-4845-9081-0fec18abf287-trusted-ca\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.587703 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.587670 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/322cb2da-6e27-4845-9081-0fec18abf287-image-registry-private-configuration\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.587867 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.587716 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/322cb2da-6e27-4845-9081-0fec18abf287-installation-pull-secrets\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.587995 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.587979 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 16 20:00:38.588083 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.588068 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-c7rt6\"" Jul 16 20:00:38.593443 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.593418 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m27x\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-kube-api-access-5m27x\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.596018 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.595998 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-bound-sa-token\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:38.615052 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.615022 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qgzz2"] Jul 16 20:00:38.615205 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.615120 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" Jul 16 20:00:38.617883 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.617797 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 16 20:00:38.633525 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.633500 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-472fn"] Jul 16 20:00:38.633752 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.633731 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf"] Jul 16 20:00:38.633752 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.633590 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qgzz2" Jul 16 20:00:38.633941 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.633781 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b"] Jul 16 20:00:38.633941 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.633809 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-hlv9f"] Jul 16 20:00:38.633941 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.633858 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-lpkxh"] Jul 16 20:00:38.633941 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.633880 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-wb7gg"] Jul 16 20:00:38.633941 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.633903 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rjkcf"] Jul 16 20:00:38.633941 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.633931 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qgzz2"] Jul 16 20:00:38.634197 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.633950 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56cbd95bbb-tngbx"] Jul 16 20:00:38.634197 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.633988 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q"] Jul 16 20:00:38.634197 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.634009 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc"] Jul 16 20:00:38.634197 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.634024 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl"] Jul 16 20:00:38.634197 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.634045 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn"] Jul 16 20:00:38.634197 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.634064 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r"] Jul 16 20:00:38.634197 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.634121 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:38.636810 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.636738 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 20:00:38.636810 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.636794 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 20:00:38.636978 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.636819 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 20:00:38.637132 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.637098 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mtlsx\"" Jul 16 20:00:38.684042 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz9lk\" (UniqueName: \"kubernetes.io/projected/dd78c5ca-602a-4ec2-8614-d9de444124e8-kube-api-access-tz9lk\") pod \"console-operator-565b7b569d-hlv9f\" (UID: \"dd78c5ca-602a-4ec2-8614-d9de444124e8\") " pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.684042 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684053 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxwtc\" (UniqueName: \"kubernetes.io/projected/92546ba6-c8be-4bca-bdd4-a4f1d283bdb7-kube-api-access-hxwtc\") pod \"volume-data-source-validator-78cf4c6f6-rjkcf\" (UID: \"92546ba6-c8be-4bca-bdd4-a4f1d283bdb7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rjkcf" Jul 16 20:00:38.684322 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd78c5ca-602a-4ec2-8614-d9de444124e8-config\") pod \"console-operator-565b7b569d-hlv9f\" (UID: \"dd78c5ca-602a-4ec2-8614-d9de444124e8\") " pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.684322 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-tmp\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.684322 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684150 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/704043dc-663b-4a9f-a7aa-f80384bdbb39-config-volume\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:38.684322 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684183 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd78c5ca-602a-4ec2-8614-d9de444124e8-serving-cert\") pod \"console-operator-565b7b569d-hlv9f\" (UID: \"dd78c5ca-602a-4ec2-8614-d9de444124e8\") " pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.684322 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684212 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/59e96a3b-d5e3-4fff-b279-f34ed99173ea-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.684322 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684237 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7300894-b683-4955-8ab2-553e6e5d8c50-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc\" (UID: \"e7300894-b683-4955-8ab2-553e6e5d8c50\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc" Jul 16 20:00:38.684322 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684282 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtzph\" (UniqueName: \"kubernetes.io/projected/f65a5ebc-fa04-4470-a13a-f1207c459f47-kube-api-access-xtzph\") pod \"network-check-source-7bc5b6bf85-wb7gg\" (UID: \"f65a5ebc-fa04-4470-a13a-f1207c459f47\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wb7gg" Jul 16 20:00:38.684322 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd78c5ca-602a-4ec2-8614-d9de444124e8-trusted-ca\") pod \"console-operator-565b7b569d-hlv9f\" (UID: \"dd78c5ca-602a-4ec2-8614-d9de444124e8\") " pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.684709 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vjl9b\" (UID: \"a6221479-7896-430d-bfc5-49b19d84a422\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:00:38.684709 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:38.684709 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk5c8\" (UniqueName: \"kubernetes.io/projected/a6107c67-4cd3-4a39-8c05-98e0275776ac-kube-api-access-fk5c8\") pod \"kube-storage-version-migrator-operator-7658d9b749-zsw8q\" (UID: \"a6107c67-4cd3-4a39-8c05-98e0275776ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" Jul 16 20:00:38.684709 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684684 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-tmp\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.684984 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/704043dc-663b-4a9f-a7aa-f80384bdbb39-tmp-dir\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:38.684984 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684811 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-serving-cert\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.684984 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6107c67-4cd3-4a39-8c05-98e0275776ac-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zsw8q\" (UID: \"a6107c67-4cd3-4a39-8c05-98e0275776ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" Jul 16 20:00:38.684984 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684874 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw72k\" (UniqueName: \"kubernetes.io/projected/704043dc-663b-4a9f-a7aa-f80384bdbb39-kube-api-access-qw72k\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:38.684984 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684878 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/704043dc-663b-4a9f-a7aa-f80384bdbb39-config-volume\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:38.684984 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684933 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/59e96a3b-d5e3-4fff-b279-f34ed99173ea-ca\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.684984 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.684948 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd78c5ca-602a-4ec2-8614-d9de444124e8-config\") pod \"console-operator-565b7b569d-hlv9f\" (UID: \"dd78c5ca-602a-4ec2-8614-d9de444124e8\") " pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.685312 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8a3e0f2-ab4d-472c-9495-b68e50de68c8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4gnqf\" (UID: \"d8a3e0f2-ab4d-472c-9495-b68e50de68c8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" Jul 16 20:00:38.685312 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.685037 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 20:00:38.685312 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685038 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7rw4\" (UniqueName: \"kubernetes.io/projected/e7300894-b683-4955-8ab2-553e6e5d8c50-kube-api-access-w7rw4\") pod \"managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc\" (UID: \"e7300894-b683-4955-8ab2-553e6e5d8c50\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc" Jul 16 20:00:38.685312 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.685107 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls podName:a6221479-7896-430d-bfc5-49b19d84a422 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:39.185088641 +0000 UTC m=+35.648441663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vjl9b" (UID: "a6221479-7896-430d-bfc5-49b19d84a422") : secret "samples-operator-tls" not found Jul 16 20:00:38.685312 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685284 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/704043dc-663b-4a9f-a7aa-f80384bdbb39-tmp-dir\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:38.685572 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685493 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tncrt\" (UniqueName: \"kubernetes.io/projected/d8a3e0f2-ab4d-472c-9495-b68e50de68c8-kube-api-access-tncrt\") pod \"service-ca-operator-5bcbc94c78-4gnqf\" (UID: \"d8a3e0f2-ab4d-472c-9495-b68e50de68c8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" Jul 16 20:00:38.685572 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41d21187-c869-44bd-8e88-601240a7aa74-tmp\") pod \"klusterlet-addon-workmgr-6568499796-nbr9r\" (UID: \"41d21187-c869-44bd-8e88-601240a7aa74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" Jul 16 20:00:38.685572 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685556 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/59e96a3b-d5e3-4fff-b279-f34ed99173ea-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.685721 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vthph\" (UniqueName: \"kubernetes.io/projected/41d21187-c869-44bd-8e88-601240a7aa74-kube-api-access-vthph\") pod \"klusterlet-addon-workmgr-6568499796-nbr9r\" (UID: \"41d21187-c869-44bd-8e88-601240a7aa74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" Jul 16 20:00:38.685721 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685609 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd78c5ca-602a-4ec2-8614-d9de444124e8-trusted-ca\") pod \"console-operator-565b7b569d-hlv9f\" (UID: \"dd78c5ca-602a-4ec2-8614-d9de444124e8\") " pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.685721 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685629 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-stats-auth\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.685721 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685654 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/59e96a3b-d5e3-4fff-b279-f34ed99173ea-hub\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.685721 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685692 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs5st\" (UniqueName: \"kubernetes.io/projected/a6221479-7896-430d-bfc5-49b19d84a422-kube-api-access-vs5st\") pod \"cluster-samples-operator-79b7c55f87-vjl9b\" (UID: \"a6221479-7896-430d-bfc5-49b19d84a422\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:00:38.685999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685755 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8a3e0f2-ab4d-472c-9495-b68e50de68c8-config\") pod \"service-ca-operator-5bcbc94c78-4gnqf\" (UID: \"d8a3e0f2-ab4d-472c-9495-b68e50de68c8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" Jul 16 20:00:38.685999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685811 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94c28\" (UniqueName: \"kubernetes.io/projected/8150a0a9-0feb-4c1d-9911-a56a59c792aa-kube-api-access-94c28\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.685999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-service-ca-bundle\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.685999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685850 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6107c67-4cd3-4a39-8c05-98e0275776ac-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-zsw8q\" (UID: \"a6107c67-4cd3-4a39-8c05-98e0275776ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" Jul 16 20:00:38.685999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685880 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/85fd6d59-457c-4fee-b0cf-738b64068a12-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:38.685999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:38.685999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.685999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/41d21187-c869-44bd-8e88-601240a7aa74-klusterlet-config\") pod \"klusterlet-addon-workmgr-6568499796-nbr9r\" (UID: \"41d21187-c869-44bd-8e88-601240a7aa74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" Jul 16 20:00:38.685999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.685991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6107c67-4cd3-4a39-8c05-98e0275776ac-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zsw8q\" (UID: \"a6107c67-4cd3-4a39-8c05-98e0275776ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" Jul 16 20:00:38.686409 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.686016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-snapshots\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.686409 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.686149 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 20:00:38.686409 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.686203 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls podName:704043dc-663b-4a9f-a7aa-f80384bdbb39 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:39.18618535 +0000 UTC m=+35.649538366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls") pod "dns-default-472fn" (UID: "704043dc-663b-4a9f-a7aa-f80384bdbb39") : secret "dns-default-metrics-tls" not found Jul 16 20:00:38.686563 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.686420 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-service-ca-bundle\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.686563 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.686467 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8a3e0f2-ab4d-472c-9495-b68e50de68c8-config\") pod \"service-ca-operator-5bcbc94c78-4gnqf\" (UID: \"d8a3e0f2-ab4d-472c-9495-b68e50de68c8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" Jul 16 20:00:38.686563 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.686514 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt9vq\" (UniqueName: \"kubernetes.io/projected/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-kube-api-access-rt9vq\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.686563 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.686547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/59e96a3b-d5e3-4fff-b279-f34ed99173ea-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.686777 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.686581 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.686777 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.686637 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntgb2\" (UniqueName: \"kubernetes.io/projected/59e96a3b-d5e3-4fff-b279-f34ed99173ea-kube-api-access-ntgb2\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.686777 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.686669 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.686777 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.686702 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcvs7\" (UniqueName: \"kubernetes.io/projected/85fd6d59-457c-4fee-b0cf-738b64068a12-kube-api-access-zcvs7\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:38.686777 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.686736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-default-certificate\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.687504 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.687461 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd78c5ca-602a-4ec2-8614-d9de444124e8-serving-cert\") pod \"console-operator-565b7b569d-hlv9f\" (UID: \"dd78c5ca-602a-4ec2-8614-d9de444124e8\") " pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.687605 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.687530 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.687856 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.687833 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-serving-cert\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.688248 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.688229 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-snapshots\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.688929 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.688906 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8a3e0f2-ab4d-472c-9495-b68e50de68c8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4gnqf\" (UID: \"d8a3e0f2-ab4d-472c-9495-b68e50de68c8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" Jul 16 20:00:38.689137 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.689115 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6107c67-4cd3-4a39-8c05-98e0275776ac-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-zsw8q\" (UID: \"a6107c67-4cd3-4a39-8c05-98e0275776ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" Jul 16 20:00:38.695014 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.694988 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz9lk\" (UniqueName: \"kubernetes.io/projected/dd78c5ca-602a-4ec2-8614-d9de444124e8-kube-api-access-tz9lk\") pod \"console-operator-565b7b569d-hlv9f\" (UID: \"dd78c5ca-602a-4ec2-8614-d9de444124e8\") " pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.695122 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.695037 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw72k\" (UniqueName: \"kubernetes.io/projected/704043dc-663b-4a9f-a7aa-f80384bdbb39-kube-api-access-qw72k\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:38.695283 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.695263 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk5c8\" (UniqueName: \"kubernetes.io/projected/a6107c67-4cd3-4a39-8c05-98e0275776ac-kube-api-access-fk5c8\") pod \"kube-storage-version-migrator-operator-7658d9b749-zsw8q\" (UID: \"a6107c67-4cd3-4a39-8c05-98e0275776ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" Jul 16 20:00:38.695440 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.695416 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxwtc\" (UniqueName: \"kubernetes.io/projected/92546ba6-c8be-4bca-bdd4-a4f1d283bdb7-kube-api-access-hxwtc\") pod \"volume-data-source-validator-78cf4c6f6-rjkcf\" (UID: \"92546ba6-c8be-4bca-bdd4-a4f1d283bdb7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rjkcf" Jul 16 20:00:38.697418 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.697384 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs5st\" (UniqueName: \"kubernetes.io/projected/a6221479-7896-430d-bfc5-49b19d84a422-kube-api-access-vs5st\") pod \"cluster-samples-operator-79b7c55f87-vjl9b\" (UID: \"a6221479-7896-430d-bfc5-49b19d84a422\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:00:38.697526 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.697447 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt9vq\" (UniqueName: \"kubernetes.io/projected/f501e4af-fcc0-4f89-8cf0-bc3831c009e2-kube-api-access-rt9vq\") pod \"insights-operator-555d9d7885-lpkxh\" (UID: \"f501e4af-fcc0-4f89-8cf0-bc3831c009e2\") " pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.697976 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.697959 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tncrt\" (UniqueName: \"kubernetes.io/projected/d8a3e0f2-ab4d-472c-9495-b68e50de68c8-kube-api-access-tncrt\") pod \"service-ca-operator-5bcbc94c78-4gnqf\" (UID: \"d8a3e0f2-ab4d-472c-9495-b68e50de68c8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" Jul 16 20:00:38.729187 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.729148 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:38.773476 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.773451 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" Jul 16 20:00:38.787869 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.787835 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:38.788053 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.787882 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/59e96a3b-d5e3-4fff-b279-f34ed99173ea-ca\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.788053 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.788011 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 20:00:38.788137 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.788073 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls podName:85fd6d59-457c-4fee-b0cf-738b64068a12 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:39.288056544 +0000 UTC m=+35.751409557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-dvfjl" (UID: "85fd6d59-457c-4fee-b0cf-738b64068a12") : secret "cluster-monitoring-operator-tls" not found Jul 16 20:00:38.788214 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788015 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7rw4\" (UniqueName: \"kubernetes.io/projected/e7300894-b683-4955-8ab2-553e6e5d8c50-kube-api-access-w7rw4\") pod \"managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc\" (UID: \"e7300894-b683-4955-8ab2-553e6e5d8c50\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc" Jul 16 20:00:38.788214 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41d21187-c869-44bd-8e88-601240a7aa74-tmp\") pod \"klusterlet-addon-workmgr-6568499796-nbr9r\" (UID: \"41d21187-c869-44bd-8e88-601240a7aa74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" Jul 16 20:00:38.788321 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/59e96a3b-d5e3-4fff-b279-f34ed99173ea-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.788321 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788262 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vthph\" (UniqueName: \"kubernetes.io/projected/41d21187-c869-44bd-8e88-601240a7aa74-kube-api-access-vthph\") pod \"klusterlet-addon-workmgr-6568499796-nbr9r\" (UID: \"41d21187-c869-44bd-8e88-601240a7aa74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" Jul 16 20:00:38.788321 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-stats-auth\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.788469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/59e96a3b-d5e3-4fff-b279-f34ed99173ea-hub\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.788469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788360 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94c28\" (UniqueName: \"kubernetes.io/projected/8150a0a9-0feb-4c1d-9911-a56a59c792aa-kube-api-access-94c28\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.788469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/85fd6d59-457c-4fee-b0cf-738b64068a12-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:38.788469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788440 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.788655 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/41d21187-c869-44bd-8e88-601240a7aa74-klusterlet-config\") pod \"klusterlet-addon-workmgr-6568499796-nbr9r\" (UID: \"41d21187-c869-44bd-8e88-601240a7aa74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" Jul 16 20:00:38.788655 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788496 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/59e96a3b-d5e3-4fff-b279-f34ed99173ea-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.788655 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788525 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgtbx\" (UniqueName: \"kubernetes.io/projected/4681653d-f640-4ade-b608-ef327d5d7fa6-kube-api-access-jgtbx\") pod \"ingress-canary-qgzz2\" (UID: \"4681653d-f640-4ade-b608-ef327d5d7fa6\") " pod="openshift-ingress-canary/ingress-canary-qgzz2" Jul 16 20:00:38.788655 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788555 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.788655 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntgb2\" (UniqueName: \"kubernetes.io/projected/59e96a3b-d5e3-4fff-b279-f34ed99173ea-kube-api-access-ntgb2\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.788655 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788612 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcvs7\" (UniqueName: \"kubernetes.io/projected/85fd6d59-457c-4fee-b0cf-738b64068a12-kube-api-access-zcvs7\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:38.788655 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788636 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41d21187-c869-44bd-8e88-601240a7aa74-tmp\") pod \"klusterlet-addon-workmgr-6568499796-nbr9r\" (UID: \"41d21187-c869-44bd-8e88-601240a7aa74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" Jul 16 20:00:38.789479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.788638 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-default-certificate\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.789479 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.789103 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 20:00:38.789479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.789122 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/59e96a3b-d5e3-4fff-b279-f34ed99173ea-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.789479 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.789159 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs podName:8150a0a9-0feb-4c1d-9911-a56a59c792aa nodeName:}" failed. No retries permitted until 2026-07-16 20:00:39.289143318 +0000 UTC m=+35.752496332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs") pod "router-default-56cbd95bbb-tngbx" (UID: "8150a0a9-0feb-4c1d-9911-a56a59c792aa") : secret "router-metrics-certs-default" not found Jul 16 20:00:38.789479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.789184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7300894-b683-4955-8ab2-553e6e5d8c50-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc\" (UID: \"e7300894-b683-4955-8ab2-553e6e5d8c50\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc" Jul 16 20:00:38.789479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.789219 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtzph\" (UniqueName: \"kubernetes.io/projected/f65a5ebc-fa04-4470-a13a-f1207c459f47-kube-api-access-xtzph\") pod \"network-check-source-7bc5b6bf85-wb7gg\" (UID: \"f65a5ebc-fa04-4470-a13a-f1207c459f47\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wb7gg" Jul 16 20:00:38.789479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.789247 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4681653d-f640-4ade-b608-ef327d5d7fa6-cert\") pod \"ingress-canary-qgzz2\" (UID: \"4681653d-f640-4ade-b608-ef327d5d7fa6\") " pod="openshift-ingress-canary/ingress-canary-qgzz2" Jul 16 20:00:38.789479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.789245 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/59e96a3b-d5e3-4fff-b279-f34ed99173ea-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.790479 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:38.790460 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle podName:8150a0a9-0feb-4c1d-9911-a56a59c792aa nodeName:}" failed. No retries permitted until 2026-07-16 20:00:39.290439391 +0000 UTC m=+35.753792401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle") pod "router-default-56cbd95bbb-tngbx" (UID: "8150a0a9-0feb-4c1d-9911-a56a59c792aa") : configmap references non-existent config key: service-ca.crt Jul 16 20:00:38.791086 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.791060 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/85fd6d59-457c-4fee-b0cf-738b64068a12-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:38.791201 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.791061 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/59e96a3b-d5e3-4fff-b279-f34ed99173ea-ca\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.792166 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.792145 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/41d21187-c869-44bd-8e88-601240a7aa74-klusterlet-config\") pod \"klusterlet-addon-workmgr-6568499796-nbr9r\" (UID: \"41d21187-c869-44bd-8e88-601240a7aa74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" Jul 16 20:00:38.792304 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.792259 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7300894-b683-4955-8ab2-553e6e5d8c50-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc\" (UID: \"e7300894-b683-4955-8ab2-553e6e5d8c50\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc" Jul 16 20:00:38.792844 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.792819 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-default-certificate\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.793066 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.793047 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/59e96a3b-d5e3-4fff-b279-f34ed99173ea-hub\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.793370 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.793350 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/59e96a3b-d5e3-4fff-b279-f34ed99173ea-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.793816 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.793795 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:38.794202 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.794186 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/59e96a3b-d5e3-4fff-b279-f34ed99173ea-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.794618 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.794598 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-stats-auth\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.799567 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.799509 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vthph\" (UniqueName: \"kubernetes.io/projected/41d21187-c869-44bd-8e88-601240a7aa74-kube-api-access-vthph\") pod \"klusterlet-addon-workmgr-6568499796-nbr9r\" (UID: \"41d21187-c869-44bd-8e88-601240a7aa74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" Jul 16 20:00:38.799938 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.799903 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7rw4\" (UniqueName: \"kubernetes.io/projected/e7300894-b683-4955-8ab2-553e6e5d8c50-kube-api-access-w7rw4\") pod \"managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc\" (UID: \"e7300894-b683-4955-8ab2-553e6e5d8c50\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc" Jul 16 20:00:38.800664 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.800642 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtzph\" (UniqueName: \"kubernetes.io/projected/f65a5ebc-fa04-4470-a13a-f1207c459f47-kube-api-access-xtzph\") pod \"network-check-source-7bc5b6bf85-wb7gg\" (UID: \"f65a5ebc-fa04-4470-a13a-f1207c459f47\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wb7gg" Jul 16 20:00:38.801255 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.801228 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94c28\" (UniqueName: \"kubernetes.io/projected/8150a0a9-0feb-4c1d-9911-a56a59c792aa-kube-api-access-94c28\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:38.801662 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.801506 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rjkcf" Jul 16 20:00:38.801980 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.801960 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntgb2\" (UniqueName: \"kubernetes.io/projected/59e96a3b-d5e3-4fff-b279-f34ed99173ea-kube-api-access-ntgb2\") pod \"cluster-proxy-proxy-agent-5745d69998-4jxxn\" (UID: \"59e96a3b-d5e3-4fff-b279-f34ed99173ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.802067 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.801983 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcvs7\" (UniqueName: \"kubernetes.io/projected/85fd6d59-457c-4fee-b0cf-738b64068a12-kube-api-access-zcvs7\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:38.817428 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.817378 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" Jul 16 20:00:38.827928 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.827891 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-lpkxh" Jul 16 20:00:38.863967 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.863938 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wb7gg" Jul 16 20:00:38.885155 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.885122 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:00:38.890886 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.889946 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4681653d-f640-4ade-b608-ef327d5d7fa6-cert\") pod \"ingress-canary-qgzz2\" (UID: \"4681653d-f640-4ade-b608-ef327d5d7fa6\") " pod="openshift-ingress-canary/ingress-canary-qgzz2" Jul 16 20:00:38.890886 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.890094 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgtbx\" (UniqueName: \"kubernetes.io/projected/4681653d-f640-4ade-b608-ef327d5d7fa6-kube-api-access-jgtbx\") pod \"ingress-canary-qgzz2\" (UID: \"4681653d-f640-4ade-b608-ef327d5d7fa6\") " pod="openshift-ingress-canary/ingress-canary-qgzz2" Jul 16 20:00:38.895102 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.895024 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4681653d-f640-4ade-b608-ef327d5d7fa6-cert\") pod \"ingress-canary-qgzz2\" (UID: \"4681653d-f640-4ade-b608-ef327d5d7fa6\") " pod="openshift-ingress-canary/ingress-canary-qgzz2" Jul 16 20:00:38.904950 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.904308 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgtbx\" (UniqueName: \"kubernetes.io/projected/4681653d-f640-4ade-b608-ef327d5d7fa6-kube-api-access-jgtbx\") pod \"ingress-canary-qgzz2\" (UID: \"4681653d-f640-4ade-b608-ef327d5d7fa6\") " pod="openshift-ingress-canary/ingress-canary-qgzz2" Jul 16 20:00:38.911824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.910262 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc" Jul 16 20:00:38.935166 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.935053 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" Jul 16 20:00:38.946406 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:38.946330 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qgzz2" Jul 16 20:00:39.018640 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.017412 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:00:39.022537 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.022084 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sfzlm\"" Jul 16 20:00:39.022537 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.022333 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 20:00:39.069422 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.068358 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rjkcf"] Jul 16 20:00:39.098364 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.097081 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-hlv9f"] Jul 16 20:00:39.098364 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.097683 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:39.098364 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:39.097921 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 20:00:39.098364 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:39.097935 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f96d567d6-zvmsr: secret "image-registry-tls" not found Jul 16 20:00:39.098364 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:39.097994 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls podName:322cb2da-6e27-4845-9081-0fec18abf287 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:40.097972533 +0000 UTC m=+36.561325544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls") pod "image-registry-f96d567d6-zvmsr" (UID: "322cb2da-6e27-4845-9081-0fec18abf287") : secret "image-registry-tls" not found Jul 16 20:00:39.134564 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.134346 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf"] Jul 16 20:00:39.134564 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.134453 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q"] Jul 16 20:00:39.182277 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.182189 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-lpkxh"] Jul 16 20:00:39.189925 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:39.189860 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf501e4af_fcc0_4f89_8cf0_bc3831c009e2.slice/crio-b8d9706dbe8fa71cf118d5e6488225c993d1a4e3de1251b1a83d6780f7753659 WatchSource:0}: Error finding container b8d9706dbe8fa71cf118d5e6488225c993d1a4e3de1251b1a83d6780f7753659: Status 404 returned error can't find the container with id b8d9706dbe8fa71cf118d5e6488225c993d1a4e3de1251b1a83d6780f7753659 Jul 16 20:00:39.195630 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.195477 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rjkcf" event={"ID":"92546ba6-c8be-4bca-bdd4-a4f1d283bdb7","Type":"ContainerStarted","Data":"471eb811910c5f8f25514522999bf6ad1a2d2f31d997271c5f57b545d0104cc9"} Jul 16 20:00:39.199613 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.198336 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:39.199613 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.198463 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vjl9b\" (UID: \"a6221479-7896-430d-bfc5-49b19d84a422\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:00:39.199613 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:39.198961 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 20:00:39.199613 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:39.199016 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls podName:704043dc-663b-4a9f-a7aa-f80384bdbb39 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:40.198996726 +0000 UTC m=+36.662349741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls") pod "dns-default-472fn" (UID: "704043dc-663b-4a9f-a7aa-f80384bdbb39") : secret "dns-default-metrics-tls" not found Jul 16 20:00:39.199613 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:39.199075 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 20:00:39.199613 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:39.199107 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls podName:a6221479-7896-430d-bfc5-49b19d84a422 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:40.199097051 +0000 UTC m=+36.662450064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vjl9b" (UID: "a6221479-7896-430d-bfc5-49b19d84a422") : secret "samples-operator-tls" not found Jul 16 20:00:39.200222 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.199316 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" event={"ID":"dd78c5ca-602a-4ec2-8614-d9de444124e8","Type":"ContainerStarted","Data":"f53b1c3bd082966c19c1f834f9464c1c0a8f22e57ac7d4fb418a7305a65fbbac"} Jul 16 20:00:39.202808 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.202779 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" event={"ID":"d8a3e0f2-ab4d-472c-9495-b68e50de68c8","Type":"ContainerStarted","Data":"2ab95d7e8f8e6a1f00617d7884b8443083d56cd6cb20df2af3f03f5e40f278dd"} Jul 16 20:00:39.210517 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.209301 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" event={"ID":"a6107c67-4cd3-4a39-8c05-98e0275776ac","Type":"ContainerStarted","Data":"637fd0ba2eb94ebc2ca27ee785bf16d52b9378a2a71c5fa7542fae580d37eb86"} Jul 16 20:00:39.228392 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.228303 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qgzz2"] Jul 16 20:00:39.235745 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:39.235553 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4681653d_f640_4ade_b608_ef327d5d7fa6.slice/crio-a96924cb7b01c0249ea97844a51abc336d4a315d7c9343caa5a8135076422c56 WatchSource:0}: Error finding container a96924cb7b01c0249ea97844a51abc336d4a315d7c9343caa5a8135076422c56: Status 404 returned error can't find the container with id a96924cb7b01c0249ea97844a51abc336d4a315d7c9343caa5a8135076422c56 Jul 16 20:00:39.264675 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.264638 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r"] Jul 16 20:00:39.268642 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:39.268610 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d21187_c869_44bd_8e88_601240a7aa74.slice/crio-0ae988e9135d67b522e481207970db2fb030d634782069fefc4d04d56d78162f WatchSource:0}: Error finding container 0ae988e9135d67b522e481207970db2fb030d634782069fefc4d04d56d78162f: Status 404 returned error can't find the container with id 0ae988e9135d67b522e481207970db2fb030d634782069fefc4d04d56d78162f Jul 16 20:00:39.269435 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.269408 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc"] Jul 16 20:00:39.272256 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.272212 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn"] Jul 16 20:00:39.274208 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:39.274137 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7300894_b683_4955_8ab2_553e6e5d8c50.slice/crio-fbe2e4deb6f8fe9ab6181ebcf4e2255a704453830da98f51525db81d78a6fd4f WatchSource:0}: Error finding container fbe2e4deb6f8fe9ab6181ebcf4e2255a704453830da98f51525db81d78a6fd4f: Status 404 returned error can't find the container with id fbe2e4deb6f8fe9ab6181ebcf4e2255a704453830da98f51525db81d78a6fd4f Jul 16 20:00:39.278110 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:39.278087 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59e96a3b_d5e3_4fff_b279_f34ed99173ea.slice/crio-01353b667a4122c4acc001b072e24305c004a62d01311fe1c5c8cf1c5e911c6c WatchSource:0}: Error finding container 01353b667a4122c4acc001b072e24305c004a62d01311fe1c5c8cf1c5e911c6c: Status 404 returned error can't find the container with id 01353b667a4122c4acc001b072e24305c004a62d01311fe1c5c8cf1c5e911c6c Jul 16 20:00:39.286014 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.285993 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-wb7gg"] Jul 16 20:00:39.288979 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:39.288953 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf65a5ebc_fa04_4470_a13a_f1207c459f47.slice/crio-0766a97f975feb99a034aed35ea30cf7b97602b151bb45bedddacfc12f2d3814 WatchSource:0}: Error finding container 0766a97f975feb99a034aed35ea30cf7b97602b151bb45bedddacfc12f2d3814: Status 404 returned error can't find the container with id 0766a97f975feb99a034aed35ea30cf7b97602b151bb45bedddacfc12f2d3814 Jul 16 20:00:39.300010 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.299962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:39.300123 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.300072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:39.300175 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:39.300123 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 20:00:39.300212 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:39.300177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:39.300212 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:39.300190 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs podName:8150a0a9-0feb-4c1d-9911-a56a59c792aa nodeName:}" failed. No retries permitted until 2026-07-16 20:00:40.300172667 +0000 UTC m=+36.763525676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs") pod "router-default-56cbd95bbb-tngbx" (UID: "8150a0a9-0feb-4c1d-9911-a56a59c792aa") : secret "router-metrics-certs-default" not found Jul 16 20:00:39.300310 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:39.300232 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 20:00:39.300310 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:39.300267 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle podName:8150a0a9-0feb-4c1d-9911-a56a59c792aa nodeName:}" failed. No retries permitted until 2026-07-16 20:00:40.30025346 +0000 UTC m=+36.763606487 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle") pod "router-default-56cbd95bbb-tngbx" (UID: "8150a0a9-0feb-4c1d-9911-a56a59c792aa") : configmap references non-existent config key: service-ca.crt Jul 16 20:00:39.300310 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:39.300291 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls podName:85fd6d59-457c-4fee-b0cf-738b64068a12 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:40.300273484 +0000 UTC m=+36.763626509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-dvfjl" (UID: "85fd6d59-457c-4fee-b0cf-738b64068a12") : secret "cluster-monitoring-operator-tls" not found Jul 16 20:00:40.014336 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.013927 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:00:40.015280 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.015052 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:00:40.017358 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.016943 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 20:00:40.018135 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.017945 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxdf6\"" Jul 16 20:00:40.109309 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.108529 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:40.109309 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:40.108870 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 20:00:40.109309 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:40.108889 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f96d567d6-zvmsr: secret "image-registry-tls" not found Jul 16 20:00:40.109309 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:40.108949 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls podName:322cb2da-6e27-4845-9081-0fec18abf287 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:42.108929857 +0000 UTC m=+38.572282868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls") pod "image-registry-f96d567d6-zvmsr" (UID: "322cb2da-6e27-4845-9081-0fec18abf287") : secret "image-registry-tls" not found Jul 16 20:00:40.210272 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.210223 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:40.210508 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.210341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vjl9b\" (UID: \"a6221479-7896-430d-bfc5-49b19d84a422\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:00:40.210508 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:40.210481 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 20:00:40.210633 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:40.210543 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls podName:a6221479-7896-430d-bfc5-49b19d84a422 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:42.210524635 +0000 UTC m=+38.673877663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vjl9b" (UID: "a6221479-7896-430d-bfc5-49b19d84a422") : secret "samples-operator-tls" not found Jul 16 20:00:40.210996 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:40.210880 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 20:00:40.210996 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:40.210938 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls podName:704043dc-663b-4a9f-a7aa-f80384bdbb39 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:42.21092039 +0000 UTC m=+38.674273452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls") pod "dns-default-472fn" (UID: "704043dc-663b-4a9f-a7aa-f80384bdbb39") : secret "dns-default-metrics-tls" not found Jul 16 20:00:40.217340 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.217267 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" event={"ID":"59e96a3b-d5e3-4fff-b279-f34ed99173ea","Type":"ContainerStarted","Data":"01353b667a4122c4acc001b072e24305c004a62d01311fe1c5c8cf1c5e911c6c"} Jul 16 20:00:40.220100 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.220006 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wb7gg" event={"ID":"f65a5ebc-fa04-4470-a13a-f1207c459f47","Type":"ContainerStarted","Data":"0766a97f975feb99a034aed35ea30cf7b97602b151bb45bedddacfc12f2d3814"} Jul 16 20:00:40.222782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.222675 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" event={"ID":"41d21187-c869-44bd-8e88-601240a7aa74","Type":"ContainerStarted","Data":"0ae988e9135d67b522e481207970db2fb030d634782069fefc4d04d56d78162f"} Jul 16 20:00:40.224842 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.224744 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-lpkxh" event={"ID":"f501e4af-fcc0-4f89-8cf0-bc3831c009e2","Type":"ContainerStarted","Data":"b8d9706dbe8fa71cf118d5e6488225c993d1a4e3de1251b1a83d6780f7753659"} Jul 16 20:00:40.227098 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.226958 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qgzz2" event={"ID":"4681653d-f640-4ade-b608-ef327d5d7fa6","Type":"ContainerStarted","Data":"a96924cb7b01c0249ea97844a51abc336d4a315d7c9343caa5a8135076422c56"} Jul 16 20:00:40.229034 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.228977 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc" event={"ID":"e7300894-b683-4955-8ab2-553e6e5d8c50","Type":"ContainerStarted","Data":"fbe2e4deb6f8fe9ab6181ebcf4e2255a704453830da98f51525db81d78a6fd4f"} Jul 16 20:00:40.312579 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.311602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:40.312579 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.311728 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:40.312579 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:40.311788 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:40.312579 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:40.311914 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 20:00:40.312579 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:40.311977 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs podName:8150a0a9-0feb-4c1d-9911-a56a59c792aa nodeName:}" failed. No retries permitted until 2026-07-16 20:00:42.311958904 +0000 UTC m=+38.775311915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs") pod "router-default-56cbd95bbb-tngbx" (UID: "8150a0a9-0feb-4c1d-9911-a56a59c792aa") : secret "router-metrics-certs-default" not found Jul 16 20:00:40.312579 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:40.312372 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 20:00:40.312579 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:40.312420 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls podName:85fd6d59-457c-4fee-b0cf-738b64068a12 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:42.312405232 +0000 UTC m=+38.775758243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-dvfjl" (UID: "85fd6d59-457c-4fee-b0cf-738b64068a12") : secret "cluster-monitoring-operator-tls" not found Jul 16 20:00:40.312579 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:40.312489 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle podName:8150a0a9-0feb-4c1d-9911-a56a59c792aa nodeName:}" failed. No retries permitted until 2026-07-16 20:00:42.312475667 +0000 UTC m=+38.775828679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle") pod "router-default-56cbd95bbb-tngbx" (UID: "8150a0a9-0feb-4c1d-9911-a56a59c792aa") : configmap references non-existent config key: service-ca.crt Jul 16 20:00:42.133806 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.133748 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:42.134298 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.133896 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 20:00:42.134298 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.133921 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f96d567d6-zvmsr: secret "image-registry-tls" not found Jul 16 20:00:42.134298 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.133996 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls podName:322cb2da-6e27-4845-9081-0fec18abf287 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:46.133975048 +0000 UTC m=+42.597328063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls") pod "image-registry-f96d567d6-zvmsr" (UID: "322cb2da-6e27-4845-9081-0fec18abf287") : secret "image-registry-tls" not found Jul 16 20:00:42.236282 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.235428 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:42.236282 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.235568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vjl9b\" (UID: \"a6221479-7896-430d-bfc5-49b19d84a422\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:00:42.236282 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.235737 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 20:00:42.236282 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.235825 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls podName:a6221479-7896-430d-bfc5-49b19d84a422 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:46.235801817 +0000 UTC m=+42.699154832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vjl9b" (UID: "a6221479-7896-430d-bfc5-49b19d84a422") : secret "samples-operator-tls" not found Jul 16 20:00:42.236282 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.235891 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 20:00:42.236282 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.235924 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls podName:704043dc-663b-4a9f-a7aa-f80384bdbb39 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:46.235912708 +0000 UTC m=+42.699265722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls") pod "dns-default-472fn" (UID: "704043dc-663b-4a9f-a7aa-f80384bdbb39") : secret "dns-default-metrics-tls" not found Jul 16 20:00:42.337192 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.337155 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:42.337370 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.337289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:42.337370 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.337330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:42.337603 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.337500 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 20:00:42.337603 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.337569 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs podName:8150a0a9-0feb-4c1d-9911-a56a59c792aa nodeName:}" failed. No retries permitted until 2026-07-16 20:00:46.337549257 +0000 UTC m=+42.800902269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs") pod "router-default-56cbd95bbb-tngbx" (UID: "8150a0a9-0feb-4c1d-9911-a56a59c792aa") : secret "router-metrics-certs-default" not found Jul 16 20:00:42.337982 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.337950 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle podName:8150a0a9-0feb-4c1d-9911-a56a59c792aa nodeName:}" failed. No retries permitted until 2026-07-16 20:00:46.337933116 +0000 UTC m=+42.801286150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle") pod "router-default-56cbd95bbb-tngbx" (UID: "8150a0a9-0feb-4c1d-9911-a56a59c792aa") : configmap references non-existent config key: service-ca.crt Jul 16 20:00:42.338107 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.337985 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 20:00:42.338107 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.338024 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls podName:85fd6d59-457c-4fee-b0cf-738b64068a12 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:46.338012495 +0000 UTC m=+42.801365504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-dvfjl" (UID: "85fd6d59-457c-4fee-b0cf-738b64068a12") : secret "cluster-monitoring-operator-tls" not found Jul 16 20:00:42.429664 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.428396 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9"] Jul 16 20:00:42.442964 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.442382 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:00:42.443899 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.443757 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9"] Jul 16 20:00:42.446595 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.445021 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7jpc9\"" Jul 16 20:00:42.449906 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.448887 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 16 20:00:42.449906 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.449014 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 16 20:00:42.539474 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.539422 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-q8cx9\" (UID: \"686d2769-c251-462c-b369-72a88d8b4eb3\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:00:42.539661 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.539522 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/686d2769-c251-462c-b369-72a88d8b4eb3-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-q8cx9\" (UID: \"686d2769-c251-462c-b369-72a88d8b4eb3\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:00:42.553601 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.553558 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:42.640694 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.640655 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-q8cx9\" (UID: \"686d2769-c251-462c-b369-72a88d8b4eb3\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:00:42.640895 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.640731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/686d2769-c251-462c-b369-72a88d8b4eb3-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-q8cx9\" (UID: \"686d2769-c251-462c-b369-72a88d8b4eb3\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:00:42.640895 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.640867 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 20:00:42.640972 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:42.640949 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert podName:686d2769-c251-462c-b369-72a88d8b4eb3 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:43.140926894 +0000 UTC m=+39.604279903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-q8cx9" (UID: "686d2769-c251-462c-b369-72a88d8b4eb3") : secret "networking-console-plugin-cert" not found Jul 16 20:00:42.641586 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.641555 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/686d2769-c251-462c-b369-72a88d8b4eb3-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-q8cx9\" (UID: \"686d2769-c251-462c-b369-72a88d8b4eb3\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:00:42.653465 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.653414 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:42.755374 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.755252 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:42.835839 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:42.835760 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:43.145367 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:43.145328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-q8cx9\" (UID: \"686d2769-c251-462c-b369-72a88d8b4eb3\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:00:43.145889 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:43.145521 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 20:00:43.145889 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:43.145603 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert podName:686d2769-c251-462c-b369-72a88d8b4eb3 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:44.145580079 +0000 UTC m=+40.608933094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-q8cx9" (UID: "686d2769-c251-462c-b369-72a88d8b4eb3") : secret "networking-console-plugin-cert" not found Jul 16 20:00:43.803784 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:43.803720 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:43.865886 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:43.865823 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:44.156726 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:44.156693 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-q8cx9\" (UID: \"686d2769-c251-462c-b369-72a88d8b4eb3\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:00:44.157106 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:44.156837 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 20:00:44.157106 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:44.156895 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert podName:686d2769-c251-462c-b369-72a88d8b4eb3 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:46.156882199 +0000 UTC m=+42.620235207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-q8cx9" (UID: "686d2769-c251-462c-b369-72a88d8b4eb3") : secret "networking-console-plugin-cert" not found Jul 16 20:00:45.482939 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:45.482903 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:45.585385 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:45.585291 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:46.178490 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:46.178447 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:46.178689 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:46.178557 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-q8cx9\" (UID: \"686d2769-c251-462c-b369-72a88d8b4eb3\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:00:46.178757 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.178713 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 20:00:46.178757 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.178725 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 20:00:46.178757 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.178738 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f96d567d6-zvmsr: secret "image-registry-tls" not found Jul 16 20:00:46.178934 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.178831 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert podName:686d2769-c251-462c-b369-72a88d8b4eb3 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:50.178805828 +0000 UTC m=+46.642158858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-q8cx9" (UID: "686d2769-c251-462c-b369-72a88d8b4eb3") : secret "networking-console-plugin-cert" not found Jul 16 20:00:46.178934 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.178853 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls podName:322cb2da-6e27-4845-9081-0fec18abf287 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:54.178843462 +0000 UTC m=+50.642196489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls") pod "image-registry-f96d567d6-zvmsr" (UID: "322cb2da-6e27-4845-9081-0fec18abf287") : secret "image-registry-tls" not found Jul 16 20:00:46.279581 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:46.279542 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vjl9b\" (UID: \"a6221479-7896-430d-bfc5-49b19d84a422\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:00:46.279789 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:46.279665 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:46.279789 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.279741 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 20:00:46.279907 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.279798 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 20:00:46.279907 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.279870 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls podName:704043dc-663b-4a9f-a7aa-f80384bdbb39 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:54.279848335 +0000 UTC m=+50.743201345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls") pod "dns-default-472fn" (UID: "704043dc-663b-4a9f-a7aa-f80384bdbb39") : secret "dns-default-metrics-tls" not found Jul 16 20:00:46.279907 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.279890 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls podName:a6221479-7896-430d-bfc5-49b19d84a422 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:54.279880434 +0000 UTC m=+50.743233445 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vjl9b" (UID: "a6221479-7896-430d-bfc5-49b19d84a422") : secret "samples-operator-tls" not found Jul 16 20:00:46.381578 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:46.381169 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:46.381578 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:46.381235 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:46.381578 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:46.381329 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:46.381578 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.381364 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle podName:8150a0a9-0feb-4c1d-9911-a56a59c792aa nodeName:}" failed. No retries permitted until 2026-07-16 20:00:54.381344313 +0000 UTC m=+50.844697341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle") pod "router-default-56cbd95bbb-tngbx" (UID: "8150a0a9-0feb-4c1d-9911-a56a59c792aa") : configmap references non-existent config key: service-ca.crt Jul 16 20:00:46.381578 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.381424 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 20:00:46.381578 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.381461 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls podName:85fd6d59-457c-4fee-b0cf-738b64068a12 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:54.381450093 +0000 UTC m=+50.844803108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-dvfjl" (UID: "85fd6d59-457c-4fee-b0cf-738b64068a12") : secret "cluster-monitoring-operator-tls" not found Jul 16 20:00:46.381578 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.381525 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 20:00:46.381578 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:46.381555 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs podName:8150a0a9-0feb-4c1d-9911-a56a59c792aa nodeName:}" failed. No retries permitted until 2026-07-16 20:00:54.381544674 +0000 UTC m=+50.844897683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs") pod "router-default-56cbd95bbb-tngbx" (UID: "8150a0a9-0feb-4c1d-9911-a56a59c792aa") : secret "router-metrics-certs-default" not found Jul 16 20:00:46.662807 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:46.662752 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:46.757788 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:46.757731 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:47.118079 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:47.118040 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:47.261802 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:47.261714 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:47.644792 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:47.644707 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:47.724924 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:47.724883 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:50.217033 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:50.216993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-q8cx9\" (UID: \"686d2769-c251-462c-b369-72a88d8b4eb3\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:00:50.217594 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:50.217167 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 20:00:50.217594 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:50.217255 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert podName:686d2769-c251-462c-b369-72a88d8b4eb3 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:58.217231833 +0000 UTC m=+54.680584856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-q8cx9" (UID: "686d2769-c251-462c-b369-72a88d8b4eb3") : secret "networking-console-plugin-cert" not found Jul 16 20:00:51.643457 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:51.643398 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:54.248061 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:54.248034 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:00:54.248359 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:54.248195 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 20:00:54.248359 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:54.248217 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f96d567d6-zvmsr: secret "image-registry-tls" not found Jul 16 20:00:54.248359 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:54.248276 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls podName:322cb2da-6e27-4845-9081-0fec18abf287 nodeName:}" failed. No retries permitted until 2026-07-16 20:01:10.248256423 +0000 UTC m=+66.711609456 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls") pod "image-registry-f96d567d6-zvmsr" (UID: "322cb2da-6e27-4845-9081-0fec18abf287") : secret "image-registry-tls" not found Jul 16 20:00:54.349237 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:54.349148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:00:54.349313 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:54.349280 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vjl9b\" (UID: \"a6221479-7896-430d-bfc5-49b19d84a422\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:00:54.349695 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:54.349460 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 20:00:54.349695 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:54.349535 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls podName:a6221479-7896-430d-bfc5-49b19d84a422 nodeName:}" failed. No retries permitted until 2026-07-16 20:01:10.349513059 +0000 UTC m=+66.812866068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vjl9b" (UID: "a6221479-7896-430d-bfc5-49b19d84a422") : secret "samples-operator-tls" not found Jul 16 20:00:54.349695 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:54.349608 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 20:00:54.349695 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:54.349642 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls podName:704043dc-663b-4a9f-a7aa-f80384bdbb39 nodeName:}" failed. No retries permitted until 2026-07-16 20:01:10.349630879 +0000 UTC m=+66.812983891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls") pod "dns-default-472fn" (UID: "704043dc-663b-4a9f-a7aa-f80384bdbb39") : secret "dns-default-metrics-tls" not found Jul 16 20:00:54.451836 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:54.450213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:54.451836 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:54.450334 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:00:54.451836 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:54.450460 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:00:54.451836 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:54.450604 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle podName:8150a0a9-0feb-4c1d-9911-a56a59c792aa nodeName:}" failed. No retries permitted until 2026-07-16 20:01:10.450582801 +0000 UTC m=+66.913935829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle") pod "router-default-56cbd95bbb-tngbx" (UID: "8150a0a9-0feb-4c1d-9911-a56a59c792aa") : configmap references non-existent config key: service-ca.crt Jul 16 20:00:54.451836 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:54.450689 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 20:00:54.451836 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:54.450722 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs podName:8150a0a9-0feb-4c1d-9911-a56a59c792aa nodeName:}" failed. No retries permitted until 2026-07-16 20:01:10.450711298 +0000 UTC m=+66.914064325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs") pod "router-default-56cbd95bbb-tngbx" (UID: "8150a0a9-0feb-4c1d-9911-a56a59c792aa") : secret "router-metrics-certs-default" not found Jul 16 20:00:54.451836 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:54.450811 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 20:00:54.451836 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:54.450845 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls podName:85fd6d59-457c-4fee-b0cf-738b64068a12 nodeName:}" failed. No retries permitted until 2026-07-16 20:01:10.450835326 +0000 UTC m=+66.914188335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-dvfjl" (UID: "85fd6d59-457c-4fee-b0cf-738b64068a12") : secret "cluster-monitoring-operator-tls" not found Jul 16 20:00:55.284551 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.284511 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" event={"ID":"41d21187-c869-44bd-8e88-601240a7aa74","Type":"ContainerStarted","Data":"97650bef455b2ea32d1c6941dc75f4d1ab37e050ffc27feab876ab9902b422e1"} Jul 16 20:00:55.285051 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.284872 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" Jul 16 20:00:55.286582 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.286488 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-lpkxh" event={"ID":"f501e4af-fcc0-4f89-8cf0-bc3831c009e2","Type":"ContainerStarted","Data":"336306f62dd2f5129bb4c8578e3399239b369c78fb91f8660ea763cad1e418e3"} Jul 16 20:00:55.286739 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.286603 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" Jul 16 20:00:55.288395 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.288367 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qgzz2" event={"ID":"4681653d-f640-4ade-b608-ef327d5d7fa6","Type":"ContainerStarted","Data":"1dd1f3967109dd231b854e65efe2b209f950cf08d6f61617fa2897e27daff188"} Jul 16 20:00:55.291950 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.291915 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc" event={"ID":"e7300894-b683-4955-8ab2-553e6e5d8c50","Type":"ContainerStarted","Data":"65c12b8221287f4ce41acbc61fe51183104bef02726e2ae894d6cdf05d69498e"} Jul 16 20:00:55.294082 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.294052 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rjkcf" event={"ID":"92546ba6-c8be-4bca-bdd4-a4f1d283bdb7","Type":"ContainerStarted","Data":"5f5f0e19341b35342e33180500392cee9505a7a421081f67cae401da31d1faa0"} Jul 16 20:00:55.300841 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.300815 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/0.log" Jul 16 20:00:55.301047 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.301021 2575 generic.go:356] "Generic (PLEG): container finished" podID="dd78c5ca-602a-4ec2-8614-d9de444124e8" containerID="523666793be66acbbb1a0b6200448934bfff2220e79db14f6ec59a5afab0e62e" exitCode=255 Jul 16 20:00:55.301357 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.301299 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" event={"ID":"dd78c5ca-602a-4ec2-8614-d9de444124e8","Type":"ContainerDied","Data":"523666793be66acbbb1a0b6200448934bfff2220e79db14f6ec59a5afab0e62e"} Jul 16 20:00:55.301431 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.301390 2575 scope.go:117] "RemoveContainer" containerID="523666793be66acbbb1a0b6200448934bfff2220e79db14f6ec59a5afab0e62e" Jul 16 20:00:55.306706 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.306675 2575 generic.go:356] "Generic (PLEG): container finished" podID="01f639df-639a-4d2c-a211-08c940b1eaa5" containerID="429ab97652982542e79dd30a2ee9dea24eea45e35e7f3728f74d4270dd4b6eaa" exitCode=0 Jul 16 20:00:55.306843 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.306812 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwhmx" event={"ID":"01f639df-639a-4d2c-a211-08c940b1eaa5","Type":"ContainerDied","Data":"429ab97652982542e79dd30a2ee9dea24eea45e35e7f3728f74d4270dd4b6eaa"} Jul 16 20:00:55.309921 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.309896 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" event={"ID":"d8a3e0f2-ab4d-472c-9495-b68e50de68c8","Type":"ContainerStarted","Data":"1b9b404f5cecdc88be2d1afc391702cf679d9ec45a364961d58db036eabfa17b"} Jul 16 20:00:55.312683 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.312660 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" event={"ID":"59e96a3b-d5e3-4fff-b279-f34ed99173ea","Type":"ContainerStarted","Data":"70e53a6a4065f2e0702d562eb755ef2f65d56add55632cb59524c0d52af18241"} Jul 16 20:00:55.313291 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.313273 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" event={"ID":"59e96a3b-d5e3-4fff-b279-f34ed99173ea","Type":"ContainerStarted","Data":"80264b9b13646b56d822de9781dc40e35c5128ec007a0373f5447e32d05171fe"} Jul 16 20:00:55.313431 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.313414 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" event={"ID":"59e96a3b-d5e3-4fff-b279-f34ed99173ea","Type":"ContainerStarted","Data":"0a917fe3bb5c4c2c34e2f01dfad4a1cae744617f3e4118261e81aa9da874a041"} Jul 16 20:00:55.315071 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.314919 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wb7gg" event={"ID":"f65a5ebc-fa04-4470-a13a-f1207c459f47","Type":"ContainerStarted","Data":"7cf2d9869cb299c3daeb7c67175a9b974ee7f86212586d4363227bc757e09fae"} Jul 16 20:00:55.316644 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.316619 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" event={"ID":"a6107c67-4cd3-4a39-8c05-98e0275776ac","Type":"ContainerStarted","Data":"2cf6294b0380c9f826e0d89564db4c874b3bf4fac260df8a6a2c235eae8a2cef"} Jul 16 20:00:55.320813 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.320753 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6568499796-nbr9r" podStartSLOduration=8.581191328 podStartE2EDuration="23.32073418s" totalImagesPullingTime="14.739542852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:55.304274764 +0000 UTC m=+51.767627796" watchObservedRunningTime="2026-07-16 20:00:55.32073418 +0000 UTC m=+51.784087194" Jul 16 20:00:55.321462 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.321431 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rjkcf" podStartSLOduration=13.242527535 podStartE2EDuration="28.321421036s" totalImagesPullingTime="15.078893501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:55.320655338 +0000 UTC m=+51.784008370" watchObservedRunningTime="2026-07-16 20:00:55.321421036 +0000 UTC m=+51.784774068" Jul 16 20:00:55.340863 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.340795 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qgzz2" podStartSLOduration=2.61662485 podStartE2EDuration="17.340600674s" totalImagesPullingTime="14.723975824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:55.339539762 +0000 UTC m=+51.802892792" watchObservedRunningTime="2026-07-16 20:00:55.340600674 +0000 UTC m=+51.803953705" Jul 16 20:00:55.415438 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.413713 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dd98cdcc8-mjqrc" podStartSLOduration=8.690615147 podStartE2EDuration="23.413692105s" totalImagesPullingTime="14.723076958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:55.41364572 +0000 UTC m=+51.876998758" watchObservedRunningTime="2026-07-16 20:00:55.413692105 +0000 UTC m=+51.877045116" Jul 16 20:00:55.439230 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.438622 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-lpkxh" podStartSLOduration=13.635587822 podStartE2EDuration="28.438599827s" totalImagesPullingTime="14.803012005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:55.436919948 +0000 UTC m=+51.900272978" watchObservedRunningTime="2026-07-16 20:00:55.438599827 +0000 UTC m=+51.901952840" Jul 16 20:00:55.439230 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.438881 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:55.479313 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.476855 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" podStartSLOduration=13.63610311 podStartE2EDuration="28.476834322s" totalImagesPullingTime="14.840731212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:55.457853563 +0000 UTC m=+51.921206595" watchObservedRunningTime="2026-07-16 20:00:55.476834322 +0000 UTC m=+51.940187353" Jul 16 20:00:55.479313 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.477919 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" podStartSLOduration=13.668338588 podStartE2EDuration="28.477905555s" totalImagesPullingTime="14.809566967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:55.47618654 +0000 UTC m=+51.939539572" watchObservedRunningTime="2026-07-16 20:00:55.477905555 +0000 UTC m=+51.941258588" Jul 16 20:00:55.508839 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.508738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:55.529525 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.529445 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wb7gg" podStartSLOduration=13.859114799 podStartE2EDuration="28.529423924s" totalImagesPullingTime="14.670309125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:55.50408051 +0000 UTC m=+51.967433540" watchObservedRunningTime="2026-07-16 20:00:55.529423924 +0000 UTC m=+51.992776948" Jul 16 20:00:55.550227 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.550120 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" podStartSLOduration=8.831233862 podStartE2EDuration="23.550100173s" totalImagesPullingTime="14.718866311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:55.54908268 +0000 UTC m=+52.012435710" watchObservedRunningTime="2026-07-16 20:00:55.550100173 +0000 UTC m=+52.013453205" Jul 16 20:00:55.858130 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.858075 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:55.959193 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:55.959146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:56.323370 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.323289 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:00:56.323796 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.323712 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/0.log" Jul 16 20:00:56.323796 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.323744 2575 generic.go:356] "Generic (PLEG): container finished" podID="dd78c5ca-602a-4ec2-8614-d9de444124e8" containerID="5cd274651b79fc8668364ee2592898f907a6bcb28a4a19dee103e919812356e4" exitCode=255 Jul 16 20:00:56.323923 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.323839 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" event={"ID":"dd78c5ca-602a-4ec2-8614-d9de444124e8","Type":"ContainerDied","Data":"5cd274651b79fc8668364ee2592898f907a6bcb28a4a19dee103e919812356e4"} Jul 16 20:00:56.323923 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.323907 2575 scope.go:117] "RemoveContainer" containerID="523666793be66acbbb1a0b6200448934bfff2220e79db14f6ec59a5afab0e62e" Jul 16 20:00:56.324143 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.324120 2575 scope.go:117] "RemoveContainer" containerID="5cd274651b79fc8668364ee2592898f907a6bcb28a4a19dee103e919812356e4" Jul 16 20:00:56.324383 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:56.324354 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-hlv9f_openshift-console-operator(dd78c5ca-602a-4ec2-8614-d9de444124e8)\"" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" podUID="dd78c5ca-602a-4ec2-8614-d9de444124e8" Jul 16 20:00:56.326986 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.326962 2575 generic.go:356] "Generic (PLEG): container finished" podID="01f639df-639a-4d2c-a211-08c940b1eaa5" containerID="6669e6736f6a2d3e567cce837c9df2ec0fa8a0bb673da2ede7ed5734daba3dc2" exitCode=0 Jul 16 20:00:56.327097 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.327029 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwhmx" event={"ID":"01f639df-639a-4d2c-a211-08c940b1eaa5","Type":"ContainerDied","Data":"6669e6736f6a2d3e567cce837c9df2ec0fa8a0bb673da2ede7ed5734daba3dc2"} Jul 16 20:00:56.716244 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.716199 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ft2n2"] Jul 16 20:00:56.718950 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.718926 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.721225 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.721201 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-92cdv\"" Jul 16 20:00:56.721359 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.721206 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 20:00:56.721529 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.721506 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 20:00:56.729142 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.729116 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ft2n2"] Jul 16 20:00:56.785845 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.785802 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.785845 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.785849 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sbxs\" (UniqueName: \"kubernetes.io/projected/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-api-access-4sbxs\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.786102 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.785868 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddcc157a-aae4-4081-9097-d3ac4cc32e64-data-volume\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.786102 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.785917 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.786102 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.786046 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ddcc157a-aae4-4081-9097-d3ac4cc32e64-crio-socket\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.848452 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.848410 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k27tg"] Jul 16 20:00:56.850805 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.850788 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k27tg" Jul 16 20:00:56.853328 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.853306 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 16 20:00:56.853918 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.853892 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gt9st\"" Jul 16 20:00:56.854300 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.854285 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 16 20:00:56.861248 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.861224 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k27tg"] Jul 16 20:00:56.886575 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.886543 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sbxs\" (UniqueName: \"kubernetes.io/projected/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-api-access-4sbxs\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.886575 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.886576 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddcc157a-aae4-4081-9097-d3ac4cc32e64-data-volume\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.886825 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.886619 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq5jn\" (UniqueName: \"kubernetes.io/projected/a44f15c0-556c-44a8-904c-61f1e1994097-kube-api-access-rq5jn\") pod \"migrator-7cc9c7ffd7-k27tg\" (UID: \"a44f15c0-556c-44a8-904c-61f1e1994097\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k27tg" Jul 16 20:00:56.886825 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.886672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.886825 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.886760 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ddcc157a-aae4-4081-9097-d3ac4cc32e64-crio-socket\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.886970 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:56.886865 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 20:00:56.886970 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.886888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.886970 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.886901 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ddcc157a-aae4-4081-9097-d3ac4cc32e64-crio-socket\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.886970 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:56.886959 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls podName:ddcc157a-aae4-4081-9097-d3ac4cc32e64 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:57.386917481 +0000 UTC m=+53.850270493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ft2n2" (UID: "ddcc157a-aae4-4081-9097-d3ac4cc32e64") : secret "insights-runtime-extractor-tls" not found Jul 16 20:00:56.887158 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.886984 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddcc157a-aae4-4081-9097-d3ac4cc32e64-data-volume\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.887158 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:56.887008 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 20:00:56.887158 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:56.887064 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm podName:ddcc157a-aae4-4081-9097-d3ac4cc32e64 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:57.387051771 +0000 UTC m=+53.850404779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ft2n2" (UID: "ddcc157a-aae4-4081-9097-d3ac4cc32e64") : configmap "kube-rbac-proxy" not found Jul 16 20:00:56.898530 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.898501 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sbxs\" (UniqueName: \"kubernetes.io/projected/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-api-access-4sbxs\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:56.987603 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.987499 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq5jn\" (UniqueName: \"kubernetes.io/projected/a44f15c0-556c-44a8-904c-61f1e1994097-kube-api-access-rq5jn\") pod \"migrator-7cc9c7ffd7-k27tg\" (UID: \"a44f15c0-556c-44a8-904c-61f1e1994097\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k27tg" Jul 16 20:00:56.995590 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:56.995558 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq5jn\" (UniqueName: \"kubernetes.io/projected/a44f15c0-556c-44a8-904c-61f1e1994097-kube-api-access-rq5jn\") pod \"migrator-7cc9c7ffd7-k27tg\" (UID: \"a44f15c0-556c-44a8-904c-61f1e1994097\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k27tg" Jul 16 20:00:57.017384 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:57.017347 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:57.106075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:57.106033 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:57.159425 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:57.159383 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k27tg" Jul 16 20:00:57.289944 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:57.289894 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k27tg"] Jul 16 20:00:57.292708 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:00:57.292681 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44f15c0_556c_44a8_904c_61f1e1994097.slice/crio-f036bfb5d1b36972f71435bf9c369e0d94929b7af66aac4fe1b204acbbf11491 WatchSource:0}: Error finding container f036bfb5d1b36972f71435bf9c369e0d94929b7af66aac4fe1b204acbbf11491: Status 404 returned error can't find the container with id f036bfb5d1b36972f71435bf9c369e0d94929b7af66aac4fe1b204acbbf11491 Jul 16 20:00:57.334609 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:57.334571 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwhmx" event={"ID":"01f639df-639a-4d2c-a211-08c940b1eaa5","Type":"ContainerStarted","Data":"bc49ff024d8c2cdeb969162ec67f3a84550a66d7938b81a9b9bec16d1294a25c"} Jul 16 20:00:57.335713 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:57.335691 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k27tg" event={"ID":"a44f15c0-556c-44a8-904c-61f1e1994097","Type":"ContainerStarted","Data":"f036bfb5d1b36972f71435bf9c369e0d94929b7af66aac4fe1b204acbbf11491"} Jul 16 20:00:57.337220 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:57.337200 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:00:57.337596 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:57.337579 2575 scope.go:117] "RemoveContainer" containerID="5cd274651b79fc8668364ee2592898f907a6bcb28a4a19dee103e919812356e4" Jul 16 20:00:57.337794 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:57.337756 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-hlv9f_openshift-console-operator(dd78c5ca-602a-4ec2-8614-d9de444124e8)\"" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" podUID="dd78c5ca-602a-4ec2-8614-d9de444124e8" Jul 16 20:00:57.357933 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:57.357874 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pwhmx" podStartSLOduration=8.569114252 podStartE2EDuration="53.357854886s" totalImagesPullingTime="44.788740634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:00:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:57.356019769 +0000 UTC m=+53.819372839" watchObservedRunningTime="2026-07-16 20:00:57.357854886 +0000 UTC m=+53.821207918" Jul 16 20:00:57.391468 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:57.391129 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:57.391468 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:57.391279 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:57.391468 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:57.391393 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 20:00:57.391468 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:57.391412 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 20:00:57.391732 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:57.391523 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm podName:ddcc157a-aae4-4081-9097-d3ac4cc32e64 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:58.391509125 +0000 UTC m=+54.854862133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ft2n2" (UID: "ddcc157a-aae4-4081-9097-d3ac4cc32e64") : configmap "kube-rbac-proxy" not found Jul 16 20:00:57.391732 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:57.391538 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls podName:ddcc157a-aae4-4081-9097-d3ac4cc32e64 nodeName:}" failed. No retries permitted until 2026-07-16 20:00:58.391531608 +0000 UTC m=+54.854884618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ft2n2" (UID: "ddcc157a-aae4-4081-9097-d3ac4cc32e64") : secret "insights-runtime-extractor-tls" not found Jul 16 20:00:57.914836 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:57.914803 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hs9v2_dc797cd1-de45-4071-85e2-8c551bee19af/dns-node-resolver/0.log" Jul 16 20:00:58.008329 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.008289 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:58.062170 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.062140 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:58.235903 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.235818 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:58.300525 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.300476 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-q8cx9\" (UID: \"686d2769-c251-462c-b369-72a88d8b4eb3\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:00:58.300724 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:58.300647 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 20:00:58.300800 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:58.300736 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert podName:686d2769-c251-462c-b369-72a88d8b4eb3 nodeName:}" failed. No retries permitted until 2026-07-16 20:01:14.300712821 +0000 UTC m=+70.764065833 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-q8cx9" (UID: "686d2769-c251-462c-b369-72a88d8b4eb3") : secret "networking-console-plugin-cert" not found Jul 16 20:00:58.338099 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.338063 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:58.401634 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.401590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:58.401933 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.401900 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:00:58.402002 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:58.401968 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 20:00:58.402048 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:58.402008 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 20:00:58.402105 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:58.402074 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm podName:ddcc157a-aae4-4081-9097-d3ac4cc32e64 nodeName:}" failed. No retries permitted until 2026-07-16 20:01:00.402051469 +0000 UTC m=+56.865404480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ft2n2" (UID: "ddcc157a-aae4-4081-9097-d3ac4cc32e64") : configmap "kube-rbac-proxy" not found Jul 16 20:00:58.402176 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:58.402120 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls podName:ddcc157a-aae4-4081-9097-d3ac4cc32e64 nodeName:}" failed. No retries permitted until 2026-07-16 20:01:00.402093585 +0000 UTC m=+56.865446607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ft2n2" (UID: "ddcc157a-aae4-4081-9097-d3ac4cc32e64") : secret "insights-runtime-extractor-tls" not found Jul 16 20:00:58.436147 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.436113 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:58.794347 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.794265 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:58.794522 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.794322 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:00:58.794812 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.794793 2575 scope.go:117] "RemoveContainer" containerID="5cd274651b79fc8668364ee2592898f907a6bcb28a4a19dee103e919812356e4" Jul 16 20:00:58.795010 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:58.794989 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-hlv9f_openshift-console-operator(dd78c5ca-602a-4ec2-8614-d9de444124e8)\"" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" podUID="dd78c5ca-602a-4ec2-8614-d9de444124e8" Jul 16 20:00:58.795502 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.795477 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:58.893357 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.893322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:58.990754 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:58.990716 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:59.115421 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:59.115397 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k8pmr_034aaa90-6ffb-454d-9c1b-8c43d45e428f/node-ca/0.log" Jul 16 20:00:59.225439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:59.225401 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:00:59.346274 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:59.346236 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k27tg" event={"ID":"a44f15c0-556c-44a8-904c-61f1e1994097","Type":"ContainerStarted","Data":"296e42b998cffc2a6b0d34e4940a64e8da78c168218b0b160260d235f2e65122"} Jul 16 20:00:59.346666 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:59.346296 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k27tg" event={"ID":"a44f15c0-556c-44a8-904c-61f1e1994097","Type":"ContainerStarted","Data":"f0f7f0dd7651f2afae92beb286ea22ecaeb4d74d9519ed513d984fb55f347568"} Jul 16 20:00:59.346666 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:59.346581 2575 scope.go:117] "RemoveContainer" containerID="5cd274651b79fc8668364ee2592898f907a6bcb28a4a19dee103e919812356e4" Jul 16 20:00:59.346745 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:00:59.346710 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-hlv9f_openshift-console-operator(dd78c5ca-602a-4ec2-8614-d9de444124e8)\"" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" podUID="dd78c5ca-602a-4ec2-8614-d9de444124e8" Jul 16 20:00:59.368008 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:59.367912 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k27tg" podStartSLOduration=2.128486155 podStartE2EDuration="3.367895946s" totalImagesPullingTime="1.239409791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:00:59.367248025 +0000 UTC m=+55.830601068" watchObservedRunningTime="2026-07-16 20:00:59.367895946 +0000 UTC m=+55.831249027" Jul 16 20:00:59.515570 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:00:59.515529 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qgzz2_4681653d-f640-4ade-b608-ef327d5d7fa6/serve-healthcheck-canary/0.log" Jul 16 20:01:00.422527 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:00.422482 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:01:00.423016 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:00.422570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:01:00.423016 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:01:00.422614 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 20:01:00.423016 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:01:00.422687 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm podName:ddcc157a-aae4-4081-9097-d3ac4cc32e64 nodeName:}" failed. No retries permitted until 2026-07-16 20:01:04.422666747 +0000 UTC m=+60.886019756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ft2n2" (UID: "ddcc157a-aae4-4081-9097-d3ac4cc32e64") : configmap "kube-rbac-proxy" not found Jul 16 20:01:00.423016 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:01:00.422722 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 20:01:00.423016 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:01:00.422799 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls podName:ddcc157a-aae4-4081-9097-d3ac4cc32e64 nodeName:}" failed. No retries permitted until 2026-07-16 20:01:04.422786624 +0000 UTC m=+60.886139647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ft2n2" (UID: "ddcc157a-aae4-4081-9097-d3ac4cc32e64") : secret "insights-runtime-extractor-tls" not found Jul 16 20:01:01.870346 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:01.870311 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:01.971686 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:01.971653 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:02.116136 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:02.116103 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:02.221878 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:02.221797 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:02.317067 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:02.317033 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:02.572397 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:02.572309 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:02.667842 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:02.667810 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:02.985003 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:02.984966 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:03.087551 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:03.087515 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:03.784973 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:03.784938 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:03.960315 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:03.960284 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:04.156284 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:04.156096 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:04.197589 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:04.197557 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pgg5" Jul 16 20:01:04.359744 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:04.359714 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:04.459782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:04.459663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:01:04.459782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:04.459725 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:01:04.459998 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:01:04.459823 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 20:01:04.459998 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:01:04.459901 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 20:01:04.459998 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:01:04.459908 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm podName:ddcc157a-aae4-4081-9097-d3ac4cc32e64 nodeName:}" failed. No retries permitted until 2026-07-16 20:01:12.459887353 +0000 UTC m=+68.923240363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ft2n2" (UID: "ddcc157a-aae4-4081-9097-d3ac4cc32e64") : configmap "kube-rbac-proxy" not found Jul 16 20:01:04.459998 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:01:04.459984 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls podName:ddcc157a-aae4-4081-9097-d3ac4cc32e64 nodeName:}" failed. No retries permitted until 2026-07-16 20:01:12.459969535 +0000 UTC m=+68.923322544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ft2n2" (UID: "ddcc157a-aae4-4081-9097-d3ac4cc32e64") : secret "insights-runtime-extractor-tls" not found Jul 16 20:01:04.556448 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:04.556409 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:05.603587 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:05.603554 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:05.755187 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:05.755152 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:05.855163 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:05.855061 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:05.955960 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:05.955926 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:06.167283 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:06.167186 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:06.361195 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:06.361151 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:06.462863 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:06.462784 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:06.563531 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:06.563494 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:07.355546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:07.355509 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:08.010879 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:08.010843 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:08.182042 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:08.181993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:08.328061 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:08.327969 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:08.573048 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:08.573011 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:08.771603 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:08.771561 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:09.357641 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.357607 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:09.717338 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.717244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:01:09.719968 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.719950 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 20:01:09.729595 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.729563 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1d737e2-027f-4074-b311-f888a3d6c24a-original-pull-secret\") pod \"global-pull-secret-syncer-fk2vw\" (UID: \"e1d737e2-027f-4074-b311-f888a3d6c24a\") " pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:01:09.732048 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.732031 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk2vw" Jul 16 20:01:09.758901 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.758860 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:09.818727 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.818686 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs\") pod \"network-metrics-daemon-shcvc\" (UID: \"77b2afb3-a310-4f8b-afc1-e7866f997196\") " pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:01:09.821865 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.821842 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 20:01:09.831467 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.831436 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b2afb3-a310-4f8b-afc1-e7866f997196-metrics-certs\") pod \"network-metrics-daemon-shcvc\" (UID: \"77b2afb3-a310-4f8b-afc1-e7866f997196\") " pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:01:09.916870 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.916810 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fk2vw"] Jul 16 20:01:09.919780 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:01:09.919741 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d737e2_027f_4074_b311_f888a3d6c24a.slice/crio-6de036da93f03bd65bcc5812aaea2ec58e1e6fb01425ace8a13c848ac180bcfa WatchSource:0}: Error finding container 6de036da93f03bd65bcc5812aaea2ec58e1e6fb01425ace8a13c848ac180bcfa: Status 404 returned error can't find the container with id 6de036da93f03bd65bcc5812aaea2ec58e1e6fb01425ace8a13c848ac180bcfa Jul 16 20:01:09.919780 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.919750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29x5p\" (UniqueName: \"kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p\") pod \"network-check-target-dflz4\" (UID: \"34e42184-3345-497c-b72f-e09222e9bd3a\") " pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:01:09.922535 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.922506 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29x5p\" (UniqueName: \"kubernetes.io/projected/34e42184-3345-497c-b72f-e09222e9bd3a-kube-api-access-29x5p\") pod \"network-check-target-dflz4\" (UID: \"34e42184-3345-497c-b72f-e09222e9bd3a\") " pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:01:09.952491 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.952461 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sfzlm\"" Jul 16 20:01:09.960739 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:09.960713 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shcvc" Jul 16 20:01:10.044804 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.044751 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxdf6\"" Jul 16 20:01:10.052245 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.052219 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:01:10.125186 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.125157 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-shcvc"] Jul 16 20:01:10.129136 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:01:10.129112 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b2afb3_a310_4f8b_afc1_e7866f997196.slice/crio-30adcd47db628047704bfe743bd8eb97ec0b8456225b4f7355e5671d80c062d3 WatchSource:0}: Error finding container 30adcd47db628047704bfe743bd8eb97ec0b8456225b4f7355e5671d80c062d3: Status 404 returned error can't find the container with id 30adcd47db628047704bfe743bd8eb97ec0b8456225b4f7355e5671d80c062d3 Jul 16 20:01:10.161415 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.161379 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:10.202283 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.202256 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dflz4"] Jul 16 20:01:10.204629 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:01:10.204598 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e42184_3345_497c_b72f_e09222e9bd3a.slice/crio-b14514d7069f7b68f33c5846dcb3180fc0b8dbd89ccd3e24544092e32f4208ae WatchSource:0}: Error finding container b14514d7069f7b68f33c5846dcb3180fc0b8dbd89ccd3e24544092e32f4208ae: Status 404 returned error can't find the container with id b14514d7069f7b68f33c5846dcb3180fc0b8dbd89ccd3e24544092e32f4208ae Jul 16 20:01:10.257664 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.257630 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:10.325176 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.325146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:01:10.327372 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.327355 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls\") pod \"image-registry-f96d567d6-zvmsr\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:01:10.382347 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.382315 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dflz4" event={"ID":"34e42184-3345-497c-b72f-e09222e9bd3a","Type":"ContainerStarted","Data":"b7ecbf3aff70bd7fb479c65738d68ec332cda7a5dbba93964e3beeed84e4e98a"} Jul 16 20:01:10.382541 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.382367 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dflz4" event={"ID":"34e42184-3345-497c-b72f-e09222e9bd3a","Type":"ContainerStarted","Data":"b14514d7069f7b68f33c5846dcb3180fc0b8dbd89ccd3e24544092e32f4208ae"} Jul 16 20:01:10.382541 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.382437 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:01:10.383586 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.383564 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fk2vw" event={"ID":"e1d737e2-027f-4074-b311-f888a3d6c24a","Type":"ContainerStarted","Data":"6de036da93f03bd65bcc5812aaea2ec58e1e6fb01425ace8a13c848ac180bcfa"} Jul 16 20:01:10.384602 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.384580 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shcvc" event={"ID":"77b2afb3-a310-4f8b-afc1-e7866f997196","Type":"ContainerStarted","Data":"30adcd47db628047704bfe743bd8eb97ec0b8456225b4f7355e5671d80c062d3"} Jul 16 20:01:10.398687 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.398635 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dflz4" podStartSLOduration=66.398620595 podStartE2EDuration="1m6.398620595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:01:10.39852688 +0000 UTC m=+66.861879911" watchObservedRunningTime="2026-07-16 20:01:10.398620595 +0000 UTC m=+66.861973626" Jul 16 20:01:10.426017 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.425980 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vjl9b\" (UID: \"a6221479-7896-430d-bfc5-49b19d84a422\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:01:10.426165 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.426081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:01:10.428522 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.428491 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704043dc-663b-4a9f-a7aa-f80384bdbb39-metrics-tls\") pod \"dns-default-472fn\" (UID: \"704043dc-663b-4a9f-a7aa-f80384bdbb39\") " pod="openshift-dns/dns-default-472fn" Jul 16 20:01:10.428638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.428559 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6221479-7896-430d-bfc5-49b19d84a422-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vjl9b\" (UID: \"a6221479-7896-430d-bfc5-49b19d84a422\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:01:10.521306 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.521202 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vjpvn\"" Jul 16 20:01:10.527501 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.527473 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:01:10.527643 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.527538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:01:10.527643 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.527569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:01:10.528205 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.528185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8150a0a9-0feb-4c1d-9911-a56a59c792aa-service-ca-bundle\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:01:10.529040 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.529017 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:01:10.529955 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.529935 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8150a0a9-0feb-4c1d-9911-a56a59c792aa-metrics-certs\") pod \"router-default-56cbd95bbb-tngbx\" (UID: \"8150a0a9-0feb-4c1d-9911-a56a59c792aa\") " pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:01:10.530036 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.529938 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85fd6d59-457c-4fee-b0cf-738b64068a12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dvfjl\" (UID: \"85fd6d59-457c-4fee-b0cf-738b64068a12\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:01:10.542191 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.542171 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fkb6w\"" Jul 16 20:01:10.550362 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.550333 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-472fn" Jul 16 20:01:10.555332 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.555312 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dw7gq\"" Jul 16 20:01:10.560071 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.560043 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:10.563965 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.563946 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" Jul 16 20:01:10.644305 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.644271 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kqk9x\"" Jul 16 20:01:10.652668 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.652340 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" Jul 16 20:01:10.653992 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.653726 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2x6nk\"" Jul 16 20:01:10.661014 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.660981 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:01:10.749189 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.749074 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f96d567d6-zvmsr"] Jul 16 20:01:10.770487 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.770396 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-472fn"] Jul 16 20:01:10.771869 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.771433 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:10.828778 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.828399 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b"] Jul 16 20:01:10.840035 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.839966 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:10.902098 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.902011 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl"] Jul 16 20:01:10.906542 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:01:10.906509 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85fd6d59_457c_4fee_b0cf_738b64068a12.slice/crio-6c30893916d01f81b6c6dd3d36428ec826029ba0ff9312383dcff17ba11a1179 WatchSource:0}: Error finding container 6c30893916d01f81b6c6dd3d36428ec826029ba0ff9312383dcff17ba11a1179: Status 404 returned error can't find the container with id 6c30893916d01f81b6c6dd3d36428ec826029ba0ff9312383dcff17ba11a1179 Jul 16 20:01:10.928145 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:10.928115 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56cbd95bbb-tngbx"] Jul 16 20:01:10.932051 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:01:10.932018 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8150a0a9_0feb_4c1d_9911_a56a59c792aa.slice/crio-36edce59aef8c3577d696c53f933771b24648afbbb9c4f6491762decf2bc7583 WatchSource:0}: Error finding container 36edce59aef8c3577d696c53f933771b24648afbbb9c4f6491762decf2bc7583: Status 404 returned error can't find the container with id 36edce59aef8c3577d696c53f933771b24648afbbb9c4f6491762decf2bc7583 Jul 16 20:01:11.157969 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.157909 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:11.392390 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.392348 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" event={"ID":"a6221479-7896-430d-bfc5-49b19d84a422","Type":"ContainerStarted","Data":"14e52a4754f2e900e0533ee4fa9f684ff7eeee4cc4288f06f9895b55e63ad71c"} Jul 16 20:01:11.394991 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.394917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-472fn" event={"ID":"704043dc-663b-4a9f-a7aa-f80384bdbb39","Type":"ContainerStarted","Data":"659cedcd84ce96586190e7786b2deee66f18968bcb38af9b62be2cbbca9053ac"} Jul 16 20:01:11.396796 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.396728 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" event={"ID":"85fd6d59-457c-4fee-b0cf-738b64068a12","Type":"ContainerStarted","Data":"6c30893916d01f81b6c6dd3d36428ec826029ba0ff9312383dcff17ba11a1179"} Jul 16 20:01:11.399657 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.398968 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" event={"ID":"322cb2da-6e27-4845-9081-0fec18abf287","Type":"ContainerStarted","Data":"05fecd04ce7147239a9e5c37d3a232d95033301b61acc1fd5f6cf2228430c866"} Jul 16 20:01:11.399657 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.399017 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" event={"ID":"322cb2da-6e27-4845-9081-0fec18abf287","Type":"ContainerStarted","Data":"0fa0e1e6a6f8be81add01b7ed075c64dcd85bbd9d44a8296f6a1bdd37f6a67c1"} Jul 16 20:01:11.399657 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.399276 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:01:11.403557 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.402333 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56cbd95bbb-tngbx" event={"ID":"8150a0a9-0feb-4c1d-9911-a56a59c792aa","Type":"ContainerStarted","Data":"d338f7f9d2eaf1fe56332d5ffffaa053bf2009fce49409a5094335819e321771"} Jul 16 20:01:11.403557 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.402373 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56cbd95bbb-tngbx" event={"ID":"8150a0a9-0feb-4c1d-9911-a56a59c792aa","Type":"ContainerStarted","Data":"36edce59aef8c3577d696c53f933771b24648afbbb9c4f6491762decf2bc7583"} Jul 16 20:01:11.419808 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.419473 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" podStartSLOduration=67.419449654 podStartE2EDuration="1m7.419449654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:01:11.418949345 +0000 UTC m=+67.882302379" watchObservedRunningTime="2026-07-16 20:01:11.419449654 +0000 UTC m=+67.882802686" Jul 16 20:01:11.661816 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.661697 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:01:11.665003 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.664977 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:01:11.684537 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.684481 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56cbd95bbb-tngbx" podStartSLOduration=44.684460287 podStartE2EDuration="44.684460287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:01:11.439954386 +0000 UTC m=+67.903307419" watchObservedRunningTime="2026-07-16 20:01:11.684460287 +0000 UTC m=+68.147813319" Jul 16 20:01:11.955196 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:11.955097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:12.170508 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:12.170333 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:12.369406 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:12.369344 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:12.407703 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:12.407646 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:01:12.409926 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:12.409892 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56cbd95bbb-tngbx" Jul 16 20:01:12.549716 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:12.549682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:01:12.550017 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:12.549989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:01:12.550628 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:12.550595 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddcc157a-aae4-4081-9097-d3ac4cc32e64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:01:12.554601 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:12.554547 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddcc157a-aae4-4081-9097-d3ac4cc32e64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ft2n2\" (UID: \"ddcc157a-aae4-4081-9097-d3ac4cc32e64\") " pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:01:12.567830 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:12.567777 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:12.633350 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:12.633267 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-92cdv\"" Jul 16 20:01:12.640859 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:12.640830 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ft2n2" Jul 16 20:01:13.012405 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:13.012329 2575 scope.go:117] "RemoveContainer" containerID="5cd274651b79fc8668364ee2592898f907a6bcb28a4a19dee103e919812356e4" Jul 16 20:01:14.367246 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:14.367205 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-q8cx9\" (UID: \"686d2769-c251-462c-b369-72a88d8b4eb3\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:01:14.370275 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:14.370245 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/686d2769-c251-462c-b369-72a88d8b4eb3-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-q8cx9\" (UID: \"686d2769-c251-462c-b369-72a88d8b4eb3\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:01:14.562425 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:14.562387 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7jpc9\"" Jul 16 20:01:14.570591 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:14.570559 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" Jul 16 20:01:15.531882 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:15.531649 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ft2n2"] Jul 16 20:01:15.534844 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:01:15.534810 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddcc157a_aae4_4081_9097_d3ac4cc32e64.slice/crio-b6e113ba80c516d43e728587fc89967a03904b7f65420a7dd94745b5abc2809b WatchSource:0}: Error finding container b6e113ba80c516d43e728587fc89967a03904b7f65420a7dd94745b5abc2809b: Status 404 returned error can't find the container with id b6e113ba80c516d43e728587fc89967a03904b7f65420a7dd94745b5abc2809b Jul 16 20:01:15.546795 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:15.546716 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9"] Jul 16 20:01:15.550889 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:01:15.550848 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686d2769_c251_462c_b369_72a88d8b4eb3.slice/crio-32570038632ed2e72961bad8bdcc7c77d52f00020eed5098e37d4ebb5a544e8f WatchSource:0}: Error finding container 32570038632ed2e72961bad8bdcc7c77d52f00020eed5098e37d4ebb5a544e8f: Status 404 returned error can't find the container with id 32570038632ed2e72961bad8bdcc7c77d52f00020eed5098e37d4ebb5a544e8f Jul 16 20:01:16.434237 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.433831 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" event={"ID":"a6221479-7896-430d-bfc5-49b19d84a422","Type":"ContainerStarted","Data":"da0ea551ef8bb6be01450cada45fcf738ae0ea48aa94a34c1efa3fd0b444457f"} Jul 16 20:01:16.434237 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.433899 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" event={"ID":"a6221479-7896-430d-bfc5-49b19d84a422","Type":"ContainerStarted","Data":"5f8c32d530c9fbb70dedbb60df03141cafc1636794973fd5a9ccdc9e56b05def"} Jul 16 20:01:16.438794 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.436794 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:01:16.438794 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.436948 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" event={"ID":"dd78c5ca-602a-4ec2-8614-d9de444124e8","Type":"ContainerStarted","Data":"8bd9e1f063403c0ab97d6bcc7061a1d1069bf775d57b72d42b548ed4349304ee"} Jul 16 20:01:16.438794 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.437777 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:01:16.442600 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.442565 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fk2vw" event={"ID":"e1d737e2-027f-4074-b311-f888a3d6c24a","Type":"ContainerStarted","Data":"811720ee17f2a721ccf9045f2c854ab4c2195171ebbc440fa003679391df40b4"} Jul 16 20:01:16.445814 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.445705 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" Jul 16 20:01:16.447071 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.447040 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ft2n2" event={"ID":"ddcc157a-aae4-4081-9097-d3ac4cc32e64","Type":"ContainerStarted","Data":"b6e113ba80c516d43e728587fc89967a03904b7f65420a7dd94745b5abc2809b"} Jul 16 20:01:16.452606 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.452511 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-472fn" event={"ID":"704043dc-663b-4a9f-a7aa-f80384bdbb39","Type":"ContainerStarted","Data":"8f27dc3fff598ccf376ab245cb4be5881fde2007a7e01e21fff6e23528398a50"} Jul 16 20:01:16.452915 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.452894 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-472fn" event={"ID":"704043dc-663b-4a9f-a7aa-f80384bdbb39","Type":"ContainerStarted","Data":"72926a3b1888103d26d0cdd510a8e4839e11739eddf992073ad8d14ce8eadeeb"} Jul 16 20:01:16.453293 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.453236 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-472fn" Jul 16 20:01:16.454134 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.454040 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vjl9b" podStartSLOduration=45.035432338 podStartE2EDuration="49.454020349s" totalImagesPullingTime="4.418588011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:01:16.45294549 +0000 UTC m=+72.916298522" watchObservedRunningTime="2026-07-16 20:01:16.454020349 +0000 UTC m=+72.917373381" Jul 16 20:01:16.461010 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.459361 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" event={"ID":"686d2769-c251-462c-b369-72a88d8b4eb3","Type":"ContainerStarted","Data":"32570038632ed2e72961bad8bdcc7c77d52f00020eed5098e37d4ebb5a544e8f"} Jul 16 20:01:16.464489 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.463853 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shcvc" event={"ID":"77b2afb3-a310-4f8b-afc1-e7866f997196","Type":"ContainerStarted","Data":"ca4dc4d201e84d1a134c0da73aafbdde5ac363d188c8539b170b7f839bf0d2db"} Jul 16 20:01:16.464489 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.463923 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shcvc" event={"ID":"77b2afb3-a310-4f8b-afc1-e7866f997196","Type":"ContainerStarted","Data":"67448e6eee384ffba475e16e47a4f21cdcbb62cfce43e1a820b7e9cf8e7263c1"} Jul 16 20:01:16.474881 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.472321 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-hlv9f" podStartSLOduration=34.657073827 podStartE2EDuration="49.472298678s" totalImagesPullingTime="14.815224851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:01:16.471397408 +0000 UTC m=+72.934750440" watchObservedRunningTime="2026-07-16 20:01:16.472298678 +0000 UTC m=+72.935651710" Jul 16 20:01:16.492153 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.490979 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fk2vw" podStartSLOduration=67.057520701 podStartE2EDuration="1m12.490956956s" totalImagesPullingTime="5.433436255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:01:16.490474464 +0000 UTC m=+72.953827493" watchObservedRunningTime="2026-07-16 20:01:16.490956956 +0000 UTC m=+72.954309989" Jul 16 20:01:16.527453 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.525039 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-472fn" podStartSLOduration=33.971003979 podStartE2EDuration="38.525016967s" totalImagesPullingTime="4.554012988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:01:16.524612574 +0000 UTC m=+72.987965617" watchObservedRunningTime="2026-07-16 20:01:16.525016967 +0000 UTC m=+72.988369998" Jul 16 20:01:16.527453 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.525751 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-shcvc" podStartSLOduration=67.363029778 podStartE2EDuration="1m12.525734269s" totalImagesPullingTime="5.162704491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:01:16.50761009 +0000 UTC m=+72.970963122" watchObservedRunningTime="2026-07-16 20:01:16.525734269 +0000 UTC m=+72.989087302" Jul 16 20:01:16.625151 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.624944 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:16.704571 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.704422 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:16.802691 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.802516 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:16.916037 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:16.915948 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:17.094753 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:17.094715 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:17.195607 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:17.195553 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:17.294943 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:17.294910 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:17.395308 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:17.395200 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:17.473453 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:17.473415 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" event={"ID":"85fd6d59-457c-4fee-b0cf-738b64068a12","Type":"ContainerStarted","Data":"893436681a9f1cb0e3e2691551c6051073b85521e750fb7f07bce8f576789888"} Jul 16 20:01:17.503929 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:17.503874 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dvfjl" podStartSLOduration=44.257807323 podStartE2EDuration="50.503856366s" totalImagesPullingTime="6.246049043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:01:17.502270484 +0000 UTC m=+73.965623517" watchObservedRunningTime="2026-07-16 20:01:17.503856366 +0000 UTC m=+73.967209397" Jul 16 20:01:18.269931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:18.269898 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:18.368968 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:18.368919 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:18.511021 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:18.510927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:18.685936 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:18.685891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:19.213606 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:19.213557 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:19.619736 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:19.619682 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:21.491660 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:21.491622 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" event={"ID":"686d2769-c251-462c-b369-72a88d8b4eb3","Type":"ContainerStarted","Data":"1aea70d2902df34fcbd86163787d659f7c19ee60fdfca87fac150cbf9c53f3a3"} Jul 16 20:01:21.493054 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:21.493032 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ft2n2" event={"ID":"ddcc157a-aae4-4081-9097-d3ac4cc32e64","Type":"ContainerStarted","Data":"8c245752d3852759cb97ef00af8f4e11c667cf8ae326713d8f30c6bd4fc6cf69"} Jul 16 20:01:21.509128 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:21.509076 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-q8cx9" podStartSLOduration=33.647381099 podStartE2EDuration="39.509059624s" totalImagesPullingTime="5.861678525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:01:21.508835321 +0000 UTC m=+77.972188352" watchObservedRunningTime="2026-07-16 20:01:21.509059624 +0000 UTC m=+77.972412693" Jul 16 20:01:23.043498 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:23.043461 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:23.134148 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:23.134106 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:24.705510 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:24.705454 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:24.793260 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:24.793212 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:25.512787 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:25.512687 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ft2n2" event={"ID":"ddcc157a-aae4-4081-9097-d3ac4cc32e64","Type":"ContainerStarted","Data":"25c09eb1017e04d58834c5c2d695faf2d81c123a07d101afec42d73151a7f5dd"} Jul 16 20:01:26.476516 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:26.476481 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-472fn" Jul 16 20:01:29.402192 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:29.402151 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:29.464149 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:29.464105 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:29.531043 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:29.531005 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ft2n2" event={"ID":"ddcc157a-aae4-4081-9097-d3ac4cc32e64","Type":"ContainerStarted","Data":"c3af6397a5056d104a67a078e3d4c8906898d58980118a12fafa0b1188761450"} Jul 16 20:01:29.552495 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:29.552441 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ft2n2" podStartSLOduration=20.358397444 podStartE2EDuration="33.552425966s" totalImagesPullingTime="13.194028522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:00:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:01:29.552120362 +0000 UTC m=+86.015473395" watchObservedRunningTime="2026-07-16 20:01:29.552425966 +0000 UTC m=+86.015778997" Jul 16 20:01:30.534663 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:30.534629 2575 patch_prober.go:28] interesting pod/image-registry-f96d567d6-zvmsr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 20:01:30.535070 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:30.534688 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" podUID="322cb2da-6e27-4845-9081-0fec18abf287" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 20:01:31.488269 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:31.488237 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:31.547434 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:31.547398 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:32.412446 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:32.412418 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:01:34.552402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:34.552366 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:34.652838 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:34.652801 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:36.350522 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:36.350477 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:36.548963 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:36.548928 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:36.649852 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:36.649721 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:36.749374 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:36.749339 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:36.816977 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:36.816941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:38.928400 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:38.928359 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:39.027620 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:39.027586 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:40.225912 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:40.225867 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:40.512702 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:40.512612 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:40.613993 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:40.613962 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:41.404678 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:41.404644 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dflz4" Jul 16 20:01:42.777052 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:42.777013 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:42.886903 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:42.886863 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:42.978272 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:42.978241 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:43.086448 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:43.086410 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:43.273276 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:43.273240 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:44.711204 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:44.711159 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f96d567d6-zvmsr"] Jul 16 20:01:44.819702 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:44.819661 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:44.918185 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:44.918139 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:45.657278 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:45.657239 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:45.733916 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:45.733877 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:45.841552 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:45.841479 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:45.940501 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:45.940398 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:46.041137 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:46.041097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:47.876346 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:47.876308 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:47.977970 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:47.977929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:48.082853 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.082816 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:48.166345 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.166259 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-thvgr"] Jul 16 20:01:48.182589 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.182555 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:48.210376 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.210344 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.213049 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.213024 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 20:01:48.213049 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.213044 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-66zdp\"" Jul 16 20:01:48.213288 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.213051 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 20:01:48.213973 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.213951 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 20:01:48.214111 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.213981 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 20:01:48.257330 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.257286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-wtmp\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.257330 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.257328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l6t6\" (UniqueName: \"kubernetes.io/projected/a73911a2-66d4-4113-87d4-c33c2c2e63b8-kube-api-access-6l6t6\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.257540 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.257359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-textfile\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.257540 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.257445 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a73911a2-66d4-4113-87d4-c33c2c2e63b8-root\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.257540 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.257497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.257653 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.257551 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a73911a2-66d4-4113-87d4-c33c2c2e63b8-metrics-client-ca\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.257653 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.257575 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.257653 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.257596 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-tls\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.257653 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.257621 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a73911a2-66d4-4113-87d4-c33c2c2e63b8-sys\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.279096 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.279057 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:48.358695 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.358655 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a73911a2-66d4-4113-87d4-c33c2c2e63b8-root\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.358921 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.358708 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.358921 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.358816 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a73911a2-66d4-4113-87d4-c33c2c2e63b8-root\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.358921 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.358898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a73911a2-66d4-4113-87d4-c33c2c2e63b8-metrics-client-ca\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.359084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.358933 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.359084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.358965 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-tls\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.359084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.358992 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a73911a2-66d4-4113-87d4-c33c2c2e63b8-sys\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.359084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.359051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-wtmp\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.359277 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.359109 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a73911a2-66d4-4113-87d4-c33c2c2e63b8-sys\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.359277 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.359180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l6t6\" (UniqueName: \"kubernetes.io/projected/a73911a2-66d4-4113-87d4-c33c2c2e63b8-kube-api-access-6l6t6\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.359277 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.359242 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-textfile\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.359444 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.359188 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-wtmp\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.359444 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.359432 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.359538 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.359494 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a73911a2-66d4-4113-87d4-c33c2c2e63b8-metrics-client-ca\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.359599 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.359581 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-textfile\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.361420 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.361397 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-tls\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.361420 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.361409 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a73911a2-66d4-4113-87d4-c33c2c2e63b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.368529 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.368495 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l6t6\" (UniqueName: \"kubernetes.io/projected/a73911a2-66d4-4113-87d4-c33c2c2e63b8-kube-api-access-6l6t6\") pod \"node-exporter-thvgr\" (UID: \"a73911a2-66d4-4113-87d4-c33c2c2e63b8\") " pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.467056 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.466961 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:48.520557 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.520516 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-thvgr" Jul 16 20:01:48.564421 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:01:48.564387 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73911a2_66d4_4113_87d4_c33c2c2e63b8.slice/crio-49561766d77ab7f81aa915deb439e1b2b22e49ad577aa31c356f7d1adaace62c WatchSource:0}: Error finding container 49561766d77ab7f81aa915deb439e1b2b22e49ad577aa31c356f7d1adaace62c: Status 404 returned error can't find the container with id 49561766d77ab7f81aa915deb439e1b2b22e49ad577aa31c356f7d1adaace62c Jul 16 20:01:48.569282 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.569254 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:48.603539 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:48.603506 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-thvgr" event={"ID":"a73911a2-66d4-4113-87d4-c33c2c2e63b8","Type":"ContainerStarted","Data":"49561766d77ab7f81aa915deb439e1b2b22e49ad577aa31c356f7d1adaace62c"} Jul 16 20:01:49.381585 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:49.381546 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:49.482485 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:49.482446 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:49.582978 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:49.582873 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:50.614749 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:50.614719 2575 generic.go:356] "Generic (PLEG): container finished" podID="a73911a2-66d4-4113-87d4-c33c2c2e63b8" containerID="ad05e29eacd0392bfce311c19a1e80cb70869217eaa0560c58d71134fca608aa" exitCode=0 Jul 16 20:01:50.615180 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:50.614806 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-thvgr" event={"ID":"a73911a2-66d4-4113-87d4-c33c2c2e63b8","Type":"ContainerDied","Data":"ad05e29eacd0392bfce311c19a1e80cb70869217eaa0560c58d71134fca608aa"} Jul 16 20:01:50.786143 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:50.786108 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:50.852181 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:50.852150 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:51.620954 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:51.620924 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-thvgr" event={"ID":"a73911a2-66d4-4113-87d4-c33c2c2e63b8","Type":"ContainerStarted","Data":"8f4825995962468244d318f8aed4a287022229c444f45901cceddde468328b83"} Jul 16 20:01:51.621332 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:51.620982 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-thvgr" event={"ID":"a73911a2-66d4-4113-87d4-c33c2c2e63b8","Type":"ContainerStarted","Data":"0b4b61bfcaec46bff524a836998f6ec2ed86d8a4c65da86484e44648ff30e50e"} Jul 16 20:01:51.649727 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:51.649666 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-thvgr" podStartSLOduration=1.842976161 podStartE2EDuration="3.649647839s" totalImagesPullingTime="1.732121905s" totalInitContainerRuntime="74.549773ms" isStatefulPod=true podCreationTimestamp="2026-07-16 20:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:01:51.647344441 +0000 UTC m=+108.110697484" watchObservedRunningTime="2026-07-16 20:01:51.649647839 +0000 UTC m=+108.113000869" Jul 16 20:01:51.762587 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:51.762551 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:51.822995 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:51.822957 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:52.375697 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:52.375662 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:52.938130 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:52.938092 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:53.013348 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:53.013307 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:53.112483 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:53.112445 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:53.171822 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:53.171755 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:01:54.334338 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:01:54.334295 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:02:00.656238 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:00.656198 2575 generic.go:356] "Generic (PLEG): container finished" podID="d8a3e0f2-ab4d-472c-9495-b68e50de68c8" containerID="1b9b404f5cecdc88be2d1afc391702cf679d9ec45a364961d58db036eabfa17b" exitCode=0 Jul 16 20:02:00.656660 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:00.656276 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" event={"ID":"d8a3e0f2-ab4d-472c-9495-b68e50de68c8","Type":"ContainerDied","Data":"1b9b404f5cecdc88be2d1afc391702cf679d9ec45a364961d58db036eabfa17b"} Jul 16 20:02:00.656660 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:00.656571 2575 scope.go:117] "RemoveContainer" containerID="1b9b404f5cecdc88be2d1afc391702cf679d9ec45a364961d58db036eabfa17b" Jul 16 20:02:01.662301 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:01.662266 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4gnqf" event={"ID":"d8a3e0f2-ab4d-472c-9495-b68e50de68c8","Type":"ContainerStarted","Data":"309c65fb67912fc0ca37c65c7f79da79ad693435581eac71fa76e67869c031b1"} Jul 16 20:02:02.109665 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:02.109623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:02:02.210505 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:02.210469 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:02:09.038950 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:09.038908 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:02:09.143299 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:09.143260 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:02:09.733099 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:09.733051 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" podUID="322cb2da-6e27-4845-9081-0fec18abf287" containerName="registry" containerID="cri-o://05fecd04ce7147239a9e5c37d3a232d95033301b61acc1fd5f6cf2228430c866" gracePeriod=30 Jul 16 20:02:09.997312 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:09.997283 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:02:10.154002 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.153967 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m27x\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-kube-api-access-5m27x\") pod \"322cb2da-6e27-4845-9081-0fec18abf287\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " Jul 16 20:02:10.154469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.154014 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/322cb2da-6e27-4845-9081-0fec18abf287-registry-certificates\") pod \"322cb2da-6e27-4845-9081-0fec18abf287\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " Jul 16 20:02:10.154469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.154046 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/322cb2da-6e27-4845-9081-0fec18abf287-image-registry-private-configuration\") pod \"322cb2da-6e27-4845-9081-0fec18abf287\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " Jul 16 20:02:10.154469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.154194 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/322cb2da-6e27-4845-9081-0fec18abf287-ca-trust-extracted\") pod \"322cb2da-6e27-4845-9081-0fec18abf287\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " Jul 16 20:02:10.154469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.154240 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls\") pod \"322cb2da-6e27-4845-9081-0fec18abf287\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " Jul 16 20:02:10.154469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.154279 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/322cb2da-6e27-4845-9081-0fec18abf287-trusted-ca\") pod \"322cb2da-6e27-4845-9081-0fec18abf287\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " Jul 16 20:02:10.154469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.154316 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/322cb2da-6e27-4845-9081-0fec18abf287-installation-pull-secrets\") pod \"322cb2da-6e27-4845-9081-0fec18abf287\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " Jul 16 20:02:10.154469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.154351 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-bound-sa-token\") pod \"322cb2da-6e27-4845-9081-0fec18abf287\" (UID: \"322cb2da-6e27-4845-9081-0fec18abf287\") " Jul 16 20:02:10.154858 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.154479 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/322cb2da-6e27-4845-9081-0fec18abf287-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "322cb2da-6e27-4845-9081-0fec18abf287" (UID: "322cb2da-6e27-4845-9081-0fec18abf287"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:02:10.154858 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.154792 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/322cb2da-6e27-4845-9081-0fec18abf287-registry-certificates\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:02:10.155405 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.155362 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/322cb2da-6e27-4845-9081-0fec18abf287-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "322cb2da-6e27-4845-9081-0fec18abf287" (UID: "322cb2da-6e27-4845-9081-0fec18abf287"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:02:10.156951 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.156918 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/322cb2da-6e27-4845-9081-0fec18abf287-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "322cb2da-6e27-4845-9081-0fec18abf287" (UID: "322cb2da-6e27-4845-9081-0fec18abf287"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:02:10.157118 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.157097 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "322cb2da-6e27-4845-9081-0fec18abf287" (UID: "322cb2da-6e27-4845-9081-0fec18abf287"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:02:10.157236 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.157211 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-kube-api-access-5m27x" (OuterVolumeSpecName: "kube-api-access-5m27x") pod "322cb2da-6e27-4845-9081-0fec18abf287" (UID: "322cb2da-6e27-4845-9081-0fec18abf287"). InnerVolumeSpecName "kube-api-access-5m27x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:02:10.157440 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.157421 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "322cb2da-6e27-4845-9081-0fec18abf287" (UID: "322cb2da-6e27-4845-9081-0fec18abf287"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:02:10.157845 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.157823 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/322cb2da-6e27-4845-9081-0fec18abf287-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "322cb2da-6e27-4845-9081-0fec18abf287" (UID: "322cb2da-6e27-4845-9081-0fec18abf287"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:02:10.165860 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.165733 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/322cb2da-6e27-4845-9081-0fec18abf287-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "322cb2da-6e27-4845-9081-0fec18abf287" (UID: "322cb2da-6e27-4845-9081-0fec18abf287"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:02:10.255392 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.255288 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/322cb2da-6e27-4845-9081-0fec18abf287-ca-trust-extracted\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:02:10.255392 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.255334 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-registry-tls\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:02:10.255392 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.255344 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/322cb2da-6e27-4845-9081-0fec18abf287-trusted-ca\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:02:10.255392 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.255353 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/322cb2da-6e27-4845-9081-0fec18abf287-installation-pull-secrets\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:02:10.255392 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.255362 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-bound-sa-token\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:02:10.255392 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.255370 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m27x\" (UniqueName: \"kubernetes.io/projected/322cb2da-6e27-4845-9081-0fec18abf287-kube-api-access-5m27x\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:02:10.255392 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.255380 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/322cb2da-6e27-4845-9081-0fec18abf287-image-registry-private-configuration\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:02:10.460455 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.460418 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:02:10.696005 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.695972 2575 generic.go:356] "Generic (PLEG): container finished" podID="322cb2da-6e27-4845-9081-0fec18abf287" containerID="05fecd04ce7147239a9e5c37d3a232d95033301b61acc1fd5f6cf2228430c866" exitCode=0 Jul 16 20:02:10.696178 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.696013 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" event={"ID":"322cb2da-6e27-4845-9081-0fec18abf287","Type":"ContainerDied","Data":"05fecd04ce7147239a9e5c37d3a232d95033301b61acc1fd5f6cf2228430c866"} Jul 16 20:02:10.696178 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.696052 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" event={"ID":"322cb2da-6e27-4845-9081-0fec18abf287","Type":"ContainerDied","Data":"0fa0e1e6a6f8be81add01b7ed075c64dcd85bbd9d44a8296f6a1bdd37f6a67c1"} Jul 16 20:02:10.696178 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.696070 2575 scope.go:117] "RemoveContainer" containerID="05fecd04ce7147239a9e5c37d3a232d95033301b61acc1fd5f6cf2228430c866" Jul 16 20:02:10.696178 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.696016 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f96d567d6-zvmsr" Jul 16 20:02:10.704989 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.704966 2575 scope.go:117] "RemoveContainer" containerID="05fecd04ce7147239a9e5c37d3a232d95033301b61acc1fd5f6cf2228430c866" Jul 16 20:02:10.705297 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:02:10.705276 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05fecd04ce7147239a9e5c37d3a232d95033301b61acc1fd5f6cf2228430c866\": container with ID starting with 05fecd04ce7147239a9e5c37d3a232d95033301b61acc1fd5f6cf2228430c866 not found: ID does not exist" containerID="05fecd04ce7147239a9e5c37d3a232d95033301b61acc1fd5f6cf2228430c866" Jul 16 20:02:10.705369 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.705303 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05fecd04ce7147239a9e5c37d3a232d95033301b61acc1fd5f6cf2228430c866"} err="failed to get container status \"05fecd04ce7147239a9e5c37d3a232d95033301b61acc1fd5f6cf2228430c866\": rpc error: code = NotFound desc = could not find container \"05fecd04ce7147239a9e5c37d3a232d95033301b61acc1fd5f6cf2228430c866\": container with ID starting with 05fecd04ce7147239a9e5c37d3a232d95033301b61acc1fd5f6cf2228430c866 not found: ID does not exist" Jul 16 20:02:10.717676 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.717636 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f96d567d6-zvmsr"] Jul 16 20:02:10.723559 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:10.723531 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f96d567d6-zvmsr"] Jul 16 20:02:12.017194 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:12.017164 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="322cb2da-6e27-4845-9081-0fec18abf287" path="/var/lib/kubelet/pods/322cb2da-6e27-4845-9081-0fec18abf287/volumes" Jul 16 20:02:18.886511 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:18.886465 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" podUID="59e96a3b-d5e3-4fff-b279-f34ed99173ea" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 16 20:02:20.737886 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:20.737843 2575 generic.go:356] "Generic (PLEG): container finished" podID="a6107c67-4cd3-4a39-8c05-98e0275776ac" containerID="2cf6294b0380c9f826e0d89564db4c874b3bf4fac260df8a6a2c235eae8a2cef" exitCode=0 Jul 16 20:02:20.738305 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:20.737915 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" event={"ID":"a6107c67-4cd3-4a39-8c05-98e0275776ac","Type":"ContainerDied","Data":"2cf6294b0380c9f826e0d89564db4c874b3bf4fac260df8a6a2c235eae8a2cef"} Jul 16 20:02:20.738374 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:20.738344 2575 scope.go:117] "RemoveContainer" containerID="2cf6294b0380c9f826e0d89564db4c874b3bf4fac260df8a6a2c235eae8a2cef" Jul 16 20:02:20.739527 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:20.739502 2575 generic.go:356] "Generic (PLEG): container finished" podID="f501e4af-fcc0-4f89-8cf0-bc3831c009e2" containerID="336306f62dd2f5129bb4c8578e3399239b369c78fb91f8660ea763cad1e418e3" exitCode=0 Jul 16 20:02:20.739615 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:20.739573 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-lpkxh" event={"ID":"f501e4af-fcc0-4f89-8cf0-bc3831c009e2","Type":"ContainerDied","Data":"336306f62dd2f5129bb4c8578e3399239b369c78fb91f8660ea763cad1e418e3"} Jul 16 20:02:20.739915 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:20.739899 2575 scope.go:117] "RemoveContainer" containerID="336306f62dd2f5129bb4c8578e3399239b369c78fb91f8660ea763cad1e418e3" Jul 16 20:02:21.313182 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:21.313140 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cbd95bbb-tngbx_8150a0a9-0feb-4c1d-9911-a56a59c792aa/router/0.log" Jul 16 20:02:21.329534 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:21.329509 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qgzz2_4681653d-f640-4ade-b608-ef327d5d7fa6/serve-healthcheck-canary/0.log" Jul 16 20:02:21.745003 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:21.744961 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-lpkxh" event={"ID":"f501e4af-fcc0-4f89-8cf0-bc3831c009e2","Type":"ContainerStarted","Data":"4d61179f7da035eb5da2eafd373a9e66f53b9a833d2ddca31110043a58e57aef"} Jul 16 20:02:21.746811 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:21.746756 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-zsw8q" event={"ID":"a6107c67-4cd3-4a39-8c05-98e0275776ac","Type":"ContainerStarted","Data":"bfc4466a5def215cc77cd72fa3b0f00b706b719443c66bc787e936815cda4c17"} Jul 16 20:02:25.094798 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:25.094730 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:02:25.193844 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:25.193808 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:02:28.886809 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:28.886749 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" podUID="59e96a3b-d5e3-4fff-b279-f34ed99173ea" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 16 20:02:38.886754 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:38.886712 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" podUID="59e96a3b-d5e3-4fff-b279-f34ed99173ea" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 16 20:02:38.887250 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:38.886841 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" Jul 16 20:02:38.887410 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:38.887388 2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"70e53a6a4065f2e0702d562eb755ef2f65d56add55632cb59524c0d52af18241"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 16 20:02:38.887460 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:38.887444 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" podUID="59e96a3b-d5e3-4fff-b279-f34ed99173ea" containerName="service-proxy" containerID="cri-o://70e53a6a4065f2e0702d562eb755ef2f65d56add55632cb59524c0d52af18241" gracePeriod=30 Jul 16 20:02:39.819176 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:39.819140 2575 generic.go:356] "Generic (PLEG): container finished" podID="59e96a3b-d5e3-4fff-b279-f34ed99173ea" containerID="70e53a6a4065f2e0702d562eb755ef2f65d56add55632cb59524c0d52af18241" exitCode=2 Jul 16 20:02:39.819354 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:39.819214 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" event={"ID":"59e96a3b-d5e3-4fff-b279-f34ed99173ea","Type":"ContainerDied","Data":"70e53a6a4065f2e0702d562eb755ef2f65d56add55632cb59524c0d52af18241"} Jul 16 20:02:39.819354 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:02:39.819260 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5745d69998-4jxxn" event={"ID":"59e96a3b-d5e3-4fff-b279-f34ed99173ea","Type":"ContainerStarted","Data":"7d78857e379eee30425b92f3b1c158946e40377b6a33b537ac2c3003149adac2"} Jul 16 20:03:04.204409 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:04.204309 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:04.767853 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:04.767816 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:05.014459 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:05.014421 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:05.096161 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:05.096123 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:05.223922 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:05.223880 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:05.325616 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:05.325575 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:05.760206 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:05.760171 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:05.861902 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:05.861841 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:16.191910 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:16.191869 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:16.290711 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:16.290673 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:16.390902 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:16.390867 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:16.996660 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:16.996623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:30.383495 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:30.383457 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:32.115808 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:32.115748 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:32.218188 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:32.218144 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:03:51.509500 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:03:51.509465 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:04:40.283602 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:04:40.283548 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:04:40.379644 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:04:40.379593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:02.750678 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:02.750642 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:02.872071 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:02.872039 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:03.929298 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:03.929266 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:05:03.934379 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:03.934352 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:05:03.942084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:03.942053 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 20:05:07.223760 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:07.223726 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:09.526707 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:09.526671 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:10.818256 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:10.818222 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:10.917855 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:10.917817 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:12.010602 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:12.010572 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:12.107623 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:12.107587 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:12.934740 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:12.934697 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:13.025600 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:13.025566 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:15.089138 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:15.089103 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:15.254407 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:15.254372 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:17.906163 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:17.906128 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:18.006547 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:18.006511 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:21.611540 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:21.611502 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:21.673985 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:21.673950 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:22.380211 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:22.380170 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:22.475707 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:22.475668 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:23.334328 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:23.334296 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:24.303697 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:24.303658 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:24.404381 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:24.404348 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:30.517865 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:30.517819 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:30.620876 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:30.620836 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:32.220440 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:32.220404 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:42.542932 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:42.542841 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:42.814628 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:42.814512 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:44.430534 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:44.430498 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:44.529398 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:44.529360 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:45.047352 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.047306 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:45.371903 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.371870 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:45.467092 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.467057 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:45.487300 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.487269 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp"] Jul 16 20:05:45.487559 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.487547 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="322cb2da-6e27-4845-9081-0fec18abf287" containerName="registry" Jul 16 20:05:45.487603 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.487561 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="322cb2da-6e27-4845-9081-0fec18abf287" containerName="registry" Jul 16 20:05:45.487639 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.487631 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="322cb2da-6e27-4845-9081-0fec18abf287" containerName="registry" Jul 16 20:05:45.490432 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.490415 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.492909 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.492879 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 16 20:05:45.493045 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.492948 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p5l6r\"" Jul 16 20:05:45.493045 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.492970 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 16 20:05:45.493920 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.493898 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 20:05:45.494044 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.494027 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 20:05:45.507841 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.507815 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp"] Jul 16 20:05:45.604786 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.604732 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4a0c2983-50b3-4351-b4b0-9d1b399c253d-manifests\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.604972 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.604838 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4drpn\" (UniqueName: \"kubernetes.io/projected/4a0c2983-50b3-4351-b4b0-9d1b399c253d-kube-api-access-4drpn\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.604972 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.604887 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a0c2983-50b3-4351-b4b0-9d1b399c253d-webhook-cert\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.604972 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.604938 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a0c2983-50b3-4351-b4b0-9d1b399c253d-tmp\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.605084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.605011 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4a0c2983-50b3-4351-b4b0-9d1b399c253d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.704437 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.704357 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:45.706311 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.706286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4drpn\" (UniqueName: \"kubernetes.io/projected/4a0c2983-50b3-4351-b4b0-9d1b399c253d-kube-api-access-4drpn\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.706462 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.706326 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a0c2983-50b3-4351-b4b0-9d1b399c253d-webhook-cert\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.706462 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.706376 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a0c2983-50b3-4351-b4b0-9d1b399c253d-tmp\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.706462 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.706426 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4a0c2983-50b3-4351-b4b0-9d1b399c253d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.706622 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.706465 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4a0c2983-50b3-4351-b4b0-9d1b399c253d-manifests\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.706852 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.706832 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4a0c2983-50b3-4351-b4b0-9d1b399c253d-manifests\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.708635 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.708604 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a0c2983-50b3-4351-b4b0-9d1b399c253d-tmp\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.708879 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.708863 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4a0c2983-50b3-4351-b4b0-9d1b399c253d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.708933 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.708915 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4a0c2983-50b3-4351-b4b0-9d1b399c253d-webhook-cert\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.714748 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.714724 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4drpn\" (UniqueName: \"kubernetes.io/projected/4a0c2983-50b3-4351-b4b0-9d1b399c253d-kube-api-access-4drpn\") pod \"opendatahub-operator-controller-manager-64c594d8d4-h48xp\" (UID: \"4a0c2983-50b3-4351-b4b0-9d1b399c253d\") " pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.800735 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.800702 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:45.813876 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.813843 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:45.905197 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.905159 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:45.943428 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.943400 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp"] Jul 16 20:05:45.946514 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:05:45.946489 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0c2983_50b3_4351_b4b0_9d1b399c253d.slice/crio-f79865fe5df4f8612169f9fa2104eb3ce79c718e56fd5f6170d91b2324aadbe3 WatchSource:0}: Error finding container f79865fe5df4f8612169f9fa2104eb3ce79c718e56fd5f6170d91b2324aadbe3: Status 404 returned error can't find the container with id f79865fe5df4f8612169f9fa2104eb3ce79c718e56fd5f6170d91b2324aadbe3 Jul 16 20:05:45.948472 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:45.948453 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 20:05:46.007269 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:46.007173 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:46.109067 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:46.109031 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:46.206435 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:46.206398 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:05:46.520313 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:46.520280 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" event={"ID":"4a0c2983-50b3-4351-b4b0-9d1b399c253d","Type":"ContainerStarted","Data":"f79865fe5df4f8612169f9fa2104eb3ce79c718e56fd5f6170d91b2324aadbe3"} Jul 16 20:05:51.545036 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:51.544952 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" event={"ID":"4a0c2983-50b3-4351-b4b0-9d1b399c253d","Type":"ContainerStarted","Data":"d684a34f3dc28a93cc9f966ed4f040b9d77bd254d605c7480c3ff5928c19259c"} Jul 16 20:05:52.550677 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:52.550641 2575 generic.go:356] "Generic (PLEG): container finished" podID="4a0c2983-50b3-4351-b4b0-9d1b399c253d" containerID="d684a34f3dc28a93cc9f966ed4f040b9d77bd254d605c7480c3ff5928c19259c" exitCode=0 Jul 16 20:05:52.551087 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:52.550716 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" event={"ID":"4a0c2983-50b3-4351-b4b0-9d1b399c253d","Type":"ContainerDied","Data":"d684a34f3dc28a93cc9f966ed4f040b9d77bd254d605c7480c3ff5928c19259c"} Jul 16 20:05:54.561612 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:54.561510 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" event={"ID":"4a0c2983-50b3-4351-b4b0-9d1b399c253d","Type":"ContainerStarted","Data":"0c4b6c36a84fa43624495d160ba68a4c2911056e56a0f2bff10ec50316727f92"} Jul 16 20:05:54.562001 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:54.561632 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:05:54.583697 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:05:54.583642 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" podStartSLOduration=1.725780122 podStartE2EDuration="9.583624969s" totalImagesPullingTime="6.735980598s" totalInitContainerRuntime="1.121864249s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:05:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:05:54.581969482 +0000 UTC m=+351.045322505" watchObservedRunningTime="2026-07-16 20:05:54.583624969 +0000 UTC m=+351.046978003" Jul 16 20:06:05.569103 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:05.569026 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64c594d8d4-h48xp" Jul 16 20:06:07.069565 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.069512 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:07.264058 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.264022 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:07.463927 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.463894 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:07.595550 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.595517 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4"] Jul 16 20:06:07.609522 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.609490 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" Jul 16 20:06:07.611905 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.611868 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4"] Jul 16 20:06:07.612158 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.612138 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mc88n\"" Jul 16 20:06:07.612279 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.612230 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 16 20:06:07.613209 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.613191 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 16 20:06:07.687257 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.687213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264f4e7d-487b-401b-b119-4ebd50d80fbb-tls-certs\") pod \"kube-auth-proxy-59f964d6d4-4gjb4\" (UID: \"264f4e7d-487b-401b-b119-4ebd50d80fbb\") " pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" Jul 16 20:06:07.687257 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.687269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/264f4e7d-487b-401b-b119-4ebd50d80fbb-tmp\") pod \"kube-auth-proxy-59f964d6d4-4gjb4\" (UID: \"264f4e7d-487b-401b-b119-4ebd50d80fbb\") " pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" Jul 16 20:06:07.687507 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.687345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blqpp\" (UniqueName: \"kubernetes.io/projected/264f4e7d-487b-401b-b119-4ebd50d80fbb-kube-api-access-blqpp\") pod \"kube-auth-proxy-59f964d6d4-4gjb4\" (UID: \"264f4e7d-487b-401b-b119-4ebd50d80fbb\") " pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" Jul 16 20:06:07.709006 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.708960 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:07.788016 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.787924 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264f4e7d-487b-401b-b119-4ebd50d80fbb-tls-certs\") pod \"kube-auth-proxy-59f964d6d4-4gjb4\" (UID: \"264f4e7d-487b-401b-b119-4ebd50d80fbb\") " pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" Jul 16 20:06:07.788016 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.787979 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/264f4e7d-487b-401b-b119-4ebd50d80fbb-tmp\") pod \"kube-auth-proxy-59f964d6d4-4gjb4\" (UID: \"264f4e7d-487b-401b-b119-4ebd50d80fbb\") " pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" Jul 16 20:06:07.788016 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.788009 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blqpp\" (UniqueName: \"kubernetes.io/projected/264f4e7d-487b-401b-b119-4ebd50d80fbb-kube-api-access-blqpp\") pod \"kube-auth-proxy-59f964d6d4-4gjb4\" (UID: \"264f4e7d-487b-401b-b119-4ebd50d80fbb\") " pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" Jul 16 20:06:07.790405 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.790373 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/264f4e7d-487b-401b-b119-4ebd50d80fbb-tmp\") pod \"kube-auth-proxy-59f964d6d4-4gjb4\" (UID: \"264f4e7d-487b-401b-b119-4ebd50d80fbb\") " pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" Jul 16 20:06:07.790562 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.790544 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264f4e7d-487b-401b-b119-4ebd50d80fbb-tls-certs\") pod \"kube-auth-proxy-59f964d6d4-4gjb4\" (UID: \"264f4e7d-487b-401b-b119-4ebd50d80fbb\") " pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" Jul 16 20:06:07.799293 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.799261 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blqpp\" (UniqueName: \"kubernetes.io/projected/264f4e7d-487b-401b-b119-4ebd50d80fbb-kube-api-access-blqpp\") pod \"kube-auth-proxy-59f964d6d4-4gjb4\" (UID: \"264f4e7d-487b-401b-b119-4ebd50d80fbb\") " pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" Jul 16 20:06:07.894902 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.894867 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fb4k4"] Jul 16 20:06:07.897603 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.897585 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" Jul 16 20:06:07.900580 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.900552 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 16 20:06:07.900734 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.900717 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dtprz\"" Jul 16 20:06:07.912482 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.912450 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fb4k4"] Jul 16 20:06:07.919894 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.919871 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" Jul 16 20:06:07.943449 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.943401 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:07.989631 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.989592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96bb6697-a0e5-473e-ad38-e76d568f1871-cert\") pod \"odh-model-controller-7998c67dc4-fb4k4\" (UID: \"96bb6697-a0e5-473e-ad38-e76d568f1871\") " pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" Jul 16 20:06:07.989794 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:07.989685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ztx9\" (UniqueName: \"kubernetes.io/projected/96bb6697-a0e5-473e-ad38-e76d568f1871-kube-api-access-8ztx9\") pod \"odh-model-controller-7998c67dc4-fb4k4\" (UID: \"96bb6697-a0e5-473e-ad38-e76d568f1871\") " pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" Jul 16 20:06:08.042082 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.041989 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:08.062687 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.062558 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4"] Jul 16 20:06:08.065341 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:06:08.065314 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264f4e7d_487b_401b_b119_4ebd50d80fbb.slice/crio-192be4800ddd2d26d4be815aed8e15a0b07f9cb073c0d0dcb1f59840a75c40c9 WatchSource:0}: Error finding container 192be4800ddd2d26d4be815aed8e15a0b07f9cb073c0d0dcb1f59840a75c40c9: Status 404 returned error can't find the container with id 192be4800ddd2d26d4be815aed8e15a0b07f9cb073c0d0dcb1f59840a75c40c9 Jul 16 20:06:08.090116 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.090081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96bb6697-a0e5-473e-ad38-e76d568f1871-cert\") pod \"odh-model-controller-7998c67dc4-fb4k4\" (UID: \"96bb6697-a0e5-473e-ad38-e76d568f1871\") " pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" Jul 16 20:06:08.090633 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.090131 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ztx9\" (UniqueName: \"kubernetes.io/projected/96bb6697-a0e5-473e-ad38-e76d568f1871-kube-api-access-8ztx9\") pod \"odh-model-controller-7998c67dc4-fb4k4\" (UID: \"96bb6697-a0e5-473e-ad38-e76d568f1871\") " pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" Jul 16 20:06:08.090633 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:06:08.090252 2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 16 20:06:08.090633 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:06:08.090336 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96bb6697-a0e5-473e-ad38-e76d568f1871-cert podName:96bb6697-a0e5-473e-ad38-e76d568f1871 nodeName:}" failed. No retries permitted until 2026-07-16 20:06:08.590313534 +0000 UTC m=+365.053666547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/96bb6697-a0e5-473e-ad38-e76d568f1871-cert") pod "odh-model-controller-7998c67dc4-fb4k4" (UID: "96bb6697-a0e5-473e-ad38-e76d568f1871") : secret "odh-model-controller-webhook-cert" not found Jul 16 20:06:08.104863 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.104827 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ztx9\" (UniqueName: \"kubernetes.io/projected/96bb6697-a0e5-473e-ad38-e76d568f1871-kube-api-access-8ztx9\") pod \"odh-model-controller-7998c67dc4-fb4k4\" (UID: \"96bb6697-a0e5-473e-ad38-e76d568f1871\") " pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" Jul 16 20:06:08.150477 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.150442 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:08.344931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.344897 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:08.594346 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.594312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96bb6697-a0e5-473e-ad38-e76d568f1871-cert\") pod \"odh-model-controller-7998c67dc4-fb4k4\" (UID: \"96bb6697-a0e5-473e-ad38-e76d568f1871\") " pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" Jul 16 20:06:08.596876 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.596808 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96bb6697-a0e5-473e-ad38-e76d568f1871-cert\") pod \"odh-model-controller-7998c67dc4-fb4k4\" (UID: \"96bb6697-a0e5-473e-ad38-e76d568f1871\") " pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" Jul 16 20:06:08.622041 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.622007 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" event={"ID":"264f4e7d-487b-401b-b119-4ebd50d80fbb","Type":"ContainerStarted","Data":"192be4800ddd2d26d4be815aed8e15a0b07f9cb073c0d0dcb1f59840a75c40c9"} Jul 16 20:06:08.807997 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.807956 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" Jul 16 20:06:08.862398 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.862368 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jtwg5"] Jul 16 20:06:08.865643 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.865510 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jtwg5" Jul 16 20:06:08.868961 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.868655 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 16 20:06:08.876494 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.876457 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jtwg5"] Jul 16 20:06:08.896297 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.896256 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a586cbd-16d9-4ae8-a6b9-83d7faff22c7-tls-certs\") pod \"model-serving-api-54d89bd5fc-jtwg5\" (UID: \"9a586cbd-16d9-4ae8-a6b9-83d7faff22c7\") " pod="opendatahub/model-serving-api-54d89bd5fc-jtwg5" Jul 16 20:06:08.896430 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.896362 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frnlx\" (UniqueName: \"kubernetes.io/projected/9a586cbd-16d9-4ae8-a6b9-83d7faff22c7-kube-api-access-frnlx\") pod \"model-serving-api-54d89bd5fc-jtwg5\" (UID: \"9a586cbd-16d9-4ae8-a6b9-83d7faff22c7\") " pod="opendatahub/model-serving-api-54d89bd5fc-jtwg5" Jul 16 20:06:08.959793 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.959735 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fb4k4"] Jul 16 20:06:08.963380 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:06:08.963345 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96bb6697_a0e5_473e_ad38_e76d568f1871.slice/crio-1de59bd068d2634eed8ebbb3d18644afb6775f39e42e82bf67c979d52d606107 WatchSource:0}: Error finding container 1de59bd068d2634eed8ebbb3d18644afb6775f39e42e82bf67c979d52d606107: Status 404 returned error can't find the container with id 1de59bd068d2634eed8ebbb3d18644afb6775f39e42e82bf67c979d52d606107 Jul 16 20:06:08.997442 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.997401 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frnlx\" (UniqueName: \"kubernetes.io/projected/9a586cbd-16d9-4ae8-a6b9-83d7faff22c7-kube-api-access-frnlx\") pod \"model-serving-api-54d89bd5fc-jtwg5\" (UID: \"9a586cbd-16d9-4ae8-a6b9-83d7faff22c7\") " pod="opendatahub/model-serving-api-54d89bd5fc-jtwg5" Jul 16 20:06:08.997632 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:08.997497 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a586cbd-16d9-4ae8-a6b9-83d7faff22c7-tls-certs\") pod \"model-serving-api-54d89bd5fc-jtwg5\" (UID: \"9a586cbd-16d9-4ae8-a6b9-83d7faff22c7\") " pod="opendatahub/model-serving-api-54d89bd5fc-jtwg5" Jul 16 20:06:09.000249 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.000223 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a586cbd-16d9-4ae8-a6b9-83d7faff22c7-tls-certs\") pod \"model-serving-api-54d89bd5fc-jtwg5\" (UID: \"9a586cbd-16d9-4ae8-a6b9-83d7faff22c7\") " pod="opendatahub/model-serving-api-54d89bd5fc-jtwg5" Jul 16 20:06:09.008358 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.008328 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frnlx\" (UniqueName: \"kubernetes.io/projected/9a586cbd-16d9-4ae8-a6b9-83d7faff22c7-kube-api-access-frnlx\") pod \"model-serving-api-54d89bd5fc-jtwg5\" (UID: \"9a586cbd-16d9-4ae8-a6b9-83d7faff22c7\") " pod="opendatahub/model-serving-api-54d89bd5fc-jtwg5" Jul 16 20:06:09.058157 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.058122 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-572dq"] Jul 16 20:06:09.060341 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.060325 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.063198 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.063156 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 16 20:06:09.063198 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.063159 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 20:06:09.063392 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.063235 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7pgj9\"" Jul 16 20:06:09.063392 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.063274 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 16 20:06:09.063392 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.063239 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 16 20:06:09.076049 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.076022 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-572dq"] Jul 16 20:06:09.098284 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.098246 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.098707 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.098308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.098707 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.098337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-token\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.098707 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.098366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-local-certs\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.098707 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.098381 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbb7d\" (UniqueName: \"kubernetes.io/projected/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-kube-api-access-tbb7d\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.098707 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.098451 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-cacerts\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.098707 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.098494 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.180218 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.180129 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jtwg5" Jul 16 20:06:09.199499 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.199468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-cacerts\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.199646 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.199528 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.199646 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.199576 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.199646 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.199642 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.199847 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.199672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-token\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.199847 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.199698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-local-certs\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.199847 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.199720 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbb7d\" (UniqueName: \"kubernetes.io/projected/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-kube-api-access-tbb7d\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.200391 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.200363 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.202140 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.202114 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.202233 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.202163 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-cacerts\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.202233 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.202220 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-local-certs\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.202401 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.202385 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.208452 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.208424 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-token\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.208626 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.208609 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbb7d\" (UniqueName: \"kubernetes.io/projected/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-kube-api-access-tbb7d\") pod \"istiod-openshift-gateway-7574459656-572dq\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.315497 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.315425 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jtwg5"] Jul 16 20:06:09.319500 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:06:09.319468 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a586cbd_16d9_4ae8_a6b9_83d7faff22c7.slice/crio-368b143224e95ed7de8efbb8234de62db6440b7d055a8e9f517aa3c0931f37e5 WatchSource:0}: Error finding container 368b143224e95ed7de8efbb8234de62db6440b7d055a8e9f517aa3c0931f37e5: Status 404 returned error can't find the container with id 368b143224e95ed7de8efbb8234de62db6440b7d055a8e9f517aa3c0931f37e5 Jul 16 20:06:09.369921 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.369872 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:09.496498 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.496463 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:09.527562 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.527536 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-572dq"] Jul 16 20:06:09.529751 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:06:09.529723 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f501a2_70f7_4b4f_8eb0_67f2bd627ea6.slice/crio-f4669835cf063776b723c9e9642b7d8e9e3cbb0e2197ef8f09bb5a196d30cbd9 WatchSource:0}: Error finding container f4669835cf063776b723c9e9642b7d8e9e3cbb0e2197ef8f09bb5a196d30cbd9: Status 404 returned error can't find the container with id f4669835cf063776b723c9e9642b7d8e9e3cbb0e2197ef8f09bb5a196d30cbd9 Jul 16 20:06:09.597300 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.597265 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:09.627593 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.627553 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" event={"ID":"96bb6697-a0e5-473e-ad38-e76d568f1871","Type":"ContainerStarted","Data":"1de59bd068d2634eed8ebbb3d18644afb6775f39e42e82bf67c979d52d606107"} Jul 16 20:06:09.628811 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.628784 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" event={"ID":"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6","Type":"ContainerStarted","Data":"f4669835cf063776b723c9e9642b7d8e9e3cbb0e2197ef8f09bb5a196d30cbd9"} Jul 16 20:06:09.629757 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:09.629738 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jtwg5" event={"ID":"9a586cbd-16d9-4ae8-a6b9-83d7faff22c7","Type":"ContainerStarted","Data":"368b143224e95ed7de8efbb8234de62db6440b7d055a8e9f517aa3c0931f37e5"} Jul 16 20:06:10.159553 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:10.159510 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:15.017149 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:15.017089 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:06:15.017720 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:15.017183 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:06:15.673910 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:15.673872 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" event={"ID":"96bb6697-a0e5-473e-ad38-e76d568f1871","Type":"ContainerStarted","Data":"1bfc7b7e08afa6f263a821a707d215bcf65e30359be714625e480df73b8fb7fe"} Jul 16 20:06:15.674121 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:15.673965 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" Jul 16 20:06:15.675452 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:15.675424 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" event={"ID":"264f4e7d-487b-401b-b119-4ebd50d80fbb","Type":"ContainerStarted","Data":"da3aab8426602925f0af4d33f89e5d50c82907c7969a114435146f6f62c2cf81"} Jul 16 20:06:15.676984 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:15.676953 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" event={"ID":"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6","Type":"ContainerStarted","Data":"fe99e77f3dd1bdc1d91353701cccbae16a5f7ab21f2b0a7e1e11f4846da53384"} Jul 16 20:06:15.677102 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:15.677034 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:15.678479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:15.678452 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jtwg5" event={"ID":"9a586cbd-16d9-4ae8-a6b9-83d7faff22c7","Type":"ContainerStarted","Data":"21c2938387baaa1711adb75b2d7a72c32c679394c5c4fedb2217c2f0a0b73f65"} Jul 16 20:06:15.678588 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:15.678571 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jtwg5" Jul 16 20:06:15.699667 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:15.699616 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" podStartSLOduration=2.6328201890000003 podStartE2EDuration="8.699598518s" totalImagesPullingTime="6.066778329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:06:15.698101883 +0000 UTC m=+372.161454914" watchObservedRunningTime="2026-07-16 20:06:15.699598518 +0000 UTC m=+372.162951549" Jul 16 20:06:15.725491 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:15.725435 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59f964d6d4-4gjb4" podStartSLOduration=1.7717140059999998 podStartE2EDuration="8.725409345s" totalImagesPullingTime="6.953695339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:06:15.725204137 +0000 UTC m=+372.188557170" watchObservedRunningTime="2026-07-16 20:06:15.725409345 +0000 UTC m=+372.188762374" Jul 16 20:06:15.754419 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:15.754368 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jtwg5" podStartSLOduration=2.054528529 podStartE2EDuration="7.754352135s" totalImagesPullingTime="5.699823606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:06:15.752785057 +0000 UTC m=+372.216138086" watchObservedRunningTime="2026-07-16 20:06:15.754352135 +0000 UTC m=+372.217705166" Jul 16 20:06:15.781796 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:15.781723 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" podStartSLOduration=1.296805566 podStartE2EDuration="6.781704643s" totalImagesPullingTime="5.484899077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:06:15.780138344 +0000 UTC m=+372.243491373" watchObservedRunningTime="2026-07-16 20:06:15.781704643 +0000 UTC m=+372.245057673" Jul 16 20:06:16.190913 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.190880 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:16.513103 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.513009 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q"] Jul 16 20:06:16.516489 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.516467 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.519241 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.519215 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9q8vk\"" Jul 16 20:06:16.529462 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.529432 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q"] Jul 16 20:06:16.566545 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.566510 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.566545 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.566545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.566782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.566575 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.566782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.566619 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61125582-1358-45ca-b0fb-466f4bbcb41f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.566782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.566669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.566782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.566709 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.566782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.566739 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.567030 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.566793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.567030 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.566810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ftlf\" (UniqueName: \"kubernetes.io/projected/61125582-1358-45ca-b0fb-466f4bbcb41f-kube-api-access-8ftlf\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.668105 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.668072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.668105 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.668120 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.668359 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.668140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ftlf\" (UniqueName: \"kubernetes.io/projected/61125582-1358-45ca-b0fb-466f4bbcb41f-kube-api-access-8ftlf\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.668359 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.668180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.668359 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.668207 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.668359 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.668252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.668359 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.668276 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61125582-1358-45ca-b0fb-466f4bbcb41f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.668359 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.668300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.668359 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.668328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.668684 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.668574 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.668684 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.668602 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.668820 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.668740 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.668820 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.668799 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.669276 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.669253 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61125582-1358-45ca-b0fb-466f4bbcb41f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.670681 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.670658 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.670836 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.670816 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.678595 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.678566 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.678708 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.678687 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ftlf\" (UniqueName: \"kubernetes.io/projected/61125582-1358-45ca-b0fb-466f4bbcb41f-kube-api-access-8ftlf\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.684901 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.684872 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-572dq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 20:06:16.685010 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.684929 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" podUID="c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 20:06:16.826415 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.826329 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:16.977174 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:16.977147 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q"] Jul 16 20:06:16.978551 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:06:16.978524 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61125582_1358_45ca_b0fb_466f4bbcb41f.slice/crio-f13fa1f324090dd15cc022bd221ee2503da152220380491e1a1676291cae12f4 WatchSource:0}: Error finding container f13fa1f324090dd15cc022bd221ee2503da152220380491e1a1676291cae12f4: Status 404 returned error can't find the container with id f13fa1f324090dd15cc022bd221ee2503da152220380491e1a1676291cae12f4 Jul 16 20:06:17.687821 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:17.687791 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" event={"ID":"61125582-1358-45ca-b0fb-466f4bbcb41f","Type":"ContainerStarted","Data":"f13fa1f324090dd15cc022bd221ee2503da152220380491e1a1676291cae12f4"} Jul 16 20:06:18.622892 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:18.622860 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:18.780111 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:18.780076 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:18.912563 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:18.912482 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-x8586"] Jul 16 20:06:18.917074 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:18.917055 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x8586" Jul 16 20:06:18.927224 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:18.927201 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 16 20:06:18.933983 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:18.933948 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dl95k\"" Jul 16 20:06:18.957538 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:18.957456 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-x8586"] Jul 16 20:06:18.981171 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:18.981135 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:18.987211 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:18.987185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7ddc294-dbfe-49c0-b69c-4fe014fedca9-cert\") pod \"kserve-controller-manager-d6f4b65b8-x8586\" (UID: \"e7ddc294-dbfe-49c0-b69c-4fe014fedca9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x8586" Jul 16 20:06:18.987335 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:18.987253 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbc4t\" (UniqueName: \"kubernetes.io/projected/e7ddc294-dbfe-49c0-b69c-4fe014fedca9-kube-api-access-gbc4t\") pod \"kserve-controller-manager-d6f4b65b8-x8586\" (UID: \"e7ddc294-dbfe-49c0-b69c-4fe014fedca9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x8586" Jul 16 20:06:19.079392 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:19.079357 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:19.088026 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:19.087999 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbc4t\" (UniqueName: \"kubernetes.io/projected/e7ddc294-dbfe-49c0-b69c-4fe014fedca9-kube-api-access-gbc4t\") pod \"kserve-controller-manager-d6f4b65b8-x8586\" (UID: \"e7ddc294-dbfe-49c0-b69c-4fe014fedca9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x8586" Jul 16 20:06:19.088148 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:19.088051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7ddc294-dbfe-49c0-b69c-4fe014fedca9-cert\") pod \"kserve-controller-manager-d6f4b65b8-x8586\" (UID: \"e7ddc294-dbfe-49c0-b69c-4fe014fedca9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x8586" Jul 16 20:06:19.090524 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:19.090496 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7ddc294-dbfe-49c0-b69c-4fe014fedca9-cert\") pod \"kserve-controller-manager-d6f4b65b8-x8586\" (UID: \"e7ddc294-dbfe-49c0-b69c-4fe014fedca9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x8586" Jul 16 20:06:19.097682 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:19.097657 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbc4t\" (UniqueName: \"kubernetes.io/projected/e7ddc294-dbfe-49c0-b69c-4fe014fedca9-kube-api-access-gbc4t\") pod \"kserve-controller-manager-d6f4b65b8-x8586\" (UID: \"e7ddc294-dbfe-49c0-b69c-4fe014fedca9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-x8586" Jul 16 20:06:19.228254 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:19.228140 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x8586" Jul 16 20:06:19.399897 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:19.399864 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-x8586"] Jul 16 20:06:19.402759 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:06:19.402724 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ddc294_dbfe_49c0_b69c_4fe014fedca9.slice/crio-37bf1bcb32bac73df73b7736f60c9230287b16f439bc8e5a0caea58fb7dc83cb WatchSource:0}: Error finding container 37bf1bcb32bac73df73b7736f60c9230287b16f439bc8e5a0caea58fb7dc83cb: Status 404 returned error can't find the container with id 37bf1bcb32bac73df73b7736f60c9230287b16f439bc8e5a0caea58fb7dc83cb Jul 16 20:06:19.470120 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:19.470078 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:19.684528 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:19.684499 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:19.699925 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:19.699888 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x8586" event={"ID":"e7ddc294-dbfe-49c0-b69c-4fe014fedca9","Type":"ContainerStarted","Data":"37bf1bcb32bac73df73b7736f60c9230287b16f439bc8e5a0caea58fb7dc83cb"} Jul 16 20:06:20.166968 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:20.166930 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:20.260036 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:20.259999 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:20.357142 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:20.357104 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:21.984457 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:21.984422 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:06:21.984720 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:21.984488 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:06:21.984720 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:21.984521 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:06:22.029965 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.029937 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-572dq"] Jul 16 20:06:22.030140 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.030120 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" podUID="c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" containerName="discovery" containerID="cri-o://fe99e77f3dd1bdc1d91353701cccbae16a5f7ab21f2b0a7e1e11f4846da53384" gracePeriod=30 Jul 16 20:06:22.300989 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.300963 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:22.418793 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.418746 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-token\") pod \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " Jul 16 20:06:22.418793 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.418803 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-cacerts\") pod \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " Jul 16 20:06:22.419038 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.418892 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-kubeconfig\") pod \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " Jul 16 20:06:22.419038 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.418923 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbb7d\" (UniqueName: \"kubernetes.io/projected/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-kube-api-access-tbb7d\") pod \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " Jul 16 20:06:22.419038 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.418987 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-csr-dns-cert\") pod \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " Jul 16 20:06:22.419038 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.419014 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-local-certs\") pod \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " Jul 16 20:06:22.419248 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.419081 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-csr-ca-configmap\") pod \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\" (UID: \"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6\") " Jul 16 20:06:22.419640 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.419612 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" (UID: "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:06:22.421469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.421417 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" (UID: "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:06:22.421469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.421453 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" (UID: "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:06:22.421599 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.421476 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-cacerts" (OuterVolumeSpecName: "cacerts") pod "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" (UID: "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:06:22.421599 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.421491 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" (UID: "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:06:22.421713 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.421692 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-kube-api-access-tbb7d" (OuterVolumeSpecName: "kube-api-access-tbb7d") pod "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" (UID: "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6"). InnerVolumeSpecName "kube-api-access-tbb7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:06:22.422276 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.422258 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-local-certs" (OuterVolumeSpecName: "local-certs") pod "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" (UID: "c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:06:22.519903 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.519860 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-token\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:22.519903 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.519893 2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-cacerts\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:22.519903 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.519903 2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-kubeconfig\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:22.519903 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.519912 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbb7d\" (UniqueName: \"kubernetes.io/projected/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-kube-api-access-tbb7d\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:22.520165 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.519924 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-csr-dns-cert\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:22.520165 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.519932 2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-local-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:22.520165 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.519940 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6-istio-csr-ca-configmap\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:22.716909 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.716875 2575 generic.go:356] "Generic (PLEG): container finished" podID="c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" containerID="fe99e77f3dd1bdc1d91353701cccbae16a5f7ab21f2b0a7e1e11f4846da53384" exitCode=0 Jul 16 20:06:22.717119 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.716919 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" Jul 16 20:06:22.717119 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.716943 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" event={"ID":"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6","Type":"ContainerDied","Data":"fe99e77f3dd1bdc1d91353701cccbae16a5f7ab21f2b0a7e1e11f4846da53384"} Jul 16 20:06:22.717119 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.717003 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-572dq" event={"ID":"c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6","Type":"ContainerDied","Data":"f4669835cf063776b723c9e9642b7d8e9e3cbb0e2197ef8f09bb5a196d30cbd9"} Jul 16 20:06:22.717119 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.717033 2575 scope.go:117] "RemoveContainer" containerID="fe99e77f3dd1bdc1d91353701cccbae16a5f7ab21f2b0a7e1e11f4846da53384" Jul 16 20:06:22.718652 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.718628 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" event={"ID":"61125582-1358-45ca-b0fb-466f4bbcb41f","Type":"ContainerStarted","Data":"00fa4d08d8d2a6d9506038a5fc4bffd2992624a5f851171758dea5bc950cd8f1"} Jul 16 20:06:22.725998 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.725977 2575 scope.go:117] "RemoveContainer" containerID="fe99e77f3dd1bdc1d91353701cccbae16a5f7ab21f2b0a7e1e11f4846da53384" Jul 16 20:06:22.726285 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:06:22.726266 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe99e77f3dd1bdc1d91353701cccbae16a5f7ab21f2b0a7e1e11f4846da53384\": container with ID starting with fe99e77f3dd1bdc1d91353701cccbae16a5f7ab21f2b0a7e1e11f4846da53384 not found: ID does not exist" containerID="fe99e77f3dd1bdc1d91353701cccbae16a5f7ab21f2b0a7e1e11f4846da53384" Jul 16 20:06:22.726349 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.726298 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe99e77f3dd1bdc1d91353701cccbae16a5f7ab21f2b0a7e1e11f4846da53384"} err="failed to get container status \"fe99e77f3dd1bdc1d91353701cccbae16a5f7ab21f2b0a7e1e11f4846da53384\": rpc error: code = NotFound desc = could not find container \"fe99e77f3dd1bdc1d91353701cccbae16a5f7ab21f2b0a7e1e11f4846da53384\": container with ID starting with fe99e77f3dd1bdc1d91353701cccbae16a5f7ab21f2b0a7e1e11f4846da53384 not found: ID does not exist" Jul 16 20:06:22.771962 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.771909 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" podStartSLOduration=1.76843628 podStartE2EDuration="6.77189169s" totalImagesPullingTime="5.00345541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:06:22.766820281 +0000 UTC m=+379.230173312" watchObservedRunningTime="2026-07-16 20:06:22.77189169 +0000 UTC m=+379.235244722" Jul 16 20:06:22.790686 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.790645 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-572dq"] Jul 16 20:06:22.798107 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.798078 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-572dq"] Jul 16 20:06:22.826652 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.826624 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:22.856938 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:22.856901 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q"] Jul 16 20:06:23.829082 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:23.829035 2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 16 20:06:23.829561 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:23.829123 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" podUID="61125582-1358-45ca-b0fb-466f4bbcb41f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 16 20:06:24.021759 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:24.021730 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" path="/var/lib/kubelet/pods/c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6/volumes" Jul 16 20:06:24.731387 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:24.731348 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x8586" event={"ID":"e7ddc294-dbfe-49c0-b69c-4fe014fedca9","Type":"ContainerStarted","Data":"35e31400bea9b68d21d8886d1d1698fa89edc3eeaf46be3cfc62661e183e3115"} Jul 16 20:06:24.731574 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:24.731398 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" podUID="61125582-1358-45ca-b0fb-466f4bbcb41f" containerName="istio-proxy" containerID="cri-o://00fa4d08d8d2a6d9506038a5fc4bffd2992624a5f851171758dea5bc950cd8f1" gracePeriod=30 Jul 16 20:06:24.768438 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:24.768383 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x8586" podStartSLOduration=1.896706427 podStartE2EDuration="6.768366235s" totalImagesPullingTime="4.871659808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:06:24.767828812 +0000 UTC m=+381.231181844" watchObservedRunningTime="2026-07-16 20:06:24.768366235 +0000 UTC m=+381.231719283" Jul 16 20:06:25.736251 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:25.736216 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x8586" Jul 16 20:06:26.685409 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:26.685381 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fb4k4" Jul 16 20:06:26.688636 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:26.688612 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jtwg5" Jul 16 20:06:29.983347 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:29.983313 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:30.084971 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.084932 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-podinfo\") pod \"61125582-1358-45ca-b0fb-466f4bbcb41f\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " Jul 16 20:06:30.084971 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.084974 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ftlf\" (UniqueName: \"kubernetes.io/projected/61125582-1358-45ca-b0fb-466f4bbcb41f-kube-api-access-8ftlf\") pod \"61125582-1358-45ca-b0fb-466f4bbcb41f\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " Jul 16 20:06:30.085187 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.084993 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-token\") pod \"61125582-1358-45ca-b0fb-466f4bbcb41f\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " Jul 16 20:06:30.085187 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085016 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-workload-certs\") pod \"61125582-1358-45ca-b0fb-466f4bbcb41f\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " Jul 16 20:06:30.085187 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085148 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-data\") pod \"61125582-1358-45ca-b0fb-466f4bbcb41f\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " Jul 16 20:06:30.085308 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085199 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-credential-socket\") pod \"61125582-1358-45ca-b0fb-466f4bbcb41f\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " Jul 16 20:06:30.085308 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085241 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-workload-socket\") pod \"61125582-1358-45ca-b0fb-466f4bbcb41f\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " Jul 16 20:06:30.085412 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085309 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61125582-1358-45ca-b0fb-466f4bbcb41f-istiod-ca-cert\") pod \"61125582-1358-45ca-b0fb-466f4bbcb41f\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " Jul 16 20:06:30.085412 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085341 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-envoy\") pod \"61125582-1358-45ca-b0fb-466f4bbcb41f\" (UID: \"61125582-1358-45ca-b0fb-466f4bbcb41f\") " Jul 16 20:06:30.085412 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085346 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "61125582-1358-45ca-b0fb-466f4bbcb41f" (UID: "61125582-1358-45ca-b0fb-466f4bbcb41f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:06:30.085567 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085426 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-data" (OuterVolumeSpecName: "istio-data") pod "61125582-1358-45ca-b0fb-466f4bbcb41f" (UID: "61125582-1358-45ca-b0fb-466f4bbcb41f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:06:30.085567 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085498 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "61125582-1358-45ca-b0fb-466f4bbcb41f" (UID: "61125582-1358-45ca-b0fb-466f4bbcb41f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:06:30.085675 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085597 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "61125582-1358-45ca-b0fb-466f4bbcb41f" (UID: "61125582-1358-45ca-b0fb-466f4bbcb41f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:06:30.085746 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085719 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61125582-1358-45ca-b0fb-466f4bbcb41f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "61125582-1358-45ca-b0fb-466f4bbcb41f" (UID: "61125582-1358-45ca-b0fb-466f4bbcb41f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:06:30.085825 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085788 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-data\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:30.085825 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085813 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-credential-socket\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:30.085928 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085828 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-workload-socket\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:30.085928 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.085843 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-workload-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:30.087394 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.087368 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "61125582-1358-45ca-b0fb-466f4bbcb41f" (UID: "61125582-1358-45ca-b0fb-466f4bbcb41f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:06:30.087502 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.087402 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-token" (OuterVolumeSpecName: "istio-token") pod "61125582-1358-45ca-b0fb-466f4bbcb41f" (UID: "61125582-1358-45ca-b0fb-466f4bbcb41f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:06:30.087502 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.087492 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61125582-1358-45ca-b0fb-466f4bbcb41f-kube-api-access-8ftlf" (OuterVolumeSpecName: "kube-api-access-8ftlf") pod "61125582-1358-45ca-b0fb-466f4bbcb41f" (UID: "61125582-1358-45ca-b0fb-466f4bbcb41f"). InnerVolumeSpecName "kube-api-access-8ftlf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:06:30.087692 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.087676 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "61125582-1358-45ca-b0fb-466f4bbcb41f" (UID: "61125582-1358-45ca-b0fb-466f4bbcb41f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 20:06:30.187006 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.186968 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61125582-1358-45ca-b0fb-466f4bbcb41f-istiod-ca-cert\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:30.187006 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.186999 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-envoy\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:30.187006 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.187007 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-podinfo\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:30.187006 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.187016 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ftlf\" (UniqueName: \"kubernetes.io/projected/61125582-1358-45ca-b0fb-466f4bbcb41f-kube-api-access-8ftlf\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:30.187270 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.187025 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61125582-1358-45ca-b0fb-466f4bbcb41f-istio-token\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:06:30.760707 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.760664 2575 generic.go:356] "Generic (PLEG): container finished" podID="61125582-1358-45ca-b0fb-466f4bbcb41f" containerID="00fa4d08d8d2a6d9506038a5fc4bffd2992624a5f851171758dea5bc950cd8f1" exitCode=0 Jul 16 20:06:30.760904 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.760724 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" Jul 16 20:06:30.760904 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.760746 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" event={"ID":"61125582-1358-45ca-b0fb-466f4bbcb41f","Type":"ContainerDied","Data":"00fa4d08d8d2a6d9506038a5fc4bffd2992624a5f851171758dea5bc950cd8f1"} Jul 16 20:06:30.760904 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.760858 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q" event={"ID":"61125582-1358-45ca-b0fb-466f4bbcb41f","Type":"ContainerDied","Data":"f13fa1f324090dd15cc022bd221ee2503da152220380491e1a1676291cae12f4"} Jul 16 20:06:30.760904 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.760888 2575 scope.go:117] "RemoveContainer" containerID="00fa4d08d8d2a6d9506038a5fc4bffd2992624a5f851171758dea5bc950cd8f1" Jul 16 20:06:30.770095 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.770069 2575 scope.go:117] "RemoveContainer" containerID="00fa4d08d8d2a6d9506038a5fc4bffd2992624a5f851171758dea5bc950cd8f1" Jul 16 20:06:30.770399 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:06:30.770381 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00fa4d08d8d2a6d9506038a5fc4bffd2992624a5f851171758dea5bc950cd8f1\": container with ID starting with 00fa4d08d8d2a6d9506038a5fc4bffd2992624a5f851171758dea5bc950cd8f1 not found: ID does not exist" containerID="00fa4d08d8d2a6d9506038a5fc4bffd2992624a5f851171758dea5bc950cd8f1" Jul 16 20:06:30.770457 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.770408 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00fa4d08d8d2a6d9506038a5fc4bffd2992624a5f851171758dea5bc950cd8f1"} err="failed to get container status \"00fa4d08d8d2a6d9506038a5fc4bffd2992624a5f851171758dea5bc950cd8f1\": rpc error: code = NotFound desc = could not find container \"00fa4d08d8d2a6d9506038a5fc4bffd2992624a5f851171758dea5bc950cd8f1\": container with ID starting with 00fa4d08d8d2a6d9506038a5fc4bffd2992624a5f851171758dea5bc950cd8f1 not found: ID does not exist" Jul 16 20:06:30.783198 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.783169 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q"] Jul 16 20:06:30.786845 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:30.786819 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-h6g6q"] Jul 16 20:06:32.017759 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:32.017726 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61125582-1358-45ca-b0fb-466f4bbcb41f" path="/var/lib/kubelet/pods/61125582-1358-45ca-b0fb-466f4bbcb41f/volumes" Jul 16 20:06:56.747469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:56.747433 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-x8586" Jul 16 20:06:59.894607 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:59.894566 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:06:59.994182 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:06:59.994144 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:00.099520 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:00.099486 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:00.645634 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:00.645602 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:00.746558 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:00.746525 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:08.603855 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.603812 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:08.706292 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.706247 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:08.715185 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.715156 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h7dl2"] Jul 16 20:07:08.715489 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.715475 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" containerName="discovery" Jul 16 20:07:08.715533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.715490 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" containerName="discovery" Jul 16 20:07:08.715533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.715501 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61125582-1358-45ca-b0fb-466f4bbcb41f" containerName="istio-proxy" Jul 16 20:07:08.715533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.715507 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="61125582-1358-45ca-b0fb-466f4bbcb41f" containerName="istio-proxy" Jul 16 20:07:08.715631 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.715568 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="61125582-1358-45ca-b0fb-466f4bbcb41f" containerName="istio-proxy" Jul 16 20:07:08.715631 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.715575 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0f501a2-70f7-4b4f-8eb0-67f2bd627ea6" containerName="discovery" Jul 16 20:07:08.721864 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.721838 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h7dl2" Jul 16 20:07:08.728825 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.728546 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 20:07:08.729181 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.729158 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 20:07:08.729860 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.729805 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-tm42q\"" Jul 16 20:07:08.734912 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.734880 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h7dl2"] Jul 16 20:07:08.799306 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.799274 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k464d\" (UniqueName: \"kubernetes.io/projected/cba90fd7-8fd1-4bb8-9838-d951eb1d664b-kube-api-access-k464d\") pod \"kuadrant-operator-catalog-h7dl2\" (UID: \"cba90fd7-8fd1-4bb8-9838-d951eb1d664b\") " pod="kuadrant-system/kuadrant-operator-catalog-h7dl2" Jul 16 20:07:08.807175 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.807143 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:08.900442 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.900349 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k464d\" (UniqueName: \"kubernetes.io/projected/cba90fd7-8fd1-4bb8-9838-d951eb1d664b-kube-api-access-k464d\") pod \"kuadrant-operator-catalog-h7dl2\" (UID: \"cba90fd7-8fd1-4bb8-9838-d951eb1d664b\") " pod="kuadrant-system/kuadrant-operator-catalog-h7dl2" Jul 16 20:07:08.909709 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:08.909676 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k464d\" (UniqueName: \"kubernetes.io/projected/cba90fd7-8fd1-4bb8-9838-d951eb1d664b-kube-api-access-k464d\") pod \"kuadrant-operator-catalog-h7dl2\" (UID: \"cba90fd7-8fd1-4bb8-9838-d951eb1d664b\") " pod="kuadrant-system/kuadrant-operator-catalog-h7dl2" Jul 16 20:07:09.032044 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.031991 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h7dl2" Jul 16 20:07:09.059553 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.059522 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h7dl2"] Jul 16 20:07:09.191373 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.191333 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h7dl2"] Jul 16 20:07:09.194036 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:07:09.194007 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba90fd7_8fd1_4bb8_9838_d951eb1d664b.slice/crio-a3b1ec1d894c123b957734102113b26a124105297bd6d400ed5cf3354508a072 WatchSource:0}: Error finding container a3b1ec1d894c123b957734102113b26a124105297bd6d400ed5cf3354508a072: Status 404 returned error can't find the container with id a3b1ec1d894c123b957734102113b26a124105297bd6d400ed5cf3354508a072 Jul 16 20:07:09.270204 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.270167 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-csmgc"] Jul 16 20:07:09.275521 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.275501 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-csmgc" Jul 16 20:07:09.281557 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.281532 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-csmgc"] Jul 16 20:07:09.303569 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.303535 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6ksx\" (UniqueName: \"kubernetes.io/projected/e5370d87-12f5-497d-825e-8d781efde152-kube-api-access-m6ksx\") pod \"kuadrant-operator-catalog-csmgc\" (UID: \"e5370d87-12f5-497d-825e-8d781efde152\") " pod="kuadrant-system/kuadrant-operator-catalog-csmgc" Jul 16 20:07:09.404915 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.404868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6ksx\" (UniqueName: \"kubernetes.io/projected/e5370d87-12f5-497d-825e-8d781efde152-kube-api-access-m6ksx\") pod \"kuadrant-operator-catalog-csmgc\" (UID: \"e5370d87-12f5-497d-825e-8d781efde152\") " pod="kuadrant-system/kuadrant-operator-catalog-csmgc" Jul 16 20:07:09.414374 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.414340 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6ksx\" (UniqueName: \"kubernetes.io/projected/e5370d87-12f5-497d-825e-8d781efde152-kube-api-access-m6ksx\") pod \"kuadrant-operator-catalog-csmgc\" (UID: \"e5370d87-12f5-497d-825e-8d781efde152\") " pod="kuadrant-system/kuadrant-operator-catalog-csmgc" Jul 16 20:07:09.508601 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.508516 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:09.586147 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.586106 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-csmgc" Jul 16 20:07:09.737782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.737624 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-csmgc"] Jul 16 20:07:09.738540 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.738510 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:09.740475 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:07:09.740455 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5370d87_12f5_497d_825e_8d781efde152.slice/crio-d8a51694b2365503d9b9ff4ba9eeb5544c813db30f222f1e78238ddd12fa0cdb WatchSource:0}: Error finding container d8a51694b2365503d9b9ff4ba9eeb5544c813db30f222f1e78238ddd12fa0cdb: Status 404 returned error can't find the container with id d8a51694b2365503d9b9ff4ba9eeb5544c813db30f222f1e78238ddd12fa0cdb Jul 16 20:07:09.943663 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.943624 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-csmgc" event={"ID":"e5370d87-12f5-497d-825e-8d781efde152","Type":"ContainerStarted","Data":"d8a51694b2365503d9b9ff4ba9eeb5544c813db30f222f1e78238ddd12fa0cdb"} Jul 16 20:07:09.944870 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:09.944839 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h7dl2" event={"ID":"cba90fd7-8fd1-4bb8-9838-d951eb1d664b","Type":"ContainerStarted","Data":"a3b1ec1d894c123b957734102113b26a124105297bd6d400ed5cf3354508a072"} Jul 16 20:07:10.404873 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:10.404812 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:10.509949 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:10.509907 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:10.636569 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:10.636516 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:11.957434 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:11.957392 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-csmgc" event={"ID":"e5370d87-12f5-497d-825e-8d781efde152","Type":"ContainerStarted","Data":"1461f63d2517b5bf4bda683348993a62cbd18acb2d1972a6c41778665a6cc6c1"} Jul 16 20:07:11.959322 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:11.959273 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h7dl2" event={"ID":"cba90fd7-8fd1-4bb8-9838-d951eb1d664b","Type":"ContainerStarted","Data":"fe0af207feb1227b682c3b711aeabefba3412ac574ad6587cd7a2b07dc18071a"} Jul 16 20:07:11.959471 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:11.959391 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-h7dl2" podUID="cba90fd7-8fd1-4bb8-9838-d951eb1d664b" containerName="registry-server" containerID="cri-o://fe0af207feb1227b682c3b711aeabefba3412ac574ad6587cd7a2b07dc18071a" gracePeriod=2 Jul 16 20:07:11.974238 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:11.974194 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-csmgc" podStartSLOduration=0.84849983 podStartE2EDuration="2.97417651s" totalImagesPullingTime="2.12567668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:07:11.973813692 +0000 UTC m=+428.437166723" watchObservedRunningTime="2026-07-16 20:07:11.97417651 +0000 UTC m=+428.437529542" Jul 16 20:07:11.995796 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:11.995727 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-h7dl2" podStartSLOduration=1.319772932 podStartE2EDuration="3.995712692s" totalImagesPullingTime="2.67593976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:07:11.994205414 +0000 UTC m=+428.457558444" watchObservedRunningTime="2026-07-16 20:07:11.995712692 +0000 UTC m=+428.459065723" Jul 16 20:07:12.201262 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.201238 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-h7dl2_cba90fd7-8fd1-4bb8-9838-d951eb1d664b/registry-server/0.log" Jul 16 20:07:12.203246 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.203230 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h7dl2" Jul 16 20:07:12.230386 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.230351 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k464d\" (UniqueName: \"kubernetes.io/projected/cba90fd7-8fd1-4bb8-9838-d951eb1d664b-kube-api-access-k464d\") pod \"cba90fd7-8fd1-4bb8-9838-d951eb1d664b\" (UID: \"cba90fd7-8fd1-4bb8-9838-d951eb1d664b\") " Jul 16 20:07:12.232739 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.232705 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cba90fd7-8fd1-4bb8-9838-d951eb1d664b-kube-api-access-k464d" (OuterVolumeSpecName: "kube-api-access-k464d") pod "cba90fd7-8fd1-4bb8-9838-d951eb1d664b" (UID: "cba90fd7-8fd1-4bb8-9838-d951eb1d664b"). InnerVolumeSpecName "kube-api-access-k464d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:07:12.331054 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.331015 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k464d\" (UniqueName: \"kubernetes.io/projected/cba90fd7-8fd1-4bb8-9838-d951eb1d664b-kube-api-access-k464d\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:07:12.965452 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.965423 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-h7dl2_cba90fd7-8fd1-4bb8-9838-d951eb1d664b/registry-server/0.log" Jul 16 20:07:12.965898 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.965460 2575 generic.go:356] "Generic (PLEG): container finished" podID="cba90fd7-8fd1-4bb8-9838-d951eb1d664b" containerID="fe0af207feb1227b682c3b711aeabefba3412ac574ad6587cd7a2b07dc18071a" exitCode=2 Jul 16 20:07:12.965898 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.965511 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h7dl2" Jul 16 20:07:12.965898 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.965554 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h7dl2" event={"ID":"cba90fd7-8fd1-4bb8-9838-d951eb1d664b","Type":"ContainerDied","Data":"fe0af207feb1227b682c3b711aeabefba3412ac574ad6587cd7a2b07dc18071a"} Jul 16 20:07:12.965898 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.965622 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h7dl2" event={"ID":"cba90fd7-8fd1-4bb8-9838-d951eb1d664b","Type":"ContainerDied","Data":"a3b1ec1d894c123b957734102113b26a124105297bd6d400ed5cf3354508a072"} Jul 16 20:07:12.965898 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.965652 2575 scope.go:117] "RemoveContainer" containerID="fe0af207feb1227b682c3b711aeabefba3412ac574ad6587cd7a2b07dc18071a" Jul 16 20:07:12.974444 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.974427 2575 scope.go:117] "RemoveContainer" containerID="fe0af207feb1227b682c3b711aeabefba3412ac574ad6587cd7a2b07dc18071a" Jul 16 20:07:12.974719 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:07:12.974700 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe0af207feb1227b682c3b711aeabefba3412ac574ad6587cd7a2b07dc18071a\": container with ID starting with fe0af207feb1227b682c3b711aeabefba3412ac574ad6587cd7a2b07dc18071a not found: ID does not exist" containerID="fe0af207feb1227b682c3b711aeabefba3412ac574ad6587cd7a2b07dc18071a" Jul 16 20:07:12.974817 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.974733 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0af207feb1227b682c3b711aeabefba3412ac574ad6587cd7a2b07dc18071a"} err="failed to get container status \"fe0af207feb1227b682c3b711aeabefba3412ac574ad6587cd7a2b07dc18071a\": rpc error: code = NotFound desc = could not find container \"fe0af207feb1227b682c3b711aeabefba3412ac574ad6587cd7a2b07dc18071a\": container with ID starting with fe0af207feb1227b682c3b711aeabefba3412ac574ad6587cd7a2b07dc18071a not found: ID does not exist" Jul 16 20:07:12.986793 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.986746 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h7dl2"] Jul 16 20:07:12.990690 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:12.990664 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h7dl2"] Jul 16 20:07:14.021920 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:14.020274 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cba90fd7-8fd1-4bb8-9838-d951eb1d664b" path="/var/lib/kubelet/pods/cba90fd7-8fd1-4bb8-9838-d951eb1d664b/volumes" Jul 16 20:07:19.587016 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:19.586956 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-csmgc" Jul 16 20:07:19.587016 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:19.587038 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-csmgc" Jul 16 20:07:19.611001 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:19.610968 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-csmgc" Jul 16 20:07:20.022402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:20.022330 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-csmgc" Jul 16 20:07:21.531211 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:21.531167 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:21.634983 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:21.634943 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:30.776080 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:30.775978 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:37.998214 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:37.998178 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:40.109454 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.109411 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:40.210183 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.210142 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:40.634702 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.634667 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rmrj"] Jul 16 20:07:40.635038 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.635025 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cba90fd7-8fd1-4bb8-9838-d951eb1d664b" containerName="registry-server" Jul 16 20:07:40.635083 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.635040 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cba90fd7-8fd1-4bb8-9838-d951eb1d664b" containerName="registry-server" Jul 16 20:07:40.635116 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.635094 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cba90fd7-8fd1-4bb8-9838-d951eb1d664b" containerName="registry-server" Jul 16 20:07:40.640101 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.640083 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rmrj" Jul 16 20:07:40.642998 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.642972 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xphpx\"" Jul 16 20:07:40.644014 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.643999 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 16 20:07:40.662035 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.662009 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rmrj"] Jul 16 20:07:40.775848 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.775805 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-264r6\" (UniqueName: \"kubernetes.io/projected/ee8548e9-c103-47e8-b365-a81b86d899ea-kube-api-access-264r6\") pod \"dns-operator-controller-manager-864dd78c4c-5rmrj\" (UID: \"ee8548e9-c103-47e8-b365-a81b86d899ea\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rmrj" Jul 16 20:07:40.876806 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.876746 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-264r6\" (UniqueName: \"kubernetes.io/projected/ee8548e9-c103-47e8-b365-a81b86d899ea-kube-api-access-264r6\") pod \"dns-operator-controller-manager-864dd78c4c-5rmrj\" (UID: \"ee8548e9-c103-47e8-b365-a81b86d899ea\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rmrj" Jul 16 20:07:40.888647 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.888580 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-264r6\" (UniqueName: \"kubernetes.io/projected/ee8548e9-c103-47e8-b365-a81b86d899ea-kube-api-access-264r6\") pod \"dns-operator-controller-manager-864dd78c4c-5rmrj\" (UID: \"ee8548e9-c103-47e8-b365-a81b86d899ea\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rmrj" Jul 16 20:07:40.950539 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:40.950492 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rmrj" Jul 16 20:07:41.098336 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:41.098312 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rmrj"] Jul 16 20:07:41.100672 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:07:41.100642 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee8548e9_c103_47e8_b365_a81b86d899ea.slice/crio-df27e95b7a6c47c1f2653b4022e6259341d96a477563f123fd8c31134e88ce08 WatchSource:0}: Error finding container df27e95b7a6c47c1f2653b4022e6259341d96a477563f123fd8c31134e88ce08: Status 404 returned error can't find the container with id df27e95b7a6c47c1f2653b4022e6259341d96a477563f123fd8c31134e88ce08 Jul 16 20:07:41.394191 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:41.394156 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:42.102278 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:42.102246 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rmrj" event={"ID":"ee8548e9-c103-47e8-b365-a81b86d899ea","Type":"ContainerStarted","Data":"df27e95b7a6c47c1f2653b4022e6259341d96a477563f123fd8c31134e88ce08"} Jul 16 20:07:42.214600 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:42.214564 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:44.113210 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:44.113172 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rmrj" event={"ID":"ee8548e9-c103-47e8-b365-a81b86d899ea","Type":"ContainerStarted","Data":"e48c47553446831bec67fe19a2d67b86f6cfbba075ad5863f6d9e198417d433e"} Jul 16 20:07:44.113643 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:44.113303 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rmrj" Jul 16 20:07:44.137861 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:44.137807 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rmrj" podStartSLOduration=1.690924307 podStartE2EDuration="4.137789777s" totalImagesPullingTime="2.44686547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:07:44.136572458 +0000 UTC m=+460.599925488" watchObservedRunningTime="2026-07-16 20:07:44.137789777 +0000 UTC m=+460.601142807" Jul 16 20:07:44.722575 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:44.722534 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v6dvw"] Jul 16 20:07:44.725943 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:44.725918 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v6dvw" Jul 16 20:07:44.728644 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:44.728624 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4lt6t\"" Jul 16 20:07:44.736799 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:44.736752 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v6dvw"] Jul 16 20:07:44.814558 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:44.814514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzl5z\" (UniqueName: \"kubernetes.io/projected/771f7f08-73ad-4939-9830-559e2576cbe1-kube-api-access-vzl5z\") pod \"authorino-operator-75cc8d5cb7-v6dvw\" (UID: \"771f7f08-73ad-4939-9830-559e2576cbe1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v6dvw" Jul 16 20:07:44.915914 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:44.915877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzl5z\" (UniqueName: \"kubernetes.io/projected/771f7f08-73ad-4939-9830-559e2576cbe1-kube-api-access-vzl5z\") pod \"authorino-operator-75cc8d5cb7-v6dvw\" (UID: \"771f7f08-73ad-4939-9830-559e2576cbe1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v6dvw" Jul 16 20:07:44.928481 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:44.928451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzl5z\" (UniqueName: \"kubernetes.io/projected/771f7f08-73ad-4939-9830-559e2576cbe1-kube-api-access-vzl5z\") pod \"authorino-operator-75cc8d5cb7-v6dvw\" (UID: \"771f7f08-73ad-4939-9830-559e2576cbe1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v6dvw" Jul 16 20:07:45.035517 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:45.035412 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v6dvw" Jul 16 20:07:45.201653 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:45.201631 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v6dvw"] Jul 16 20:07:45.203688 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:07:45.203664 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771f7f08_73ad_4939_9830_559e2576cbe1.slice/crio-0b4cef8b82b875e1120785f66471677b0fef69dc3a3eccdedd9db40a510e569b WatchSource:0}: Error finding container 0b4cef8b82b875e1120785f66471677b0fef69dc3a3eccdedd9db40a510e569b: Status 404 returned error can't find the container with id 0b4cef8b82b875e1120785f66471677b0fef69dc3a3eccdedd9db40a510e569b Jul 16 20:07:45.805480 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:45.805443 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:46.046271 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:46.046174 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:46.127245 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:46.127184 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v6dvw" event={"ID":"771f7f08-73ad-4939-9830-559e2576cbe1","Type":"ContainerStarted","Data":"0b4cef8b82b875e1120785f66471677b0fef69dc3a3eccdedd9db40a510e569b"} Jul 16 20:07:46.144490 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:46.144453 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:48.063078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.063041 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs"] Jul 16 20:07:48.066392 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.066373 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:07:48.070179 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.070154 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7f8dn\"" Jul 16 20:07:48.079667 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.079626 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs"] Jul 16 20:07:48.087162 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.087127 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:48.138123 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.138084 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v6dvw" event={"ID":"771f7f08-73ad-4939-9830-559e2576cbe1","Type":"ContainerStarted","Data":"28961763dd73833974a98773f9daaaa7ac4628efade15834a5d1c7b0fc1a0f38"} Jul 16 20:07:48.138306 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.138156 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v6dvw" Jul 16 20:07:48.158157 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.158105 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v6dvw" podStartSLOduration=1.841602135 podStartE2EDuration="4.158087952s" totalImagesPullingTime="2.316485817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:07:48.15697767 +0000 UTC m=+464.620330724" watchObservedRunningTime="2026-07-16 20:07:48.158087952 +0000 UTC m=+464.621440983" Jul 16 20:07:48.245915 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.245854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8spq\" (UniqueName: \"kubernetes.io/projected/a7f4a17a-c158-4e41-9bb2-b1292633e10f-kube-api-access-c8spq\") pod \"limitador-operator-controller-manager-859d7b78bd-2lnxs\" (UID: \"a7f4a17a-c158-4e41-9bb2-b1292633e10f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:07:48.346752 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.346701 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8spq\" (UniqueName: \"kubernetes.io/projected/a7f4a17a-c158-4e41-9bb2-b1292633e10f-kube-api-access-c8spq\") pod \"limitador-operator-controller-manager-859d7b78bd-2lnxs\" (UID: \"a7f4a17a-c158-4e41-9bb2-b1292633e10f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:07:48.359173 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.359134 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8spq\" (UniqueName: \"kubernetes.io/projected/a7f4a17a-c158-4e41-9bb2-b1292633e10f-kube-api-access-c8spq\") pod \"limitador-operator-controller-manager-859d7b78bd-2lnxs\" (UID: \"a7f4a17a-c158-4e41-9bb2-b1292633e10f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:07:48.378127 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.378085 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:07:48.525202 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.525137 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs"] Jul 16 20:07:48.527922 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:07:48.527891 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f4a17a_c158_4e41_9bb2_b1292633e10f.slice/crio-4521567d6faa498df1dbaa5cab8a0d57135ed16495fdfb150cfa9b6b3d186f01 WatchSource:0}: Error finding container 4521567d6faa498df1dbaa5cab8a0d57135ed16495fdfb150cfa9b6b3d186f01: Status 404 returned error can't find the container with id 4521567d6faa498df1dbaa5cab8a0d57135ed16495fdfb150cfa9b6b3d186f01 Jul 16 20:07:48.617337 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:48.617231 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:49.065577 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:49.065482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:49.144896 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:49.144846 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" event={"ID":"a7f4a17a-c158-4e41-9bb2-b1292633e10f","Type":"ContainerStarted","Data":"4521567d6faa498df1dbaa5cab8a0d57135ed16495fdfb150cfa9b6b3d186f01"} Jul 16 20:07:51.038321 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:51.038283 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:51.156714 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:51.156676 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" event={"ID":"a7f4a17a-c158-4e41-9bb2-b1292633e10f","Type":"ContainerStarted","Data":"ed5665e8cb515d1db2f799e37294293edf3e3b31dc40ca72ebe604825e5e3832"} Jul 16 20:07:51.156917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:51.156808 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:07:51.175040 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:51.174979 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" podStartSLOduration=1.141857599 podStartE2EDuration="3.174963671s" totalImagesPullingTime="2.033106072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:07:51.174124989 +0000 UTC m=+467.637478034" watchObservedRunningTime="2026-07-16 20:07:51.174963671 +0000 UTC m=+467.638316702" Jul 16 20:07:52.690460 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:52.690427 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm"] Jul 16 20:07:52.693936 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:52.693917 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:07:52.696645 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:52.696621 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-42wrl\"" Jul 16 20:07:52.709083 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:52.709047 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm"] Jul 16 20:07:52.886592 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:52.886554 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzq5b\" (UniqueName: \"kubernetes.io/projected/eece699f-f69e-409d-a124-bd48ff2f8e90-kube-api-access-bzq5b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" (UID: \"eece699f-f69e-409d-a124-bd48ff2f8e90\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:07:52.886824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:52.886605 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eece699f-f69e-409d-a124-bd48ff2f8e90-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" (UID: \"eece699f-f69e-409d-a124-bd48ff2f8e90\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:07:52.987408 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:52.987310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzq5b\" (UniqueName: \"kubernetes.io/projected/eece699f-f69e-409d-a124-bd48ff2f8e90-kube-api-access-bzq5b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" (UID: \"eece699f-f69e-409d-a124-bd48ff2f8e90\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:07:52.987408 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:52.987371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eece699f-f69e-409d-a124-bd48ff2f8e90-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" (UID: \"eece699f-f69e-409d-a124-bd48ff2f8e90\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:07:52.987915 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:52.987896 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eece699f-f69e-409d-a124-bd48ff2f8e90-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" (UID: \"eece699f-f69e-409d-a124-bd48ff2f8e90\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:07:52.997259 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:52.997231 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzq5b\" (UniqueName: \"kubernetes.io/projected/eece699f-f69e-409d-a124-bd48ff2f8e90-kube-api-access-bzq5b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" (UID: \"eece699f-f69e-409d-a124-bd48ff2f8e90\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:07:53.004107 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:53.004076 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:07:53.141958 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:53.141934 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm"] Jul 16 20:07:53.144747 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:07:53.144714 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeece699f_f69e_409d_a124_bd48ff2f8e90.slice/crio-e000999f1c9e5ed3a89fc5519d3f9f112e224f07f38e5c639ae43a60723719c1 WatchSource:0}: Error finding container e000999f1c9e5ed3a89fc5519d3f9f112e224f07f38e5c639ae43a60723719c1: Status 404 returned error can't find the container with id e000999f1c9e5ed3a89fc5519d3f9f112e224f07f38e5c639ae43a60723719c1 Jul 16 20:07:53.172564 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:53.172531 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" event={"ID":"eece699f-f69e-409d-a124-bd48ff2f8e90","Type":"ContainerStarted","Data":"e000999f1c9e5ed3a89fc5519d3f9f112e224f07f38e5c639ae43a60723719c1"} Jul 16 20:07:54.020364 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:54.020326 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:54.112307 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:54.112274 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:55.120201 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:55.120168 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5rmrj" Jul 16 20:07:59.147906 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:59.147865 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v6dvw" Jul 16 20:07:59.421651 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:59.421552 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:59.519405 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:59.519367 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:59.868588 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:59.868550 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:07:59.968896 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:07:59.968852 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:01.217131 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:01.217094 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" event={"ID":"eece699f-f69e-409d-a124-bd48ff2f8e90","Type":"ContainerStarted","Data":"0f3b179628aba7fa50a5e5a12f129811f9cff1a05ded56846cec31c681605b6b"} Jul 16 20:08:01.217578 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:01.217216 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:08:01.239110 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:01.239056 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" podStartSLOduration=2.069371861 podStartE2EDuration="9.23903797s" totalImagesPullingTime="7.169666109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:08:01.238532223 +0000 UTC m=+477.701885266" watchObservedRunningTime="2026-07-16 20:08:01.23903797 +0000 UTC m=+477.702391002" Jul 16 20:08:02.169254 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:02.169230 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:08:03.066200 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.066168 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j"] Jul 16 20:08:03.069815 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.069791 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" Jul 16 20:08:03.072756 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.072728 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 16 20:08:03.072896 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.072785 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 16 20:08:03.072967 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.072899 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-slrcx\"" Jul 16 20:08:03.093045 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.093012 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j"] Jul 16 20:08:03.165717 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.165679 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/15664b72-39d4-4f0b-a17b-6e3e6eca8a22-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x8h2j\" (UID: \"15664b72-39d4-4f0b-a17b-6e3e6eca8a22\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" Jul 16 20:08:03.165931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.165724 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkxr6\" (UniqueName: \"kubernetes.io/projected/15664b72-39d4-4f0b-a17b-6e3e6eca8a22-kube-api-access-lkxr6\") pod \"kuadrant-console-plugin-66b5774985-x8h2j\" (UID: \"15664b72-39d4-4f0b-a17b-6e3e6eca8a22\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" Jul 16 20:08:03.165931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.165760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/15664b72-39d4-4f0b-a17b-6e3e6eca8a22-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8h2j\" (UID: \"15664b72-39d4-4f0b-a17b-6e3e6eca8a22\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" Jul 16 20:08:03.267039 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.266995 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkxr6\" (UniqueName: \"kubernetes.io/projected/15664b72-39d4-4f0b-a17b-6e3e6eca8a22-kube-api-access-lkxr6\") pod \"kuadrant-console-plugin-66b5774985-x8h2j\" (UID: \"15664b72-39d4-4f0b-a17b-6e3e6eca8a22\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" Jul 16 20:08:03.267221 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.267057 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/15664b72-39d4-4f0b-a17b-6e3e6eca8a22-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8h2j\" (UID: \"15664b72-39d4-4f0b-a17b-6e3e6eca8a22\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" Jul 16 20:08:03.267221 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.267114 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/15664b72-39d4-4f0b-a17b-6e3e6eca8a22-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x8h2j\" (UID: \"15664b72-39d4-4f0b-a17b-6e3e6eca8a22\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" Jul 16 20:08:03.268842 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.268293 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/15664b72-39d4-4f0b-a17b-6e3e6eca8a22-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x8h2j\" (UID: \"15664b72-39d4-4f0b-a17b-6e3e6eca8a22\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" Jul 16 20:08:03.274017 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.270841 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/15664b72-39d4-4f0b-a17b-6e3e6eca8a22-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8h2j\" (UID: \"15664b72-39d4-4f0b-a17b-6e3e6eca8a22\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" Jul 16 20:08:03.276653 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.276618 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkxr6\" (UniqueName: \"kubernetes.io/projected/15664b72-39d4-4f0b-a17b-6e3e6eca8a22-kube-api-access-lkxr6\") pod \"kuadrant-console-plugin-66b5774985-x8h2j\" (UID: \"15664b72-39d4-4f0b-a17b-6e3e6eca8a22\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" Jul 16 20:08:03.379075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.379032 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" Jul 16 20:08:03.533025 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:03.532999 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j"] Jul 16 20:08:03.534496 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:08:03.534469 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15664b72_39d4_4f0b_a17b_6e3e6eca8a22.slice/crio-ae1e2c25480ddce6e149d030c8c87cbcce31461287ac72a16083e26162192ca7 WatchSource:0}: Error finding container ae1e2c25480ddce6e149d030c8c87cbcce31461287ac72a16083e26162192ca7: Status 404 returned error can't find the container with id ae1e2c25480ddce6e149d030c8c87cbcce31461287ac72a16083e26162192ca7 Jul 16 20:08:04.134756 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:04.134718 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:04.233658 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:04.233565 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" event={"ID":"15664b72-39d4-4f0b-a17b-6e3e6eca8a22","Type":"ContainerStarted","Data":"ae1e2c25480ddce6e149d030c8c87cbcce31461287ac72a16083e26162192ca7"} Jul 16 20:08:04.250549 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:04.250500 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:05.854175 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:05.854140 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:05.955248 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:05.955200 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:12.225426 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:12.225392 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:08:13.408792 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.408674 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:13.502664 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.502605 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:13.945248 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.945210 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm"] Jul 16 20:08:13.945525 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.945484 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" podUID="eece699f-f69e-409d-a124-bd48ff2f8e90" containerName="manager" containerID="cri-o://0f3b179628aba7fa50a5e5a12f129811f9cff1a05ded56846cec31c681605b6b" gracePeriod=2 Jul 16 20:08:13.948121 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:13.948049 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" is forbidden: User \"system:node:ip-10-0-134-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-169.ec2.internal' and this object" podUID="eece699f-f69e-409d-a124-bd48ff2f8e90" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:08:13.951053 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.950985 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm"] Jul 16 20:08:13.962070 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.962040 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs"] Jul 16 20:08:13.962325 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.962284 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" podUID="a7f4a17a-c158-4e41-9bb2-b1292633e10f" containerName="manager" containerID="cri-o://ed5665e8cb515d1db2f799e37294293edf3e3b31dc40ca72ebe604825e5e3832" gracePeriod=2 Jul 16 20:08:13.965334 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:13.965287 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" is forbidden: User \"system:node:ip-10-0-134-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-169.ec2.internal' and this object" podUID="eece699f-f69e-409d-a124-bd48ff2f8e90" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:08:13.971700 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.971674 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs"] Jul 16 20:08:13.982643 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.982506 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n"] Jul 16 20:08:13.983027 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.983002 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7f4a17a-c158-4e41-9bb2-b1292633e10f" containerName="manager" Jul 16 20:08:13.983027 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.983026 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7f4a17a-c158-4e41-9bb2-b1292633e10f" containerName="manager" Jul 16 20:08:13.983214 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.983039 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eece699f-f69e-409d-a124-bd48ff2f8e90" containerName="manager" Jul 16 20:08:13.983214 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.983047 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eece699f-f69e-409d-a124-bd48ff2f8e90" containerName="manager" Jul 16 20:08:13.983214 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.983149 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7f4a17a-c158-4e41-9bb2-b1292633e10f" containerName="manager" Jul 16 20:08:13.983214 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.983160 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="eece699f-f69e-409d-a124-bd48ff2f8e90" containerName="manager" Jul 16 20:08:13.989578 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.989545 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" Jul 16 20:08:13.993729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.993480 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xg5tl"] Jul 16 20:08:13.998782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:13.998743 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xg5tl" Jul 16 20:08:14.003196 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.003164 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n"] Jul 16 20:08:14.021754 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.021723 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xg5tl"] Jul 16 20:08:14.027785 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:14.027720 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" is forbidden: User \"system:node:ip-10-0-134-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-169.ec2.internal' and this object" podUID="eece699f-f69e-409d-a124-bd48ff2f8e90" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:08:14.029867 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:14.029833 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2lnxs\" is forbidden: User \"system:node:ip-10-0-134-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-169.ec2.internal' and this object" podUID="a7f4a17a-c158-4e41-9bb2-b1292633e10f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:08:14.069217 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.069188 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed1a2097-cd1b-48e0-8984-1a9e2aff42ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7b44n\" (UID: \"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" Jul 16 20:08:14.069349 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.069235 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqnxp\" (UniqueName: \"kubernetes.io/projected/ed1a2097-cd1b-48e0-8984-1a9e2aff42ad-kube-api-access-vqnxp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7b44n\" (UID: \"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" Jul 16 20:08:14.069406 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.069351 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrnbq\" (UniqueName: \"kubernetes.io/projected/873fe72e-97f1-4ec8-9c68-78dde3c1acf7-kube-api-access-nrnbq\") pod \"limitador-operator-controller-manager-859d7b78bd-xg5tl\" (UID: \"873fe72e-97f1-4ec8-9c68-78dde3c1acf7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xg5tl" Jul 16 20:08:14.170598 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.170561 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed1a2097-cd1b-48e0-8984-1a9e2aff42ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7b44n\" (UID: \"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" Jul 16 20:08:14.170598 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.170607 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqnxp\" (UniqueName: \"kubernetes.io/projected/ed1a2097-cd1b-48e0-8984-1a9e2aff42ad-kube-api-access-vqnxp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7b44n\" (UID: \"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" Jul 16 20:08:14.170857 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.170650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrnbq\" (UniqueName: \"kubernetes.io/projected/873fe72e-97f1-4ec8-9c68-78dde3c1acf7-kube-api-access-nrnbq\") pod \"limitador-operator-controller-manager-859d7b78bd-xg5tl\" (UID: \"873fe72e-97f1-4ec8-9c68-78dde3c1acf7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xg5tl" Jul 16 20:08:14.171046 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.171024 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed1a2097-cd1b-48e0-8984-1a9e2aff42ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7b44n\" (UID: \"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" Jul 16 20:08:14.180367 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.180336 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqnxp\" (UniqueName: \"kubernetes.io/projected/ed1a2097-cd1b-48e0-8984-1a9e2aff42ad-kube-api-access-vqnxp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7b44n\" (UID: \"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" Jul 16 20:08:14.180509 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.180336 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrnbq\" (UniqueName: \"kubernetes.io/projected/873fe72e-97f1-4ec8-9c68-78dde3c1acf7-kube-api-access-nrnbq\") pod \"limitador-operator-controller-manager-859d7b78bd-xg5tl\" (UID: \"873fe72e-97f1-4ec8-9c68-78dde3c1acf7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xg5tl" Jul 16 20:08:14.373007 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.372964 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" Jul 16 20:08:14.380261 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.380238 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xg5tl" Jul 16 20:08:14.468499 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.468465 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2"] Jul 16 20:08:14.473890 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.473858 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" Jul 16 20:08:14.490871 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.490820 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2"] Jul 16 20:08:14.574726 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.574680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2ctp\" (UniqueName: \"kubernetes.io/projected/a1b8438a-93e7-4b29-a699-fdb30d06ce00-kube-api-access-s2ctp\") pod \"kuadrant-operator-controller-manager-86878c769f-2nwt2\" (UID: \"a1b8438a-93e7-4b29-a699-fdb30d06ce00\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" Jul 16 20:08:14.574958 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.574746 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1b8438a-93e7-4b29-a699-fdb30d06ce00-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2nwt2\" (UID: \"a1b8438a-93e7-4b29-a699-fdb30d06ce00\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" Jul 16 20:08:14.676249 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.676156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2ctp\" (UniqueName: \"kubernetes.io/projected/a1b8438a-93e7-4b29-a699-fdb30d06ce00-kube-api-access-s2ctp\") pod \"kuadrant-operator-controller-manager-86878c769f-2nwt2\" (UID: \"a1b8438a-93e7-4b29-a699-fdb30d06ce00\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" Jul 16 20:08:14.676249 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.676223 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1b8438a-93e7-4b29-a699-fdb30d06ce00-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2nwt2\" (UID: \"a1b8438a-93e7-4b29-a699-fdb30d06ce00\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" Jul 16 20:08:14.676615 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.676596 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1b8438a-93e7-4b29-a699-fdb30d06ce00-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2nwt2\" (UID: \"a1b8438a-93e7-4b29-a699-fdb30d06ce00\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" Jul 16 20:08:14.691835 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.691797 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2ctp\" (UniqueName: \"kubernetes.io/projected/a1b8438a-93e7-4b29-a699-fdb30d06ce00-kube-api-access-s2ctp\") pod \"kuadrant-operator-controller-manager-86878c769f-2nwt2\" (UID: \"a1b8438a-93e7-4b29-a699-fdb30d06ce00\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" Jul 16 20:08:14.789497 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:14.789453 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" Jul 16 20:08:16.634170 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:16.634115 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:16.733587 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:16.733540 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:17.845996 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:17.845953 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:17.946834 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:17.946796 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:18.458462 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:18.458422 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:18.564237 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:18.564198 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:21.834339 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:21.834241 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:21.931788 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:21.931739 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:25.439028 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:25.438982 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:25.500580 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:25.500531 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:26.964630 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:26.964602 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:08:26.967449 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:26.967402 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" is forbidden: User \"system:node:ip-10-0-134-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-169.ec2.internal' and this object" podUID="eece699f-f69e-409d-a124-bd48ff2f8e90" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:08:26.969624 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:26.969598 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n"] Jul 16 20:08:26.973866 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:08:26.973831 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded1a2097_cd1b_48e0_8984_1a9e2aff42ad.slice/crio-b7ce5b7b916f203e5e977193881f66ff6cc209bd8c928d3c3fcaef5cb4d6c33d WatchSource:0}: Error finding container b7ce5b7b916f203e5e977193881f66ff6cc209bd8c928d3c3fcaef5cb4d6c33d: Status 404 returned error can't find the container with id b7ce5b7b916f203e5e977193881f66ff6cc209bd8c928d3c3fcaef5cb4d6c33d Jul 16 20:08:26.996710 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:26.996684 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:08:26.998977 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:26.998946 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" is forbidden: User \"system:node:ip-10-0-134-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-169.ec2.internal' and this object" podUID="eece699f-f69e-409d-a124-bd48ff2f8e90" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:08:27.000836 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:27.000810 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2lnxs\" is forbidden: User \"system:node:ip-10-0-134-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-169.ec2.internal' and this object" podUID="a7f4a17a-c158-4e41-9bb2-b1292633e10f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:08:27.091535 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.091501 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8spq\" (UniqueName: \"kubernetes.io/projected/a7f4a17a-c158-4e41-9bb2-b1292633e10f-kube-api-access-c8spq\") pod \"a7f4a17a-c158-4e41-9bb2-b1292633e10f\" (UID: \"a7f4a17a-c158-4e41-9bb2-b1292633e10f\") " Jul 16 20:08:27.091535 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.091542 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eece699f-f69e-409d-a124-bd48ff2f8e90-extensions-socket-volume\") pod \"eece699f-f69e-409d-a124-bd48ff2f8e90\" (UID: \"eece699f-f69e-409d-a124-bd48ff2f8e90\") " Jul 16 20:08:27.091753 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.091588 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzq5b\" (UniqueName: \"kubernetes.io/projected/eece699f-f69e-409d-a124-bd48ff2f8e90-kube-api-access-bzq5b\") pod \"eece699f-f69e-409d-a124-bd48ff2f8e90\" (UID: \"eece699f-f69e-409d-a124-bd48ff2f8e90\") " Jul 16 20:08:27.092084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.092049 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eece699f-f69e-409d-a124-bd48ff2f8e90-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eece699f-f69e-409d-a124-bd48ff2f8e90" (UID: "eece699f-f69e-409d-a124-bd48ff2f8e90"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:08:27.093743 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.093722 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7f4a17a-c158-4e41-9bb2-b1292633e10f-kube-api-access-c8spq" (OuterVolumeSpecName: "kube-api-access-c8spq") pod "a7f4a17a-c158-4e41-9bb2-b1292633e10f" (UID: "a7f4a17a-c158-4e41-9bb2-b1292633e10f"). InnerVolumeSpecName "kube-api-access-c8spq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:08:27.093743 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.093728 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eece699f-f69e-409d-a124-bd48ff2f8e90-kube-api-access-bzq5b" (OuterVolumeSpecName: "kube-api-access-bzq5b") pod "eece699f-f69e-409d-a124-bd48ff2f8e90" (UID: "eece699f-f69e-409d-a124-bd48ff2f8e90"). InnerVolumeSpecName "kube-api-access-bzq5b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:08:27.192948 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.192914 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8spq\" (UniqueName: \"kubernetes.io/projected/a7f4a17a-c158-4e41-9bb2-b1292633e10f-kube-api-access-c8spq\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:08:27.192948 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.192945 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eece699f-f69e-409d-a124-bd48ff2f8e90-extensions-socket-volume\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:08:27.192948 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.192954 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzq5b\" (UniqueName: \"kubernetes.io/projected/eece699f-f69e-409d-a124-bd48ff2f8e90-kube-api-access-bzq5b\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:08:27.196974 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.196945 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xg5tl"] Jul 16 20:08:27.199043 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.199018 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2"] Jul 16 20:08:27.200254 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:08:27.200215 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873fe72e_97f1_4ec8_9c68_78dde3c1acf7.slice/crio-ce2c7aeaa5aa1c17363a22e1cd735a507c9d03a520b72eb6fdf11135034f0549 WatchSource:0}: Error finding container ce2c7aeaa5aa1c17363a22e1cd735a507c9d03a520b72eb6fdf11135034f0549: Status 404 returned error can't find the container with id ce2c7aeaa5aa1c17363a22e1cd735a507c9d03a520b72eb6fdf11135034f0549 Jul 16 20:08:27.201195 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:08:27.201169 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b8438a_93e7_4b29_a699_fdb30d06ce00.slice/crio-e1d17a99991044213bff11645af862d779b7a8f07630ca1a9c73ede62e5ce058 WatchSource:0}: Error finding container e1d17a99991044213bff11645af862d779b7a8f07630ca1a9c73ede62e5ce058: Status 404 returned error can't find the container with id e1d17a99991044213bff11645af862d779b7a8f07630ca1a9c73ede62e5ce058 Jul 16 20:08:27.362045 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.362009 2575 generic.go:356] "Generic (PLEG): container finished" podID="a7f4a17a-c158-4e41-9bb2-b1292633e10f" containerID="ed5665e8cb515d1db2f799e37294293edf3e3b31dc40ca72ebe604825e5e3832" exitCode=0 Jul 16 20:08:27.362257 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.362053 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:08:27.362257 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.362108 2575 scope.go:117] "RemoveContainer" containerID="ed5665e8cb515d1db2f799e37294293edf3e3b31dc40ca72ebe604825e5e3832" Jul 16 20:08:27.363890 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.363817 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" event={"ID":"a1b8438a-93e7-4b29-a699-fdb30d06ce00","Type":"ContainerStarted","Data":"e29415f77978090a944a35546fd3ab00a9f5344d8077d9c53a941315b0b7d9c3"} Jul 16 20:08:27.363890 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.363876 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" event={"ID":"a1b8438a-93e7-4b29-a699-fdb30d06ce00","Type":"ContainerStarted","Data":"e1d17a99991044213bff11645af862d779b7a8f07630ca1a9c73ede62e5ce058"} Jul 16 20:08:27.364068 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.363907 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" Jul 16 20:08:27.367551 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:27.366924 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" is forbidden: User \"system:node:ip-10-0-134-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-169.ec2.internal' and this object" podUID="eece699f-f69e-409d-a124-bd48ff2f8e90" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:08:27.369075 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:27.369043 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2lnxs\" is forbidden: User \"system:node:ip-10-0-134-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-169.ec2.internal' and this object" podUID="a7f4a17a-c158-4e41-9bb2-b1292633e10f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:08:27.369420 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.369379 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" event={"ID":"15664b72-39d4-4f0b-a17b-6e3e6eca8a22","Type":"ContainerStarted","Data":"f861c4f5f5e957c14971366ad274a08b40ffafdbb133969e9d7fce9d14cd0928"} Jul 16 20:08:27.371214 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.371192 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xg5tl" event={"ID":"873fe72e-97f1-4ec8-9c68-78dde3c1acf7","Type":"ContainerStarted","Data":"d3b939dc08c2d7b4b4df18a2f604dacef64d9bfb7bbaaf040331333ff37bd2aa"} Jul 16 20:08:27.371310 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.371238 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xg5tl" event={"ID":"873fe72e-97f1-4ec8-9c68-78dde3c1acf7","Type":"ContainerStarted","Data":"ce2c7aeaa5aa1c17363a22e1cd735a507c9d03a520b72eb6fdf11135034f0549"} Jul 16 20:08:27.371310 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.371267 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xg5tl" Jul 16 20:08:27.372629 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.372607 2575 generic.go:356] "Generic (PLEG): container finished" podID="eece699f-f69e-409d-a124-bd48ff2f8e90" containerID="0f3b179628aba7fa50a5e5a12f129811f9cff1a05ded56846cec31c681605b6b" exitCode=0 Jul 16 20:08:27.372718 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.372633 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:08:27.374289 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.374270 2575 scope.go:117] "RemoveContainer" containerID="ed5665e8cb515d1db2f799e37294293edf3e3b31dc40ca72ebe604825e5e3832" Jul 16 20:08:27.374517 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.374499 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" event={"ID":"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad","Type":"ContainerStarted","Data":"192aa55477b8eba4b67d14e2a76a4d289651b6865603ecc02559d3c1403d93e0"} Jul 16 20:08:27.374594 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.374545 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" event={"ID":"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad","Type":"ContainerStarted","Data":"b7ce5b7b916f203e5e977193881f66ff6cc209bd8c928d3c3fcaef5cb4d6c33d"} Jul 16 20:08:27.374594 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:27.374498 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed5665e8cb515d1db2f799e37294293edf3e3b31dc40ca72ebe604825e5e3832\": container with ID starting with ed5665e8cb515d1db2f799e37294293edf3e3b31dc40ca72ebe604825e5e3832 not found: ID does not exist" containerID="ed5665e8cb515d1db2f799e37294293edf3e3b31dc40ca72ebe604825e5e3832" Jul 16 20:08:27.374711 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.374593 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" Jul 16 20:08:27.374711 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.374601 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed5665e8cb515d1db2f799e37294293edf3e3b31dc40ca72ebe604825e5e3832"} err="failed to get container status \"ed5665e8cb515d1db2f799e37294293edf3e3b31dc40ca72ebe604825e5e3832\": rpc error: code = NotFound desc = could not find container \"ed5665e8cb515d1db2f799e37294293edf3e3b31dc40ca72ebe604825e5e3832\": container with ID starting with ed5665e8cb515d1db2f799e37294293edf3e3b31dc40ca72ebe604825e5e3832 not found: ID does not exist" Jul 16 20:08:27.374711 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.374617 2575 scope.go:117] "RemoveContainer" containerID="0f3b179628aba7fa50a5e5a12f129811f9cff1a05ded56846cec31c681605b6b" Jul 16 20:08:27.383565 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.383544 2575 scope.go:117] "RemoveContainer" containerID="0f3b179628aba7fa50a5e5a12f129811f9cff1a05ded56846cec31c681605b6b" Jul 16 20:08:27.383852 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:27.383832 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f3b179628aba7fa50a5e5a12f129811f9cff1a05ded56846cec31c681605b6b\": container with ID starting with 0f3b179628aba7fa50a5e5a12f129811f9cff1a05ded56846cec31c681605b6b not found: ID does not exist" containerID="0f3b179628aba7fa50a5e5a12f129811f9cff1a05ded56846cec31c681605b6b" Jul 16 20:08:27.383903 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.383861 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f3b179628aba7fa50a5e5a12f129811f9cff1a05ded56846cec31c681605b6b"} err="failed to get container status \"0f3b179628aba7fa50a5e5a12f129811f9cff1a05ded56846cec31c681605b6b\": rpc error: code = NotFound desc = could not find container \"0f3b179628aba7fa50a5e5a12f129811f9cff1a05ded56846cec31c681605b6b\": container with ID starting with 0f3b179628aba7fa50a5e5a12f129811f9cff1a05ded56846cec31c681605b6b not found: ID does not exist" Jul 16 20:08:27.386917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.386875 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" podStartSLOduration=13.386859772 podStartE2EDuration="13.386859772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:08:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:08:27.386478179 +0000 UTC m=+503.849831211" watchObservedRunningTime="2026-07-16 20:08:27.386859772 +0000 UTC m=+503.850212803" Jul 16 20:08:27.388929 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:27.388904 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" is forbidden: User \"system:node:ip-10-0-134-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-169.ec2.internal' and this object" podUID="eece699f-f69e-409d-a124-bd48ff2f8e90" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:08:27.390991 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:27.390969 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2lnxs\" is forbidden: User \"system:node:ip-10-0-134-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-169.ec2.internal' and this object" podUID="a7f4a17a-c158-4e41-9bb2-b1292633e10f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:08:27.407192 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.407144 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xg5tl" podStartSLOduration=14.407130395 podStartE2EDuration="14.407130395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:08:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:08:27.406440632 +0000 UTC m=+503.869793662" watchObservedRunningTime="2026-07-16 20:08:27.407130395 +0000 UTC m=+503.870483425" Jul 16 20:08:27.408661 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:27.408633 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8wrwm\" is forbidden: User \"system:node:ip-10-0-134-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-169.ec2.internal' and this object" podUID="eece699f-f69e-409d-a124-bd48ff2f8e90" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8wrwm" Jul 16 20:08:27.410584 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:27.410559 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2lnxs\" is forbidden: User \"system:node:ip-10-0-134-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-169.ec2.internal' and this object" podUID="a7f4a17a-c158-4e41-9bb2-b1292633e10f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2lnxs" Jul 16 20:08:27.429623 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.429555 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8h2j" podStartSLOduration=1.083240174 podStartE2EDuration="24.42953339s" totalImagesPullingTime="23.346293216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:08:27.427967496 +0000 UTC m=+503.891320527" watchObservedRunningTime="2026-07-16 20:08:27.42953339 +0000 UTC m=+503.892886423" Jul 16 20:08:27.448587 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:27.448528 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" podStartSLOduration=14.448510213 podStartE2EDuration="14.448510213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:08:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:08:27.44687482 +0000 UTC m=+503.910227852" watchObservedRunningTime="2026-07-16 20:08:27.448510213 +0000 UTC m=+503.911863244" Jul 16 20:08:28.018842 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:28.018716 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7f4a17a-c158-4e41-9bb2-b1292633e10f" path="/var/lib/kubelet/pods/a7f4a17a-c158-4e41-9bb2-b1292633e10f/volumes" Jul 16 20:08:28.019299 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:28.019261 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eece699f-f69e-409d-a124-bd48ff2f8e90" path="/var/lib/kubelet/pods/eece699f-f69e-409d-a124-bd48ff2f8e90/volumes" Jul 16 20:08:38.389812 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:38.389758 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xg5tl" Jul 16 20:08:38.390430 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:38.389867 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" Jul 16 20:08:38.390430 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:38.389916 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" Jul 16 20:08:38.514163 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:38.514130 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n"] Jul 16 20:08:38.514352 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:38.514330 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" podUID="ed1a2097-cd1b-48e0-8984-1a9e2aff42ad" containerName="manager" containerID="cri-o://192aa55477b8eba4b67d14e2a76a4d289651b6865603ecc02559d3c1403d93e0" gracePeriod=10 Jul 16 20:08:38.769039 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:38.769013 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" Jul 16 20:08:38.894424 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:38.894387 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed1a2097-cd1b-48e0-8984-1a9e2aff42ad-extensions-socket-volume\") pod \"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad\" (UID: \"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad\") " Jul 16 20:08:38.894424 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:38.894432 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqnxp\" (UniqueName: \"kubernetes.io/projected/ed1a2097-cd1b-48e0-8984-1a9e2aff42ad-kube-api-access-vqnxp\") pod \"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad\" (UID: \"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad\") " Jul 16 20:08:38.894883 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:38.894854 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1a2097-cd1b-48e0-8984-1a9e2aff42ad-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ed1a2097-cd1b-48e0-8984-1a9e2aff42ad" (UID: "ed1a2097-cd1b-48e0-8984-1a9e2aff42ad"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:08:38.896579 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:38.896554 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed1a2097-cd1b-48e0-8984-1a9e2aff42ad-kube-api-access-vqnxp" (OuterVolumeSpecName: "kube-api-access-vqnxp") pod "ed1a2097-cd1b-48e0-8984-1a9e2aff42ad" (UID: "ed1a2097-cd1b-48e0-8984-1a9e2aff42ad"). InnerVolumeSpecName "kube-api-access-vqnxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:08:38.995566 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:38.995458 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed1a2097-cd1b-48e0-8984-1a9e2aff42ad-extensions-socket-volume\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:08:38.995566 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:38.995508 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqnxp\" (UniqueName: \"kubernetes.io/projected/ed1a2097-cd1b-48e0-8984-1a9e2aff42ad-kube-api-access-vqnxp\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:08:39.446173 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:39.446138 2575 generic.go:356] "Generic (PLEG): container finished" podID="ed1a2097-cd1b-48e0-8984-1a9e2aff42ad" containerID="192aa55477b8eba4b67d14e2a76a4d289651b6865603ecc02559d3c1403d93e0" exitCode=0 Jul 16 20:08:39.446648 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:39.446180 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" Jul 16 20:08:39.446648 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:39.446225 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" event={"ID":"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad","Type":"ContainerDied","Data":"192aa55477b8eba4b67d14e2a76a4d289651b6865603ecc02559d3c1403d93e0"} Jul 16 20:08:39.446648 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:39.446286 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n" event={"ID":"ed1a2097-cd1b-48e0-8984-1a9e2aff42ad","Type":"ContainerDied","Data":"b7ce5b7b916f203e5e977193881f66ff6cc209bd8c928d3c3fcaef5cb4d6c33d"} Jul 16 20:08:39.446648 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:39.446319 2575 scope.go:117] "RemoveContainer" containerID="192aa55477b8eba4b67d14e2a76a4d289651b6865603ecc02559d3c1403d93e0" Jul 16 20:08:39.456983 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:39.456963 2575 scope.go:117] "RemoveContainer" containerID="192aa55477b8eba4b67d14e2a76a4d289651b6865603ecc02559d3c1403d93e0" Jul 16 20:08:39.457301 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:08:39.457282 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"192aa55477b8eba4b67d14e2a76a4d289651b6865603ecc02559d3c1403d93e0\": container with ID starting with 192aa55477b8eba4b67d14e2a76a4d289651b6865603ecc02559d3c1403d93e0 not found: ID does not exist" containerID="192aa55477b8eba4b67d14e2a76a4d289651b6865603ecc02559d3c1403d93e0" Jul 16 20:08:39.457350 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:39.457310 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192aa55477b8eba4b67d14e2a76a4d289651b6865603ecc02559d3c1403d93e0"} err="failed to get container status \"192aa55477b8eba4b67d14e2a76a4d289651b6865603ecc02559d3c1403d93e0\": rpc error: code = NotFound desc = could not find container \"192aa55477b8eba4b67d14e2a76a4d289651b6865603ecc02559d3c1403d93e0\": container with ID starting with 192aa55477b8eba4b67d14e2a76a4d289651b6865603ecc02559d3c1403d93e0 not found: ID does not exist" Jul 16 20:08:39.480423 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:39.480388 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n"] Jul 16 20:08:39.498514 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:39.498482 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7b44n"] Jul 16 20:08:40.018486 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:40.018447 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed1a2097-cd1b-48e0-8984-1a9e2aff42ad" path="/var/lib/kubelet/pods/ed1a2097-cd1b-48e0-8984-1a9e2aff42ad/volumes" Jul 16 20:08:55.541336 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.541300 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg"] Jul 16 20:08:55.541753 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.541739 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1a2097-cd1b-48e0-8984-1a9e2aff42ad" containerName="manager" Jul 16 20:08:55.541808 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.541756 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1a2097-cd1b-48e0-8984-1a9e2aff42ad" containerName="manager" Jul 16 20:08:55.541846 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.541833 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed1a2097-cd1b-48e0-8984-1a9e2aff42ad" containerName="manager" Jul 16 20:08:55.577808 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.577675 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:55.678736 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.678702 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg"] Jul 16 20:08:55.678935 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.678860 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.681500 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.681475 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-plpgm\"" Jul 16 20:08:55.682140 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.682123 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 20:08:55.720690 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.720656 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:55.738113 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.738085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7026a235-d98f-4857-b366-565ff9b30713-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.738241 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.738123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.738241 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.738143 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg6mj\" (UniqueName: \"kubernetes.io/projected/7026a235-d98f-4857-b366-565ff9b30713-kube-api-access-hg6mj\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.738241 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.738212 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7026a235-d98f-4857-b366-565ff9b30713-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.738366 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.738257 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.738366 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.738279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.738366 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.738313 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.738479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.738404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7026a235-d98f-4857-b366-565ff9b30713-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.738479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.738447 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839083 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839050 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7026a235-d98f-4857-b366-565ff9b30713-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839083 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839085 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839309 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839105 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg6mj\" (UniqueName: \"kubernetes.io/projected/7026a235-d98f-4857-b366-565ff9b30713-kube-api-access-hg6mj\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839309 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839141 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7026a235-d98f-4857-b366-565ff9b30713-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839309 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839176 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839309 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839195 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839309 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839232 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839309 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7026a235-d98f-4857-b366-565ff9b30713-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839610 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839364 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839733 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839629 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839733 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839695 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839896 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839732 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839896 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839755 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.839980 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.839960 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7026a235-d98f-4857-b366-565ff9b30713-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.841431 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.841413 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7026a235-d98f-4857-b366-565ff9b30713-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.841751 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.841730 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7026a235-d98f-4857-b366-565ff9b30713-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.848748 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.848723 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7026a235-d98f-4857-b366-565ff9b30713-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.854183 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.854157 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg6mj\" (UniqueName: \"kubernetes.io/projected/7026a235-d98f-4857-b366-565ff9b30713-kube-api-access-hg6mj\") pod \"maas-default-gateway-openshift-default-56654dcf7-wpqwg\" (UID: \"7026a235-d98f-4857-b366-565ff9b30713\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:55.989571 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:55.989517 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:56.172509 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:56.172486 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg"] Jul 16 20:08:56.175505 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:08:56.175473 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7026a235_d98f_4857_b366_565ff9b30713.slice/crio-7665e1a95905f6304d7de424fc6cd629a2fdc3f3b5187ef9ce263ead18f4a941 WatchSource:0}: Error finding container 7665e1a95905f6304d7de424fc6cd629a2fdc3f3b5187ef9ce263ead18f4a941: Status 404 returned error can't find the container with id 7665e1a95905f6304d7de424fc6cd629a2fdc3f3b5187ef9ce263ead18f4a941 Jul 16 20:08:56.177742 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:56.177709 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:08:56.177847 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:56.177805 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:08:56.177847 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:56.177838 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:08:56.533798 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:56.533680 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" event={"ID":"7026a235-d98f-4857-b366-565ff9b30713","Type":"ContainerStarted","Data":"e1d4d81777f481045c03383f005081e38b9b77ad89f2457acfeda5c19c0c2b5f"} Jul 16 20:08:56.533798 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:56.533743 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" event={"ID":"7026a235-d98f-4857-b366-565ff9b30713","Type":"ContainerStarted","Data":"7665e1a95905f6304d7de424fc6cd629a2fdc3f3b5187ef9ce263ead18f4a941"} Jul 16 20:08:56.563838 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:56.563789 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" podStartSLOduration=1.5637485930000001 podStartE2EDuration="1.563748593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:08:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:08:56.561855543 +0000 UTC m=+533.025208574" watchObservedRunningTime="2026-07-16 20:08:56.563748593 +0000 UTC m=+533.027101623" Jul 16 20:08:56.990047 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:56.990004 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:57.995200 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:57.995169 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:58.174033 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:58.174001 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:58.283271 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:58.283189 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:58.430840 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:58.430802 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:58.544465 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:58.544377 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:58.545346 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:58.545324 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:08:59.185808 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:59.185747 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:59.330118 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:59.330083 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:08:59.448713 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:59.448636 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bg5rb"] Jul 16 20:08:59.451484 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:59.451468 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bg5rb" Jul 16 20:08:59.466037 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:59.466004 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bg5rb"] Jul 16 20:08:59.468271 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:59.468250 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nh77z\"" Jul 16 20:08:59.470082 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:59.470053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk6hg\" (UniqueName: \"kubernetes.io/projected/e53a0a43-4c7c-4776-8bc0-9ce7bdd32680-kube-api-access-zk6hg\") pod \"authorino-75d556bd77-bg5rb\" (UID: \"e53a0a43-4c7c-4776-8bc0-9ce7bdd32680\") " pod="kuadrant-system/authorino-75d556bd77-bg5rb" Jul 16 20:08:59.571483 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:59.571448 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk6hg\" (UniqueName: \"kubernetes.io/projected/e53a0a43-4c7c-4776-8bc0-9ce7bdd32680-kube-api-access-zk6hg\") pod \"authorino-75d556bd77-bg5rb\" (UID: \"e53a0a43-4c7c-4776-8bc0-9ce7bdd32680\") " pod="kuadrant-system/authorino-75d556bd77-bg5rb" Jul 16 20:08:59.580802 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:59.580754 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk6hg\" (UniqueName: \"kubernetes.io/projected/e53a0a43-4c7c-4776-8bc0-9ce7bdd32680-kube-api-access-zk6hg\") pod \"authorino-75d556bd77-bg5rb\" (UID: \"e53a0a43-4c7c-4776-8bc0-9ce7bdd32680\") " pod="kuadrant-system/authorino-75d556bd77-bg5rb" Jul 16 20:08:59.761752 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:59.761672 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bg5rb" Jul 16 20:08:59.913514 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:08:59.913478 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bg5rb"] Jul 16 20:08:59.916946 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:08:59.916916 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode53a0a43_4c7c_4776_8bc0_9ce7bdd32680.slice/crio-27a0fcc3b25c7e2dcb64ba66a42340b5cd38e186ccc9674af51dd4d8feed4f72 WatchSource:0}: Error finding container 27a0fcc3b25c7e2dcb64ba66a42340b5cd38e186ccc9674af51dd4d8feed4f72: Status 404 returned error can't find the container with id 27a0fcc3b25c7e2dcb64ba66a42340b5cd38e186ccc9674af51dd4d8feed4f72 Jul 16 20:09:00.556369 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:00.556335 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bg5rb" event={"ID":"e53a0a43-4c7c-4776-8bc0-9ce7bdd32680","Type":"ContainerStarted","Data":"27a0fcc3b25c7e2dcb64ba66a42340b5cd38e186ccc9674af51dd4d8feed4f72"} Jul 16 20:09:05.587456 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:05.587414 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bg5rb" event={"ID":"e53a0a43-4c7c-4776-8bc0-9ce7bdd32680","Type":"ContainerStarted","Data":"4b6bbc7655287c0ceccb94004bc52b79f0d2e8ed3e2cce71701e052720cd4a49"} Jul 16 20:09:05.604559 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:05.604502 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bg5rb" podStartSLOduration=1.7514856060000001 podStartE2EDuration="6.604486029s" totalImagesPullingTime="4.853000423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:09:05.603312235 +0000 UTC m=+542.066665267" watchObservedRunningTime="2026-07-16 20:09:05.604486029 +0000 UTC m=+542.067839059" Jul 16 20:09:19.657953 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:19.657909 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:09:19.749533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:19.749498 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:09:20.173714 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:20.173672 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:09:32.915923 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:32.915889 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:09:33.039143 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:33.039104 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:09:37.654121 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:37.654084 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bg5rb"] Jul 16 20:09:37.654555 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:37.654262 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bg5rb" podUID="e53a0a43-4c7c-4776-8bc0-9ce7bdd32680" containerName="authorino" containerID="cri-o://4b6bbc7655287c0ceccb94004bc52b79f0d2e8ed3e2cce71701e052720cd4a49" gracePeriod=30 Jul 16 20:09:37.922138 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:37.922111 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bg5rb" Jul 16 20:09:38.011164 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:38.011123 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk6hg\" (UniqueName: \"kubernetes.io/projected/e53a0a43-4c7c-4776-8bc0-9ce7bdd32680-kube-api-access-zk6hg\") pod \"e53a0a43-4c7c-4776-8bc0-9ce7bdd32680\" (UID: \"e53a0a43-4c7c-4776-8bc0-9ce7bdd32680\") " Jul 16 20:09:38.013185 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:38.013157 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e53a0a43-4c7c-4776-8bc0-9ce7bdd32680-kube-api-access-zk6hg" (OuterVolumeSpecName: "kube-api-access-zk6hg") pod "e53a0a43-4c7c-4776-8bc0-9ce7bdd32680" (UID: "e53a0a43-4c7c-4776-8bc0-9ce7bdd32680"). InnerVolumeSpecName "kube-api-access-zk6hg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:09:38.112189 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:38.112151 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk6hg\" (UniqueName: \"kubernetes.io/projected/e53a0a43-4c7c-4776-8bc0-9ce7bdd32680-kube-api-access-zk6hg\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:09:38.751016 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:38.750975 2575 generic.go:356] "Generic (PLEG): container finished" podID="e53a0a43-4c7c-4776-8bc0-9ce7bdd32680" containerID="4b6bbc7655287c0ceccb94004bc52b79f0d2e8ed3e2cce71701e052720cd4a49" exitCode=0 Jul 16 20:09:38.751459 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:38.751018 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bg5rb" Jul 16 20:09:38.751459 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:38.751053 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bg5rb" event={"ID":"e53a0a43-4c7c-4776-8bc0-9ce7bdd32680","Type":"ContainerDied","Data":"4b6bbc7655287c0ceccb94004bc52b79f0d2e8ed3e2cce71701e052720cd4a49"} Jul 16 20:09:38.751459 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:38.751095 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bg5rb" event={"ID":"e53a0a43-4c7c-4776-8bc0-9ce7bdd32680","Type":"ContainerDied","Data":"27a0fcc3b25c7e2dcb64ba66a42340b5cd38e186ccc9674af51dd4d8feed4f72"} Jul 16 20:09:38.751459 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:38.751112 2575 scope.go:117] "RemoveContainer" containerID="4b6bbc7655287c0ceccb94004bc52b79f0d2e8ed3e2cce71701e052720cd4a49" Jul 16 20:09:38.759716 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:38.759695 2575 scope.go:117] "RemoveContainer" containerID="4b6bbc7655287c0ceccb94004bc52b79f0d2e8ed3e2cce71701e052720cd4a49" Jul 16 20:09:38.760027 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:09:38.759999 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b6bbc7655287c0ceccb94004bc52b79f0d2e8ed3e2cce71701e052720cd4a49\": container with ID starting with 4b6bbc7655287c0ceccb94004bc52b79f0d2e8ed3e2cce71701e052720cd4a49 not found: ID does not exist" containerID="4b6bbc7655287c0ceccb94004bc52b79f0d2e8ed3e2cce71701e052720cd4a49" Jul 16 20:09:38.760095 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:38.760028 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b6bbc7655287c0ceccb94004bc52b79f0d2e8ed3e2cce71701e052720cd4a49"} err="failed to get container status \"4b6bbc7655287c0ceccb94004bc52b79f0d2e8ed3e2cce71701e052720cd4a49\": rpc error: code = NotFound desc = could not find container \"4b6bbc7655287c0ceccb94004bc52b79f0d2e8ed3e2cce71701e052720cd4a49\": container with ID starting with 4b6bbc7655287c0ceccb94004bc52b79f0d2e8ed3e2cce71701e052720cd4a49 not found: ID does not exist" Jul 16 20:09:38.767721 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:38.767697 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bg5rb"] Jul 16 20:09:38.771487 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:38.771466 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bg5rb"] Jul 16 20:09:40.018707 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:40.018661 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e53a0a43-4c7c-4776-8bc0-9ce7bdd32680" path="/var/lib/kubelet/pods/e53a0a43-4c7c-4776-8bc0-9ce7bdd32680/volumes" Jul 16 20:09:42.250693 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.250656 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:09:42.264978 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.264943 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8959486f9-tgzjs"] Jul 16 20:09:42.265328 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.265316 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e53a0a43-4c7c-4776-8bc0-9ce7bdd32680" containerName="authorino" Jul 16 20:09:42.265368 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.265329 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e53a0a43-4c7c-4776-8bc0-9ce7bdd32680" containerName="authorino" Jul 16 20:09:42.265404 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.265391 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e53a0a43-4c7c-4776-8bc0-9ce7bdd32680" containerName="authorino" Jul 16 20:09:42.269849 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.269822 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8959486f9-tgzjs" Jul 16 20:09:42.272811 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.272783 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rd6cf\"" Jul 16 20:09:42.272978 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.272787 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 16 20:09:42.273150 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.273136 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 16 20:09:42.279651 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.279623 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8959486f9-tgzjs"] Jul 16 20:09:42.349525 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.349481 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:09:42.357552 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.357516 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b65dd3f8-6d9a-43a9-8ca1-3271397501ec-webhook-cert\") pod \"maas-controller-8959486f9-tgzjs\" (UID: \"b65dd3f8-6d9a-43a9-8ca1-3271397501ec\") " pod="opendatahub/maas-controller-8959486f9-tgzjs" Jul 16 20:09:42.357711 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.357600 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8586x\" (UniqueName: \"kubernetes.io/projected/b65dd3f8-6d9a-43a9-8ca1-3271397501ec-kube-api-access-8586x\") pod \"maas-controller-8959486f9-tgzjs\" (UID: \"b65dd3f8-6d9a-43a9-8ca1-3271397501ec\") " pod="opendatahub/maas-controller-8959486f9-tgzjs" Jul 16 20:09:42.427188 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.427152 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-vclch"] Jul 16 20:09:42.429642 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.429613 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" Jul 16 20:09:42.440439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.440404 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-vclch"] Jul 16 20:09:42.458618 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.458573 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8586x\" (UniqueName: \"kubernetes.io/projected/b65dd3f8-6d9a-43a9-8ca1-3271397501ec-kube-api-access-8586x\") pod \"maas-controller-8959486f9-tgzjs\" (UID: \"b65dd3f8-6d9a-43a9-8ca1-3271397501ec\") " pod="opendatahub/maas-controller-8959486f9-tgzjs" Jul 16 20:09:42.458862 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.458644 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b65dd3f8-6d9a-43a9-8ca1-3271397501ec-webhook-cert\") pod \"maas-controller-8959486f9-tgzjs\" (UID: \"b65dd3f8-6d9a-43a9-8ca1-3271397501ec\") " pod="opendatahub/maas-controller-8959486f9-tgzjs" Jul 16 20:09:42.461181 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.461155 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b65dd3f8-6d9a-43a9-8ca1-3271397501ec-webhook-cert\") pod \"maas-controller-8959486f9-tgzjs\" (UID: \"b65dd3f8-6d9a-43a9-8ca1-3271397501ec\") " pod="opendatahub/maas-controller-8959486f9-tgzjs" Jul 16 20:09:42.462394 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.462365 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:09:42.467804 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.467717 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8586x\" (UniqueName: \"kubernetes.io/projected/b65dd3f8-6d9a-43a9-8ca1-3271397501ec-kube-api-access-8586x\") pod \"maas-controller-8959486f9-tgzjs\" (UID: \"b65dd3f8-6d9a-43a9-8ca1-3271397501ec\") " pod="opendatahub/maas-controller-8959486f9-tgzjs" Jul 16 20:09:42.517782 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.517724 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:09:42.559897 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.559835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jhc6\" (UniqueName: \"kubernetes.io/projected/b01e1d5c-8479-4fef-a993-20e494ed738c-kube-api-access-9jhc6\") pod \"maas-controller-6cc6f6c9cc-vclch\" (UID: \"b01e1d5c-8479-4fef-a993-20e494ed738c\") " pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" Jul 16 20:09:42.560081 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.559953 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b01e1d5c-8479-4fef-a993-20e494ed738c-webhook-cert\") pod \"maas-controller-6cc6f6c9cc-vclch\" (UID: \"b01e1d5c-8479-4fef-a993-20e494ed738c\") " pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" Jul 16 20:09:42.581931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.581896 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8959486f9-tgzjs" Jul 16 20:09:42.660603 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.660568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b01e1d5c-8479-4fef-a993-20e494ed738c-webhook-cert\") pod \"maas-controller-6cc6f6c9cc-vclch\" (UID: \"b01e1d5c-8479-4fef-a993-20e494ed738c\") " pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" Jul 16 20:09:42.660807 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.660667 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jhc6\" (UniqueName: \"kubernetes.io/projected/b01e1d5c-8479-4fef-a993-20e494ed738c-kube-api-access-9jhc6\") pod \"maas-controller-6cc6f6c9cc-vclch\" (UID: \"b01e1d5c-8479-4fef-a993-20e494ed738c\") " pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" Jul 16 20:09:42.663152 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.663128 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b01e1d5c-8479-4fef-a993-20e494ed738c-webhook-cert\") pod \"maas-controller-6cc6f6c9cc-vclch\" (UID: \"b01e1d5c-8479-4fef-a993-20e494ed738c\") " pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" Jul 16 20:09:42.669644 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.669614 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jhc6\" (UniqueName: \"kubernetes.io/projected/b01e1d5c-8479-4fef-a993-20e494ed738c-kube-api-access-9jhc6\") pod \"maas-controller-6cc6f6c9cc-vclch\" (UID: \"b01e1d5c-8479-4fef-a993-20e494ed738c\") " pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" Jul 16 20:09:42.727343 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.727308 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8959486f9-tgzjs"] Jul 16 20:09:42.728829 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:09:42.728801 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65dd3f8_6d9a_43a9_8ca1_3271397501ec.slice/crio-3b8b32e60dfd09013354fa3fde2d5e57cee11428a7a91cb68c0bc55cefb5f85b WatchSource:0}: Error finding container 3b8b32e60dfd09013354fa3fde2d5e57cee11428a7a91cb68c0bc55cefb5f85b: Status 404 returned error can't find the container with id 3b8b32e60dfd09013354fa3fde2d5e57cee11428a7a91cb68c0bc55cefb5f85b Jul 16 20:09:42.740530 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.740506 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" Jul 16 20:09:42.772987 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.772944 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8959486f9-tgzjs" event={"ID":"b65dd3f8-6d9a-43a9-8ca1-3271397501ec","Type":"ContainerStarted","Data":"3b8b32e60dfd09013354fa3fde2d5e57cee11428a7a91cb68c0bc55cefb5f85b"} Jul 16 20:09:42.877911 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:42.877885 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-vclch"] Jul 16 20:09:42.880160 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:09:42.880128 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01e1d5c_8479_4fef_a993_20e494ed738c.slice/crio-2da6bb23b45d1e2ba23193fc2a60928fbae1ebf3c63975257785ba605b158a82 WatchSource:0}: Error finding container 2da6bb23b45d1e2ba23193fc2a60928fbae1ebf3c63975257785ba605b158a82: Status 404 returned error can't find the container with id 2da6bb23b45d1e2ba23193fc2a60928fbae1ebf3c63975257785ba605b158a82 Jul 16 20:09:43.781020 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:43.780981 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" event={"ID":"b01e1d5c-8479-4fef-a993-20e494ed738c","Type":"ContainerStarted","Data":"2da6bb23b45d1e2ba23193fc2a60928fbae1ebf3c63975257785ba605b158a82"} Jul 16 20:09:45.510105 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:45.510056 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:09:45.795932 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:45.795889 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" event={"ID":"b01e1d5c-8479-4fef-a993-20e494ed738c","Type":"ContainerStarted","Data":"3a4d87f2ac349cfdd542992988d4f19b9047f044379d420a9b305b7ed40d7813"} Jul 16 20:09:45.796129 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:45.795983 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" Jul 16 20:09:45.797425 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:45.797394 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8959486f9-tgzjs" event={"ID":"b65dd3f8-6d9a-43a9-8ca1-3271397501ec","Type":"ContainerStarted","Data":"1c93ed217d96d9f8427364444a174d1ae8bf51883cb336ead6ee6996c640833b"} Jul 16 20:09:45.797533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:45.797469 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8959486f9-tgzjs" Jul 16 20:09:45.817172 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:45.817114 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" podStartSLOduration=1.407451431 podStartE2EDuration="3.817097897s" totalImagesPullingTime="2.409646466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:09:45.814870859 +0000 UTC m=+582.278223891" watchObservedRunningTime="2026-07-16 20:09:45.817097897 +0000 UTC m=+582.280450927" Jul 16 20:09:45.835741 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:45.835685 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8959486f9-tgzjs" podStartSLOduration=1.157035524 podStartE2EDuration="3.835662293s" totalImagesPullingTime="2.678626769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:09:45.834153655 +0000 UTC m=+582.297506710" watchObservedRunningTime="2026-07-16 20:09:45.835662293 +0000 UTC m=+582.299015325" Jul 16 20:09:46.504291 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:46.504248 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:09:54.723039 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:54.722996 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:09:56.804981 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:56.804951 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8959486f9-tgzjs" Jul 16 20:09:56.805371 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:56.805032 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" Jul 16 20:09:56.871629 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:56.871592 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8959486f9-tgzjs"] Jul 16 20:09:56.871904 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:56.871877 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8959486f9-tgzjs" podUID="b65dd3f8-6d9a-43a9-8ca1-3271397501ec" containerName="manager" containerID="cri-o://1c93ed217d96d9f8427364444a174d1ae8bf51883cb336ead6ee6996c640833b" gracePeriod=30 Jul 16 20:09:57.122313 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.122281 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8959486f9-tgzjs" Jul 16 20:09:57.186481 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.186451 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b65dd3f8-6d9a-43a9-8ca1-3271397501ec-webhook-cert\") pod \"b65dd3f8-6d9a-43a9-8ca1-3271397501ec\" (UID: \"b65dd3f8-6d9a-43a9-8ca1-3271397501ec\") " Jul 16 20:09:57.186687 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.186523 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8586x\" (UniqueName: \"kubernetes.io/projected/b65dd3f8-6d9a-43a9-8ca1-3271397501ec-kube-api-access-8586x\") pod \"b65dd3f8-6d9a-43a9-8ca1-3271397501ec\" (UID: \"b65dd3f8-6d9a-43a9-8ca1-3271397501ec\") " Jul 16 20:09:57.188716 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.188681 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b65dd3f8-6d9a-43a9-8ca1-3271397501ec-kube-api-access-8586x" (OuterVolumeSpecName: "kube-api-access-8586x") pod "b65dd3f8-6d9a-43a9-8ca1-3271397501ec" (UID: "b65dd3f8-6d9a-43a9-8ca1-3271397501ec"). InnerVolumeSpecName "kube-api-access-8586x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:09:57.188716 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.188686 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b65dd3f8-6d9a-43a9-8ca1-3271397501ec-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b65dd3f8-6d9a-43a9-8ca1-3271397501ec" (UID: "b65dd3f8-6d9a-43a9-8ca1-3271397501ec"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:09:57.287244 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.287196 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8586x\" (UniqueName: \"kubernetes.io/projected/b65dd3f8-6d9a-43a9-8ca1-3271397501ec-kube-api-access-8586x\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:09:57.287244 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.287237 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b65dd3f8-6d9a-43a9-8ca1-3271397501ec-webhook-cert\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:09:57.859435 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.859396 2575 generic.go:356] "Generic (PLEG): container finished" podID="b65dd3f8-6d9a-43a9-8ca1-3271397501ec" containerID="1c93ed217d96d9f8427364444a174d1ae8bf51883cb336ead6ee6996c640833b" exitCode=0 Jul 16 20:09:57.859911 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.859449 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8959486f9-tgzjs" Jul 16 20:09:57.859911 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.859477 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8959486f9-tgzjs" event={"ID":"b65dd3f8-6d9a-43a9-8ca1-3271397501ec","Type":"ContainerDied","Data":"1c93ed217d96d9f8427364444a174d1ae8bf51883cb336ead6ee6996c640833b"} Jul 16 20:09:57.859911 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.859529 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8959486f9-tgzjs" event={"ID":"b65dd3f8-6d9a-43a9-8ca1-3271397501ec","Type":"ContainerDied","Data":"3b8b32e60dfd09013354fa3fde2d5e57cee11428a7a91cb68c0bc55cefb5f85b"} Jul 16 20:09:57.859911 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.859552 2575 scope.go:117] "RemoveContainer" containerID="1c93ed217d96d9f8427364444a174d1ae8bf51883cb336ead6ee6996c640833b" Jul 16 20:09:57.868698 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.868681 2575 scope.go:117] "RemoveContainer" containerID="1c93ed217d96d9f8427364444a174d1ae8bf51883cb336ead6ee6996c640833b" Jul 16 20:09:57.869004 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:09:57.868985 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c93ed217d96d9f8427364444a174d1ae8bf51883cb336ead6ee6996c640833b\": container with ID starting with 1c93ed217d96d9f8427364444a174d1ae8bf51883cb336ead6ee6996c640833b not found: ID does not exist" containerID="1c93ed217d96d9f8427364444a174d1ae8bf51883cb336ead6ee6996c640833b" Jul 16 20:09:57.869072 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.869010 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c93ed217d96d9f8427364444a174d1ae8bf51883cb336ead6ee6996c640833b"} err="failed to get container status \"1c93ed217d96d9f8427364444a174d1ae8bf51883cb336ead6ee6996c640833b\": rpc error: code = NotFound desc = could not find container \"1c93ed217d96d9f8427364444a174d1ae8bf51883cb336ead6ee6996c640833b\": container with ID starting with 1c93ed217d96d9f8427364444a174d1ae8bf51883cb336ead6ee6996c640833b not found: ID does not exist" Jul 16 20:09:57.881445 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.881414 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8959486f9-tgzjs"] Jul 16 20:09:57.885505 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:57.885480 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8959486f9-tgzjs"] Jul 16 20:09:58.018547 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:09:58.018516 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b65dd3f8-6d9a-43a9-8ca1-3271397501ec" path="/var/lib/kubelet/pods/b65dd3f8-6d9a-43a9-8ca1-3271397501ec/volumes" Jul 16 20:10:03.964418 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:03.964373 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:10:03.965319 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:03.965297 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:10:11.742980 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:11.742943 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:10:17.447865 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:17.447828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:10:17.622325 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:17.622275 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:10:18.013898 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.013860 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:10:18.126565 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.126532 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-95db78549-89sj2"] Jul 16 20:10:18.126937 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.126924 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65dd3f8-6d9a-43a9-8ca1-3271397501ec" containerName="manager" Jul 16 20:10:18.126998 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.126939 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65dd3f8-6d9a-43a9-8ca1-3271397501ec" containerName="manager" Jul 16 20:10:18.127034 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.127007 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65dd3f8-6d9a-43a9-8ca1-3271397501ec" containerName="manager" Jul 16 20:10:18.131373 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.131352 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" Jul 16 20:10:18.134055 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.134031 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g78x2\"" Jul 16 20:10:18.136979 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.136948 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 16 20:10:18.137105 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.136953 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 20:10:18.137361 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.137331 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 20:10:18.151322 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.151284 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-95db78549-89sj2"] Jul 16 20:10:18.259777 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.259724 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:10:18.273049 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.272931 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f81a4f3b-2ce0-416a-85b7-94949476f900-openshift-service-ca\") pod \"maas-api-95db78549-89sj2\" (UID: \"f81a4f3b-2ce0-416a-85b7-94949476f900\") " pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" Jul 16 20:10:18.273049 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.273020 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24bpf\" (UniqueName: \"kubernetes.io/projected/f81a4f3b-2ce0-416a-85b7-94949476f900-kube-api-access-24bpf\") pod \"maas-api-95db78549-89sj2\" (UID: \"f81a4f3b-2ce0-416a-85b7-94949476f900\") " pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" Jul 16 20:10:18.273288 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.273076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f81a4f3b-2ce0-416a-85b7-94949476f900-maas-api-tls\") pod \"maas-api-95db78549-89sj2\" (UID: \"f81a4f3b-2ce0-416a-85b7-94949476f900\") " pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" Jul 16 20:10:18.374547 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.374513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f81a4f3b-2ce0-416a-85b7-94949476f900-openshift-service-ca\") pod \"maas-api-95db78549-89sj2\" (UID: \"f81a4f3b-2ce0-416a-85b7-94949476f900\") " pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" Jul 16 20:10:18.374804 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.374558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24bpf\" (UniqueName: \"kubernetes.io/projected/f81a4f3b-2ce0-416a-85b7-94949476f900-kube-api-access-24bpf\") pod \"maas-api-95db78549-89sj2\" (UID: \"f81a4f3b-2ce0-416a-85b7-94949476f900\") " pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" Jul 16 20:10:18.374804 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.374580 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f81a4f3b-2ce0-416a-85b7-94949476f900-maas-api-tls\") pod \"maas-api-95db78549-89sj2\" (UID: \"f81a4f3b-2ce0-416a-85b7-94949476f900\") " pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" Jul 16 20:10:18.375277 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.375254 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f81a4f3b-2ce0-416a-85b7-94949476f900-openshift-service-ca\") pod \"maas-api-95db78549-89sj2\" (UID: \"f81a4f3b-2ce0-416a-85b7-94949476f900\") " pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" Jul 16 20:10:18.377073 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.377052 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f81a4f3b-2ce0-416a-85b7-94949476f900-maas-api-tls\") pod \"maas-api-95db78549-89sj2\" (UID: \"f81a4f3b-2ce0-416a-85b7-94949476f900\") " pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" Jul 16 20:10:18.386545 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.386513 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24bpf\" (UniqueName: \"kubernetes.io/projected/f81a4f3b-2ce0-416a-85b7-94949476f900-kube-api-access-24bpf\") pod \"maas-api-95db78549-89sj2\" (UID: \"f81a4f3b-2ce0-416a-85b7-94949476f900\") " pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" Jul 16 20:10:18.442422 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.442383 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" Jul 16 20:10:18.592335 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.592303 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-95db78549-89sj2"] Jul 16 20:10:18.595140 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:10:18.595100 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81a4f3b_2ce0_416a_85b7_94949476f900.slice/crio-74a43e6fae8e108caf4ce149f548fd1af4958dab31ae413ffeeb666bcec4e74f WatchSource:0}: Error finding container 74a43e6fae8e108caf4ce149f548fd1af4958dab31ae413ffeeb666bcec4e74f: Status 404 returned error can't find the container with id 74a43e6fae8e108caf4ce149f548fd1af4958dab31ae413ffeeb666bcec4e74f Jul 16 20:10:18.753127 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.753084 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:10:18.864639 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.864596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:10:18.940504 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.940472 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-qbk28"] Jul 16 20:10:18.944017 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.943993 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-qbk28" Jul 16 20:10:18.949377 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.949353 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lvsf2\"" Jul 16 20:10:18.949512 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.949355 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 16 20:10:18.962282 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.962253 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-qbk28"] Jul 16 20:10:18.966183 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:18.966151 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" event={"ID":"f81a4f3b-2ce0-416a-85b7-94949476f900","Type":"ContainerStarted","Data":"74a43e6fae8e108caf4ce149f548fd1af4958dab31ae413ffeeb666bcec4e74f"} Jul 16 20:10:19.083115 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:19.083072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf2xs\" (UniqueName: \"kubernetes.io/projected/2a3855c5-b00e-4c88-b317-a1e9520c0646-kube-api-access-jf2xs\") pod \"payload-pre-processing-7677b774bb-qbk28\" (UID: \"2a3855c5-b00e-4c88-b317-a1e9520c0646\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qbk28" Jul 16 20:10:19.083311 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:19.083128 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a3855c5-b00e-4c88-b317-a1e9520c0646-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-qbk28\" (UID: \"2a3855c5-b00e-4c88-b317-a1e9520c0646\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qbk28" Jul 16 20:10:19.184429 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:19.184316 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf2xs\" (UniqueName: \"kubernetes.io/projected/2a3855c5-b00e-4c88-b317-a1e9520c0646-kube-api-access-jf2xs\") pod \"payload-pre-processing-7677b774bb-qbk28\" (UID: \"2a3855c5-b00e-4c88-b317-a1e9520c0646\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qbk28" Jul 16 20:10:19.184429 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:19.184384 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a3855c5-b00e-4c88-b317-a1e9520c0646-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-qbk28\" (UID: \"2a3855c5-b00e-4c88-b317-a1e9520c0646\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qbk28" Jul 16 20:10:19.185164 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:19.185144 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a3855c5-b00e-4c88-b317-a1e9520c0646-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-qbk28\" (UID: \"2a3855c5-b00e-4c88-b317-a1e9520c0646\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qbk28" Jul 16 20:10:19.193030 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:19.193006 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf2xs\" (UniqueName: \"kubernetes.io/projected/2a3855c5-b00e-4c88-b317-a1e9520c0646-kube-api-access-jf2xs\") pod \"payload-pre-processing-7677b774bb-qbk28\" (UID: \"2a3855c5-b00e-4c88-b317-a1e9520c0646\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qbk28" Jul 16 20:10:19.255031 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:19.254991 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-qbk28" Jul 16 20:10:19.423593 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:19.423565 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-qbk28"] Jul 16 20:10:19.438404 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:10:19.435914 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a3855c5_b00e_4c88_b317_a1e9520c0646.slice/crio-b3595d49cbe9c972abcc83158cfe52ab931e7e41b0d7490901aa8ed6858d65f9 WatchSource:0}: Error finding container b3595d49cbe9c972abcc83158cfe52ab931e7e41b0d7490901aa8ed6858d65f9: Status 404 returned error can't find the container with id b3595d49cbe9c972abcc83158cfe52ab931e7e41b0d7490901aa8ed6858d65f9 Jul 16 20:10:19.971823 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:19.971790 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-qbk28" event={"ID":"2a3855c5-b00e-4c88-b317-a1e9520c0646","Type":"ContainerStarted","Data":"b3595d49cbe9c972abcc83158cfe52ab931e7e41b0d7490901aa8ed6858d65f9"} Jul 16 20:10:24.000810 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:24.000695 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" event={"ID":"f81a4f3b-2ce0-416a-85b7-94949476f900","Type":"ContainerStarted","Data":"aec66c9e3b74afea8809209090ebf9164837f117dd2ee894a8fdf6fa88589e36"} Jul 16 20:10:24.001256 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:24.000880 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" Jul 16 20:10:24.002473 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:24.002445 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-qbk28" event={"ID":"2a3855c5-b00e-4c88-b317-a1e9520c0646","Type":"ContainerStarted","Data":"3229d48c8ec2a3aa16b6b4e5aa8d62d1645c373fb939996cf15262279b8023d4"} Jul 16 20:10:24.002594 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:24.002495 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-qbk28" Jul 16 20:10:24.018749 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:24.018685 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" podStartSLOduration=1.4579248329999999 podStartE2EDuration="6.018662788s" totalImagesPullingTime="4.560737955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:10:24.017430937 +0000 UTC m=+620.480783979" watchObservedRunningTime="2026-07-16 20:10:24.018662788 +0000 UTC m=+620.482015820" Jul 16 20:10:24.033903 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:24.033797 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-qbk28" podStartSLOduration=2.3191668500000002 podStartE2EDuration="6.033758275s" totalImagesPullingTime="3.714591425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:10:24.033243964 +0000 UTC m=+620.496596996" watchObservedRunningTime="2026-07-16 20:10:24.033758275 +0000 UTC m=+620.497111307" Jul 16 20:10:27.018720 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:27.018683 2575 generic.go:356] "Generic (PLEG): container finished" podID="7026a235-d98f-4857-b366-565ff9b30713" containerID="e1d4d81777f481045c03383f005081e38b9b77ad89f2457acfeda5c19c0c2b5f" exitCode=0 Jul 16 20:10:27.018720 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:27.018723 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" event={"ID":"7026a235-d98f-4857-b366-565ff9b30713","Type":"ContainerDied","Data":"e1d4d81777f481045c03383f005081e38b9b77ad89f2457acfeda5c19c0c2b5f"} Jul 16 20:10:27.019201 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:27.019082 2575 scope.go:117] "RemoveContainer" containerID="e1d4d81777f481045c03383f005081e38b9b77ad89f2457acfeda5c19c0c2b5f" Jul 16 20:10:27.020043 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:27.020016 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:10:27.020111 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:27.020084 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:10:27.020154 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:27.020117 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:10:28.026364 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:28.026325 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" event={"ID":"7026a235-d98f-4857-b366-565ff9b30713","Type":"ContainerStarted","Data":"70ad0430f29c73b0bfcb59109a61fe33a3efef3a21294213e4704db39b4837c4"} Jul 16 20:10:28.544807 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:28.544739 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:10:28.990372 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:28.990334 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:10:28.991558 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:28.991529 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wpqwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 16 20:10:28.991690 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:28.991602 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" podUID="7026a235-d98f-4857-b366-565ff9b30713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 16 20:10:29.990089 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:29.990052 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wpqwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 16 20:10:29.990504 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:29.990112 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" podUID="7026a235-d98f-4857-b366-565ff9b30713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 16 20:10:30.018546 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:30.018519 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-95db78549-89sj2" Jul 16 20:10:30.990884 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:30.990850 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wpqwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 16 20:10:30.990884 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:30.990908 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" podUID="7026a235-d98f-4857-b366-565ff9b30713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 16 20:10:31.150120 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:31.150075 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:10:31.250678 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:31.250543 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:10:31.990746 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:31.990711 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wpqwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 16 20:10:31.990963 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:31.990792 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" podUID="7026a235-d98f-4857-b366-565ff9b30713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 16 20:10:32.994752 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:32.994718 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:10:32.995729 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:32.995708 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wpqwg" Jul 16 20:10:35.010266 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:35.010239 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-qbk28" Jul 16 20:10:47.014925 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.014884 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8"] Jul 16 20:10:47.018152 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.018131 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.029374 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.029337 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8"] Jul 16 20:10:47.030781 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.030746 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 16 20:10:47.030909 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.030748 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 16 20:10:47.031035 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.031019 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 16 20:10:47.031341 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.031323 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5xhqz\"" Jul 16 20:10:47.060733 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.060697 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7011edfe-745e-478b-8aa4-8bc094423937-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.060733 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.060735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7011edfe-745e-478b-8aa4-8bc094423937-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.060961 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.060754 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7011edfe-745e-478b-8aa4-8bc094423937-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.060961 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.060852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7011edfe-745e-478b-8aa4-8bc094423937-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.060961 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.060909 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l69kn\" (UniqueName: \"kubernetes.io/projected/7011edfe-745e-478b-8aa4-8bc094423937-kube-api-access-l69kn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.060961 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.060952 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7011edfe-745e-478b-8aa4-8bc094423937-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.067088 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.067049 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:10:47.162321 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.162284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7011edfe-745e-478b-8aa4-8bc094423937-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.162516 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.162437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7011edfe-745e-478b-8aa4-8bc094423937-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.162516 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.162463 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7011edfe-745e-478b-8aa4-8bc094423937-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.162516 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.162481 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7011edfe-745e-478b-8aa4-8bc094423937-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.162800 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.162733 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7011edfe-745e-478b-8aa4-8bc094423937-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.162887 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.162856 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7011edfe-745e-478b-8aa4-8bc094423937-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.163031 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.163006 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7011edfe-745e-478b-8aa4-8bc094423937-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.163109 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.163051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7011edfe-745e-478b-8aa4-8bc094423937-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.163153 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.163118 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l69kn\" (UniqueName: \"kubernetes.io/projected/7011edfe-745e-478b-8aa4-8bc094423937-kube-api-access-l69kn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.165187 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.165162 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7011edfe-745e-478b-8aa4-8bc094423937-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.165321 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.165304 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7011edfe-745e-478b-8aa4-8bc094423937-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.171701 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.171671 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l69kn\" (UniqueName: \"kubernetes.io/projected/7011edfe-745e-478b-8aa4-8bc094423937-kube-api-access-l69kn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8\" (UID: \"7011edfe-745e-478b-8aa4-8bc094423937\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.328915 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.328803 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:47.474458 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.474428 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8"] Jul 16 20:10:47.477170 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:10:47.477141 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7011edfe_745e_478b_8aa4_8bc094423937.slice/crio-e25215edda82c5eb2589994358cd12628d347ea390dfc52a89637217585a7473 WatchSource:0}: Error finding container e25215edda82c5eb2589994358cd12628d347ea390dfc52a89637217585a7473: Status 404 returned error can't find the container with id e25215edda82c5eb2589994358cd12628d347ea390dfc52a89637217585a7473 Jul 16 20:10:47.479095 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:47.479072 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 20:10:48.139914 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:48.139875 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" event={"ID":"7011edfe-745e-478b-8aa4-8bc094423937","Type":"ContainerStarted","Data":"e25215edda82c5eb2589994358cd12628d347ea390dfc52a89637217585a7473"} Jul 16 20:10:49.146625 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:49.146591 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" event={"ID":"7011edfe-745e-478b-8aa4-8bc094423937","Type":"ContainerStarted","Data":"d0d2e07bdf61a6df708ce494cdd4d2392ebc19389abd14ccc2dee72c5657f7e5"} Jul 16 20:10:49.166237 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:49.166183 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" podStartSLOduration=2.037758824 podStartE2EDuration="3.166162253s" totalImagesPullingTime="1.128403429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:10:49.165949709 +0000 UTC m=+645.629302740" watchObservedRunningTime="2026-07-16 20:10:49.166162253 +0000 UTC m=+645.629515284" Jul 16 20:10:52.551939 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:52.551900 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:10:57.329138 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:57.329078 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:57.329671 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:57.329170 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:57.342020 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:57.341980 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:10:58.203489 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:10:58.203456 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8" Jul 16 20:11:07.258553 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:07.258518 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:11:18.836577 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:18.836540 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:11:18.939233 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:18.939200 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:11:24.035054 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:24.035014 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:11:31.153500 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:31.153465 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:11:33.623496 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.623459 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl"] Jul 16 20:11:33.626019 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.625998 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.629685 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.629647 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 16 20:11:33.648324 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.648284 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl"] Jul 16 20:11:33.674051 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.674014 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.674299 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.674090 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.674299 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.674118 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.674299 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.674167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.674299 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.674218 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.674299 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.674257 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfk2p\" (UniqueName: \"kubernetes.io/projected/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-kube-api-access-kfk2p\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.700102 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.700055 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:11:33.775216 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.775161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.775426 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.775237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.775426 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.775267 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.775426 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.775298 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.775426 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.775352 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.775426 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.775393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfk2p\" (UniqueName: \"kubernetes.io/projected/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-kube-api-access-kfk2p\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.776149 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.776122 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.776306 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.776174 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.776629 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.776609 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.779585 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.779559 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.779999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.779977 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.789075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.789042 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfk2p\" (UniqueName: \"kubernetes.io/projected/36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2-kube-api-access-kfk2p\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl\" (UID: \"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:33.936437 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:33.936332 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:34.084577 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:34.084551 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl"] Jul 16 20:11:34.086807 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:11:34.086777 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36086c7e_1e06_4fa1_86f6_0eb9a54cf6a2.slice/crio-c2e8e7c0f6eb83614da2fd32130cd62d7b7d16c68ca16634dfbe18c125f98a89 WatchSource:0}: Error finding container c2e8e7c0f6eb83614da2fd32130cd62d7b7d16c68ca16634dfbe18c125f98a89: Status 404 returned error can't find the container with id c2e8e7c0f6eb83614da2fd32130cd62d7b7d16c68ca16634dfbe18c125f98a89 Jul 16 20:11:34.380382 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:34.380350 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" event={"ID":"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2","Type":"ContainerStarted","Data":"49e1ea3c1a1b683f70babfa144a45463774bb7cce4fcb3b6fa14ee316525c95c"} Jul 16 20:11:34.380382 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:34.380391 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" event={"ID":"36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2","Type":"ContainerStarted","Data":"c2e8e7c0f6eb83614da2fd32130cd62d7b7d16c68ca16634dfbe18c125f98a89"} Jul 16 20:11:34.399522 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:34.399469 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" podStartSLOduration=1.200741696 podStartE2EDuration="1.399450674s" totalImagesPullingTime="198.708978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:11:34.398184493 +0000 UTC m=+690.861537525" watchObservedRunningTime="2026-07-16 20:11:34.399450674 +0000 UTC m=+690.862803704" Jul 16 20:11:43.937312 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:43.937272 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:43.937731 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:43.937328 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:43.950238 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:43.950204 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:44.447779 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:44.447737 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl" Jul 16 20:11:45.065084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:11:45.065045 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:12:20.648102 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:20.648004 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:12:20.703442 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:20.703399 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:12:21.375885 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:21.375852 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77d4cfbbcc-pjts2"] Jul 16 20:12:21.378439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:21.378418 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77d4cfbbcc-pjts2" Jul 16 20:12:21.382033 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:21.382011 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nh77z\"" Jul 16 20:12:21.382176 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:21.382011 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 16 20:12:21.386459 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:21.385870 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77d4cfbbcc-pjts2"] Jul 16 20:12:21.410825 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:21.410782 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ed9c02e7-93fe-49df-9c08-44b13569f562-tls-cert\") pod \"authorino-77d4cfbbcc-pjts2\" (UID: \"ed9c02e7-93fe-49df-9c08-44b13569f562\") " pod="kuadrant-system/authorino-77d4cfbbcc-pjts2" Jul 16 20:12:21.411004 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:21.410854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlhp7\" (UniqueName: \"kubernetes.io/projected/ed9c02e7-93fe-49df-9c08-44b13569f562-kube-api-access-nlhp7\") pod \"authorino-77d4cfbbcc-pjts2\" (UID: \"ed9c02e7-93fe-49df-9c08-44b13569f562\") " pod="kuadrant-system/authorino-77d4cfbbcc-pjts2" Jul 16 20:12:21.511996 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:21.511960 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ed9c02e7-93fe-49df-9c08-44b13569f562-tls-cert\") pod \"authorino-77d4cfbbcc-pjts2\" (UID: \"ed9c02e7-93fe-49df-9c08-44b13569f562\") " pod="kuadrant-system/authorino-77d4cfbbcc-pjts2" Jul 16 20:12:21.511996 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:21.512003 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlhp7\" (UniqueName: \"kubernetes.io/projected/ed9c02e7-93fe-49df-9c08-44b13569f562-kube-api-access-nlhp7\") pod \"authorino-77d4cfbbcc-pjts2\" (UID: \"ed9c02e7-93fe-49df-9c08-44b13569f562\") " pod="kuadrant-system/authorino-77d4cfbbcc-pjts2" Jul 16 20:12:21.514611 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:21.514580 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ed9c02e7-93fe-49df-9c08-44b13569f562-tls-cert\") pod \"authorino-77d4cfbbcc-pjts2\" (UID: \"ed9c02e7-93fe-49df-9c08-44b13569f562\") " pod="kuadrant-system/authorino-77d4cfbbcc-pjts2" Jul 16 20:12:21.521417 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:21.521390 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlhp7\" (UniqueName: \"kubernetes.io/projected/ed9c02e7-93fe-49df-9c08-44b13569f562-kube-api-access-nlhp7\") pod \"authorino-77d4cfbbcc-pjts2\" (UID: \"ed9c02e7-93fe-49df-9c08-44b13569f562\") " pod="kuadrant-system/authorino-77d4cfbbcc-pjts2" Jul 16 20:12:21.689608 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:21.689520 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77d4cfbbcc-pjts2" Jul 16 20:12:21.839192 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:21.839165 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77d4cfbbcc-pjts2"] Jul 16 20:12:21.841386 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:12:21.841348 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded9c02e7_93fe_49df_9c08_44b13569f562.slice/crio-e525ae6f2433de5075e292c1d1c5550d1b53c82db917fa1dee7a2a41d3fb582c WatchSource:0}: Error finding container e525ae6f2433de5075e292c1d1c5550d1b53c82db917fa1dee7a2a41d3fb582c: Status 404 returned error can't find the container with id e525ae6f2433de5075e292c1d1c5550d1b53c82db917fa1dee7a2a41d3fb582c Jul 16 20:12:22.633302 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:22.633259 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77d4cfbbcc-pjts2" event={"ID":"ed9c02e7-93fe-49df-9c08-44b13569f562","Type":"ContainerStarted","Data":"9d3fcc3016be3287b45ad2e3586c21201d28d173bb032572f8beed123ce73e43"} Jul 16 20:12:22.633462 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:22.633316 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77d4cfbbcc-pjts2" event={"ID":"ed9c02e7-93fe-49df-9c08-44b13569f562","Type":"ContainerStarted","Data":"e525ae6f2433de5075e292c1d1c5550d1b53c82db917fa1dee7a2a41d3fb582c"} Jul 16 20:12:22.653291 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:22.653226 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-77d4cfbbcc-pjts2" podStartSLOduration=1.175775517 podStartE2EDuration="1.653201477s" totalImagesPullingTime="477.42596ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:12:22.651725794 +0000 UTC m=+739.115078826" watchObservedRunningTime="2026-07-16 20:12:22.653201477 +0000 UTC m=+739.116554508" Jul 16 20:12:23.323025 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:23.322985 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:12:23.476242 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:23.476197 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:12:24.443279 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:24.443243 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:12:24.541598 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:24.541562 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:12:33.174216 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:12:33.174177 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:13:03.927408 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:03.927357 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:13:09.281854 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.281811 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-vclch"] Jul 16 20:13:09.282425 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.282089 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" podUID="b01e1d5c-8479-4fef-a993-20e494ed738c" containerName="manager" containerID="cri-o://3a4d87f2ac349cfdd542992988d4f19b9047f044379d420a9b305b7ed40d7813" gracePeriod=30 Jul 16 20:13:09.548649 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.548567 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" Jul 16 20:13:09.572099 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.572067 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jhc6\" (UniqueName: \"kubernetes.io/projected/b01e1d5c-8479-4fef-a993-20e494ed738c-kube-api-access-9jhc6\") pod \"b01e1d5c-8479-4fef-a993-20e494ed738c\" (UID: \"b01e1d5c-8479-4fef-a993-20e494ed738c\") " Jul 16 20:13:09.572280 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.572179 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b01e1d5c-8479-4fef-a993-20e494ed738c-webhook-cert\") pod \"b01e1d5c-8479-4fef-a993-20e494ed738c\" (UID: \"b01e1d5c-8479-4fef-a993-20e494ed738c\") " Jul 16 20:13:09.574300 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.574260 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b01e1d5c-8479-4fef-a993-20e494ed738c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b01e1d5c-8479-4fef-a993-20e494ed738c" (UID: "b01e1d5c-8479-4fef-a993-20e494ed738c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:13:09.574599 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.574575 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b01e1d5c-8479-4fef-a993-20e494ed738c-kube-api-access-9jhc6" (OuterVolumeSpecName: "kube-api-access-9jhc6") pod "b01e1d5c-8479-4fef-a993-20e494ed738c" (UID: "b01e1d5c-8479-4fef-a993-20e494ed738c"). InnerVolumeSpecName "kube-api-access-9jhc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:13:09.673758 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.673716 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jhc6\" (UniqueName: \"kubernetes.io/projected/b01e1d5c-8479-4fef-a993-20e494ed738c-kube-api-access-9jhc6\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:13:09.673758 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.673750 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b01e1d5c-8479-4fef-a993-20e494ed738c-webhook-cert\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:13:09.884654 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.884615 2575 generic.go:356] "Generic (PLEG): container finished" podID="b01e1d5c-8479-4fef-a993-20e494ed738c" containerID="3a4d87f2ac349cfdd542992988d4f19b9047f044379d420a9b305b7ed40d7813" exitCode=0 Jul 16 20:13:09.884654 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.884658 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" event={"ID":"b01e1d5c-8479-4fef-a993-20e494ed738c","Type":"ContainerDied","Data":"3a4d87f2ac349cfdd542992988d4f19b9047f044379d420a9b305b7ed40d7813"} Jul 16 20:13:09.884958 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.884707 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" event={"ID":"b01e1d5c-8479-4fef-a993-20e494ed738c","Type":"ContainerDied","Data":"2da6bb23b45d1e2ba23193fc2a60928fbae1ebf3c63975257785ba605b158a82"} Jul 16 20:13:09.884958 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.884734 2575 scope.go:117] "RemoveContainer" containerID="3a4d87f2ac349cfdd542992988d4f19b9047f044379d420a9b305b7ed40d7813" Jul 16 20:13:09.884958 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.884661 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc6f6c9cc-vclch" Jul 16 20:13:09.896977 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.896948 2575 scope.go:117] "RemoveContainer" containerID="3a4d87f2ac349cfdd542992988d4f19b9047f044379d420a9b305b7ed40d7813" Jul 16 20:13:09.897503 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:13:09.897458 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4d87f2ac349cfdd542992988d4f19b9047f044379d420a9b305b7ed40d7813\": container with ID starting with 3a4d87f2ac349cfdd542992988d4f19b9047f044379d420a9b305b7ed40d7813 not found: ID does not exist" containerID="3a4d87f2ac349cfdd542992988d4f19b9047f044379d420a9b305b7ed40d7813" Jul 16 20:13:09.897601 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.897504 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4d87f2ac349cfdd542992988d4f19b9047f044379d420a9b305b7ed40d7813"} err="failed to get container status \"3a4d87f2ac349cfdd542992988d4f19b9047f044379d420a9b305b7ed40d7813\": rpc error: code = NotFound desc = could not find container \"3a4d87f2ac349cfdd542992988d4f19b9047f044379d420a9b305b7ed40d7813\": container with ID starting with 3a4d87f2ac349cfdd542992988d4f19b9047f044379d420a9b305b7ed40d7813 not found: ID does not exist" Jul 16 20:13:09.909712 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.909666 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-vclch"] Jul 16 20:13:09.912682 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:09.912655 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-vclch"] Jul 16 20:13:10.018674 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:13:10.018638 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b01e1d5c-8479-4fef-a993-20e494ed738c" path="/var/lib/kubelet/pods/b01e1d5c-8479-4fef-a993-20e494ed738c/volumes" Jul 16 20:14:10.685306 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.685271 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-6njdq"] Jul 16 20:14:10.685821 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.685676 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b01e1d5c-8479-4fef-a993-20e494ed738c" containerName="manager" Jul 16 20:14:10.685821 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.685688 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b01e1d5c-8479-4fef-a993-20e494ed738c" containerName="manager" Jul 16 20:14:10.685821 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.685753 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b01e1d5c-8479-4fef-a993-20e494ed738c" containerName="manager" Jul 16 20:14:10.688247 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.688231 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" Jul 16 20:14:10.692255 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.692231 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rd6cf\"" Jul 16 20:14:10.692255 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.692247 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 16 20:14:10.692255 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.692229 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 16 20:14:10.698115 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.698090 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-6njdq"] Jul 16 20:14:10.737292 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.737245 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79jlr\" (UniqueName: \"kubernetes.io/projected/6c753f36-f898-498a-b8cf-6fe61c5fc6f5-kube-api-access-79jlr\") pod \"maas-controller-6cc6f6c9cc-6njdq\" (UID: \"6c753f36-f898-498a-b8cf-6fe61c5fc6f5\") " pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" Jul 16 20:14:10.737479 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.737307 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c753f36-f898-498a-b8cf-6fe61c5fc6f5-webhook-cert\") pod \"maas-controller-6cc6f6c9cc-6njdq\" (UID: \"6c753f36-f898-498a-b8cf-6fe61c5fc6f5\") " pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" Jul 16 20:14:10.838747 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.838710 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c753f36-f898-498a-b8cf-6fe61c5fc6f5-webhook-cert\") pod \"maas-controller-6cc6f6c9cc-6njdq\" (UID: \"6c753f36-f898-498a-b8cf-6fe61c5fc6f5\") " pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" Jul 16 20:14:10.838958 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.838851 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79jlr\" (UniqueName: \"kubernetes.io/projected/6c753f36-f898-498a-b8cf-6fe61c5fc6f5-kube-api-access-79jlr\") pod \"maas-controller-6cc6f6c9cc-6njdq\" (UID: \"6c753f36-f898-498a-b8cf-6fe61c5fc6f5\") " pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" Jul 16 20:14:10.841314 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.841288 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c753f36-f898-498a-b8cf-6fe61c5fc6f5-webhook-cert\") pod \"maas-controller-6cc6f6c9cc-6njdq\" (UID: \"6c753f36-f898-498a-b8cf-6fe61c5fc6f5\") " pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" Jul 16 20:14:10.848305 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.848279 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79jlr\" (UniqueName: \"kubernetes.io/projected/6c753f36-f898-498a-b8cf-6fe61c5fc6f5-kube-api-access-79jlr\") pod \"maas-controller-6cc6f6c9cc-6njdq\" (UID: \"6c753f36-f898-498a-b8cf-6fe61c5fc6f5\") " pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" Jul 16 20:14:10.999908 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:10.999806 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" Jul 16 20:14:11.145895 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:11.145864 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-6njdq"] Jul 16 20:14:11.148608 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:14:11.148580 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c753f36_f898_498a_b8cf_6fe61c5fc6f5.slice/crio-41a9d2527ab6288956897a632f6d7a84933ae155e202e3b82471d2320fd2061d WatchSource:0}: Error finding container 41a9d2527ab6288956897a632f6d7a84933ae155e202e3b82471d2320fd2061d: Status 404 returned error can't find the container with id 41a9d2527ab6288956897a632f6d7a84933ae155e202e3b82471d2320fd2061d Jul 16 20:14:11.208243 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:11.208208 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" event={"ID":"6c753f36-f898-498a-b8cf-6fe61c5fc6f5","Type":"ContainerStarted","Data":"41a9d2527ab6288956897a632f6d7a84933ae155e202e3b82471d2320fd2061d"} Jul 16 20:14:12.221901 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:12.221857 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" event={"ID":"6c753f36-f898-498a-b8cf-6fe61c5fc6f5","Type":"ContainerStarted","Data":"b58a8cef962e08052e14d11b923c3e8f49db239d3c7a2da59284f199f6308581"} Jul 16 20:14:12.222361 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:12.221998 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" Jul 16 20:14:12.239267 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:12.239207 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" podStartSLOduration=1.766603347 podStartE2EDuration="2.23918875s" totalImagesPullingTime="472.585403ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:14:12.238529215 +0000 UTC m=+848.701882250" watchObservedRunningTime="2026-07-16 20:14:12.23918875 +0000 UTC m=+848.702541809" Jul 16 20:14:23.229960 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:23.229924 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" Jul 16 20:14:27.774537 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:27.774496 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:14:27.867280 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:27.867246 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-6njdq"] Jul 16 20:14:27.867493 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:27.867467 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" podUID="6c753f36-f898-498a-b8cf-6fe61c5fc6f5" containerName="manager" containerID="cri-o://b58a8cef962e08052e14d11b923c3e8f49db239d3c7a2da59284f199f6308581" gracePeriod=30 Jul 16 20:14:28.119264 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.119235 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" Jul 16 20:14:28.302874 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.302779 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79jlr\" (UniqueName: \"kubernetes.io/projected/6c753f36-f898-498a-b8cf-6fe61c5fc6f5-kube-api-access-79jlr\") pod \"6c753f36-f898-498a-b8cf-6fe61c5fc6f5\" (UID: \"6c753f36-f898-498a-b8cf-6fe61c5fc6f5\") " Jul 16 20:14:28.303038 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.302925 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c753f36-f898-498a-b8cf-6fe61c5fc6f5-webhook-cert\") pod \"6c753f36-f898-498a-b8cf-6fe61c5fc6f5\" (UID: \"6c753f36-f898-498a-b8cf-6fe61c5fc6f5\") " Jul 16 20:14:28.305070 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.305036 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c753f36-f898-498a-b8cf-6fe61c5fc6f5-kube-api-access-79jlr" (OuterVolumeSpecName: "kube-api-access-79jlr") pod "6c753f36-f898-498a-b8cf-6fe61c5fc6f5" (UID: "6c753f36-f898-498a-b8cf-6fe61c5fc6f5"). InnerVolumeSpecName "kube-api-access-79jlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:14:28.305198 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.305068 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c753f36-f898-498a-b8cf-6fe61c5fc6f5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6c753f36-f898-498a-b8cf-6fe61c5fc6f5" (UID: "6c753f36-f898-498a-b8cf-6fe61c5fc6f5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:14:28.308473 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.308443 2575 generic.go:356] "Generic (PLEG): container finished" podID="6c753f36-f898-498a-b8cf-6fe61c5fc6f5" containerID="b58a8cef962e08052e14d11b923c3e8f49db239d3c7a2da59284f199f6308581" exitCode=0 Jul 16 20:14:28.308567 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.308493 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" Jul 16 20:14:28.308567 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.308524 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" event={"ID":"6c753f36-f898-498a-b8cf-6fe61c5fc6f5","Type":"ContainerDied","Data":"b58a8cef962e08052e14d11b923c3e8f49db239d3c7a2da59284f199f6308581"} Jul 16 20:14:28.308638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.308579 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc6f6c9cc-6njdq" event={"ID":"6c753f36-f898-498a-b8cf-6fe61c5fc6f5","Type":"ContainerDied","Data":"41a9d2527ab6288956897a632f6d7a84933ae155e202e3b82471d2320fd2061d"} Jul 16 20:14:28.308638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.308602 2575 scope.go:117] "RemoveContainer" containerID="b58a8cef962e08052e14d11b923c3e8f49db239d3c7a2da59284f199f6308581" Jul 16 20:14:28.326210 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.326189 2575 scope.go:117] "RemoveContainer" containerID="b58a8cef962e08052e14d11b923c3e8f49db239d3c7a2da59284f199f6308581" Jul 16 20:14:28.326555 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:14:28.326526 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b58a8cef962e08052e14d11b923c3e8f49db239d3c7a2da59284f199f6308581\": container with ID starting with b58a8cef962e08052e14d11b923c3e8f49db239d3c7a2da59284f199f6308581 not found: ID does not exist" containerID="b58a8cef962e08052e14d11b923c3e8f49db239d3c7a2da59284f199f6308581" Jul 16 20:14:28.326650 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.326564 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b58a8cef962e08052e14d11b923c3e8f49db239d3c7a2da59284f199f6308581"} err="failed to get container status \"b58a8cef962e08052e14d11b923c3e8f49db239d3c7a2da59284f199f6308581\": rpc error: code = NotFound desc = could not find container \"b58a8cef962e08052e14d11b923c3e8f49db239d3c7a2da59284f199f6308581\": container with ID starting with b58a8cef962e08052e14d11b923c3e8f49db239d3c7a2da59284f199f6308581 not found: ID does not exist" Jul 16 20:14:28.337387 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.337355 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-6njdq"] Jul 16 20:14:28.341446 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.341418 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-6njdq"] Jul 16 20:14:28.403725 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.403688 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79jlr\" (UniqueName: \"kubernetes.io/projected/6c753f36-f898-498a-b8cf-6fe61c5fc6f5-kube-api-access-79jlr\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:14:28.403725 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.403719 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c753f36-f898-498a-b8cf-6fe61c5fc6f5-webhook-cert\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:14:28.988114 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:28.988073 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:14:29.103438 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.103403 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-hjtnc"] Jul 16 20:14:29.103877 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.103863 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c753f36-f898-498a-b8cf-6fe61c5fc6f5" containerName="manager" Jul 16 20:14:29.103941 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.103880 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c753f36-f898-498a-b8cf-6fe61c5fc6f5" containerName="manager" Jul 16 20:14:29.103941 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.103940 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c753f36-f898-498a-b8cf-6fe61c5fc6f5" containerName="manager" Jul 16 20:14:29.106880 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.106863 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc6f6c9cc-hjtnc" Jul 16 20:14:29.109533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.109512 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rd6cf\"" Jul 16 20:14:29.110735 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.110709 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 16 20:14:29.110882 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.110723 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 16 20:14:29.119806 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.119736 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-hjtnc"] Jul 16 20:14:29.211133 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.211092 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ed584e7-82e8-4a64-aaa2-7717f39a7529-webhook-cert\") pod \"maas-controller-6cc6f6c9cc-hjtnc\" (UID: \"9ed584e7-82e8-4a64-aaa2-7717f39a7529\") " pod="opendatahub/maas-controller-6cc6f6c9cc-hjtnc" Jul 16 20:14:29.211133 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.211133 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5dpf\" (UniqueName: \"kubernetes.io/projected/9ed584e7-82e8-4a64-aaa2-7717f39a7529-kube-api-access-k5dpf\") pod \"maas-controller-6cc6f6c9cc-hjtnc\" (UID: \"9ed584e7-82e8-4a64-aaa2-7717f39a7529\") " pod="opendatahub/maas-controller-6cc6f6c9cc-hjtnc" Jul 16 20:14:29.312092 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.312004 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ed584e7-82e8-4a64-aaa2-7717f39a7529-webhook-cert\") pod \"maas-controller-6cc6f6c9cc-hjtnc\" (UID: \"9ed584e7-82e8-4a64-aaa2-7717f39a7529\") " pod="opendatahub/maas-controller-6cc6f6c9cc-hjtnc" Jul 16 20:14:29.312092 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.312040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5dpf\" (UniqueName: \"kubernetes.io/projected/9ed584e7-82e8-4a64-aaa2-7717f39a7529-kube-api-access-k5dpf\") pod \"maas-controller-6cc6f6c9cc-hjtnc\" (UID: \"9ed584e7-82e8-4a64-aaa2-7717f39a7529\") " pod="opendatahub/maas-controller-6cc6f6c9cc-hjtnc" Jul 16 20:14:29.314710 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.314679 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ed584e7-82e8-4a64-aaa2-7717f39a7529-webhook-cert\") pod \"maas-controller-6cc6f6c9cc-hjtnc\" (UID: \"9ed584e7-82e8-4a64-aaa2-7717f39a7529\") " pod="opendatahub/maas-controller-6cc6f6c9cc-hjtnc" Jul 16 20:14:29.322451 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.322425 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5dpf\" (UniqueName: \"kubernetes.io/projected/9ed584e7-82e8-4a64-aaa2-7717f39a7529-kube-api-access-k5dpf\") pod \"maas-controller-6cc6f6c9cc-hjtnc\" (UID: \"9ed584e7-82e8-4a64-aaa2-7717f39a7529\") " pod="opendatahub/maas-controller-6cc6f6c9cc-hjtnc" Jul 16 20:14:29.417821 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.417756 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc6f6c9cc-hjtnc" Jul 16 20:14:29.565490 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:29.564883 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cc6f6c9cc-hjtnc"] Jul 16 20:14:29.568149 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:14:29.568100 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed584e7_82e8_4a64_aaa2_7717f39a7529.slice/crio-94fd8fbfe652a6c061aea12eb6e41e802195a3a12a24657b0207ca71ec26b742 WatchSource:0}: Error finding container 94fd8fbfe652a6c061aea12eb6e41e802195a3a12a24657b0207ca71ec26b742: Status 404 returned error can't find the container with id 94fd8fbfe652a6c061aea12eb6e41e802195a3a12a24657b0207ca71ec26b742 Jul 16 20:14:30.025999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:30.025954 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c753f36-f898-498a-b8cf-6fe61c5fc6f5" path="/var/lib/kubelet/pods/6c753f36-f898-498a-b8cf-6fe61c5fc6f5/volumes" Jul 16 20:14:30.323194 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:30.323087 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc6f6c9cc-hjtnc" event={"ID":"9ed584e7-82e8-4a64-aaa2-7717f39a7529","Type":"ContainerStarted","Data":"16721f737b27e48305056fa1459da2fede71223b04a7b4f617e63516f52b113e"} Jul 16 20:14:30.323194 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:30.323159 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc6f6c9cc-hjtnc" event={"ID":"9ed584e7-82e8-4a64-aaa2-7717f39a7529","Type":"ContainerStarted","Data":"94fd8fbfe652a6c061aea12eb6e41e802195a3a12a24657b0207ca71ec26b742"} Jul 16 20:14:30.323431 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:30.323238 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cc6f6c9cc-hjtnc" Jul 16 20:14:30.344393 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:30.344327 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cc6f6c9cc-hjtnc" podStartSLOduration=1.018875739 podStartE2EDuration="1.344310831s" totalImagesPullingTime="325.435092ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:14:30.342033268 +0000 UTC m=+866.805386329" watchObservedRunningTime="2026-07-16 20:14:30.344310831 +0000 UTC m=+866.807663862" Jul 16 20:14:41.330802 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:41.330749 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cc6f6c9cc-hjtnc" Jul 16 20:14:54.594079 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:54.594025 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:14:54.697178 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:14:54.697137 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:15:03.457323 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:15:03.457237 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:15:03.551995 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:15:03.551961 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:15:03.717647 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:15:03.717554 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:15:03.999442 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:15:03.999350 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:15:03.999624 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:15:03.999500 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:15:10.035145 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:15:10.035106 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:15:10.144936 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:15:10.144893 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:15:10.241922 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:15:10.241883 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:15:10.446078 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:15:10.446040 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:15:10.866003 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:15:10.865966 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:15:10.978638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:15:10.978599 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:15:16.354529 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:15:16.354464 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:15:18.142949 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:15:18.142904 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:16:47.403578 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:16:47.403537 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:18:20.176069 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:18:20.175978 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:18:54.819531 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:18:54.819490 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:20:04.036464 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:20:04.036432 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:20:04.042394 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:20:04.042370 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:20:30.568166 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:20:30.568131 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:20:31.884495 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:20:31.884460 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:21:18.658400 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:18.658311 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2"] Jul 16 20:21:18.660997 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:18.658580 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" podUID="a1b8438a-93e7-4b29-a699-fdb30d06ce00" containerName="manager" containerID="cri-o://e29415f77978090a944a35546fd3ab00a9f5344d8077d9c53a941315b0b7d9c3" gracePeriod=10 Jul 16 20:21:22.225419 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.225395 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" Jul 16 20:21:22.316292 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.316200 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2ctp\" (UniqueName: \"kubernetes.io/projected/a1b8438a-93e7-4b29-a699-fdb30d06ce00-kube-api-access-s2ctp\") pod \"a1b8438a-93e7-4b29-a699-fdb30d06ce00\" (UID: \"a1b8438a-93e7-4b29-a699-fdb30d06ce00\") " Jul 16 20:21:22.316440 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.316321 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1b8438a-93e7-4b29-a699-fdb30d06ce00-extensions-socket-volume\") pod \"a1b8438a-93e7-4b29-a699-fdb30d06ce00\" (UID: \"a1b8438a-93e7-4b29-a699-fdb30d06ce00\") " Jul 16 20:21:22.316733 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.316707 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1b8438a-93e7-4b29-a699-fdb30d06ce00-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a1b8438a-93e7-4b29-a699-fdb30d06ce00" (UID: "a1b8438a-93e7-4b29-a699-fdb30d06ce00"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:21:22.318422 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.318400 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1b8438a-93e7-4b29-a699-fdb30d06ce00-kube-api-access-s2ctp" (OuterVolumeSpecName: "kube-api-access-s2ctp") pod "a1b8438a-93e7-4b29-a699-fdb30d06ce00" (UID: "a1b8438a-93e7-4b29-a699-fdb30d06ce00"). InnerVolumeSpecName "kube-api-access-s2ctp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:21:22.417949 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.417911 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2ctp\" (UniqueName: \"kubernetes.io/projected/a1b8438a-93e7-4b29-a699-fdb30d06ce00-kube-api-access-s2ctp\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:21:22.417949 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.417945 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1b8438a-93e7-4b29-a699-fdb30d06ce00-extensions-socket-volume\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:21:22.539996 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.539959 2575 generic.go:356] "Generic (PLEG): container finished" podID="a1b8438a-93e7-4b29-a699-fdb30d06ce00" containerID="e29415f77978090a944a35546fd3ab00a9f5344d8077d9c53a941315b0b7d9c3" exitCode=0 Jul 16 20:21:22.539996 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.540001 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" Jul 16 20:21:22.540208 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.540046 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" event={"ID":"a1b8438a-93e7-4b29-a699-fdb30d06ce00","Type":"ContainerDied","Data":"e29415f77978090a944a35546fd3ab00a9f5344d8077d9c53a941315b0b7d9c3"} Jul 16 20:21:22.540208 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.540099 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2" event={"ID":"a1b8438a-93e7-4b29-a699-fdb30d06ce00","Type":"ContainerDied","Data":"e1d17a99991044213bff11645af862d779b7a8f07630ca1a9c73ede62e5ce058"} Jul 16 20:21:22.540208 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.540138 2575 scope.go:117] "RemoveContainer" containerID="e29415f77978090a944a35546fd3ab00a9f5344d8077d9c53a941315b0b7d9c3" Jul 16 20:21:22.550588 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.550567 2575 scope.go:117] "RemoveContainer" containerID="e29415f77978090a944a35546fd3ab00a9f5344d8077d9c53a941315b0b7d9c3" Jul 16 20:21:22.550927 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:21:22.550895 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e29415f77978090a944a35546fd3ab00a9f5344d8077d9c53a941315b0b7d9c3\": container with ID starting with e29415f77978090a944a35546fd3ab00a9f5344d8077d9c53a941315b0b7d9c3 not found: ID does not exist" containerID="e29415f77978090a944a35546fd3ab00a9f5344d8077d9c53a941315b0b7d9c3" Jul 16 20:21:22.550983 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.550937 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e29415f77978090a944a35546fd3ab00a9f5344d8077d9c53a941315b0b7d9c3"} err="failed to get container status \"e29415f77978090a944a35546fd3ab00a9f5344d8077d9c53a941315b0b7d9c3\": rpc error: code = NotFound desc = could not find container \"e29415f77978090a944a35546fd3ab00a9f5344d8077d9c53a941315b0b7d9c3\": container with ID starting with e29415f77978090a944a35546fd3ab00a9f5344d8077d9c53a941315b0b7d9c3 not found: ID does not exist" Jul 16 20:21:22.564040 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.563999 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2"] Jul 16 20:21:22.570400 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:22.570324 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2nwt2"] Jul 16 20:21:24.019240 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:21:24.019206 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1b8438a-93e7-4b29-a699-fdb30d06ce00" path="/var/lib/kubelet/pods/a1b8438a-93e7-4b29-a699-fdb30d06ce00/volumes" Jul 16 20:22:19.753292 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:19.753257 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66"] Jul 16 20:22:19.753734 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:19.753701 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b8438a-93e7-4b29-a699-fdb30d06ce00" containerName="manager" Jul 16 20:22:19.753734 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:19.753713 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b8438a-93e7-4b29-a699-fdb30d06ce00" containerName="manager" Jul 16 20:22:19.753842 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:19.753792 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b8438a-93e7-4b29-a699-fdb30d06ce00" containerName="manager" Jul 16 20:22:19.757927 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:19.757907 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66" Jul 16 20:22:19.760824 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:19.760797 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-42wrl\"" Jul 16 20:22:19.769725 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:19.769698 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66"] Jul 16 20:22:19.850243 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:19.850202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2cgq\" (UniqueName: \"kubernetes.io/projected/10ced9a1-b9c3-4035-a904-d4fb44ff86c7-kube-api-access-d2cgq\") pod \"kuadrant-operator-controller-manager-86878c769f-pmm66\" (UID: \"10ced9a1-b9c3-4035-a904-d4fb44ff86c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66" Jul 16 20:22:19.850439 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:19.850334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ced9a1-b9c3-4035-a904-d4fb44ff86c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pmm66\" (UID: \"10ced9a1-b9c3-4035-a904-d4fb44ff86c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66" Jul 16 20:22:19.950998 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:19.950954 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ced9a1-b9c3-4035-a904-d4fb44ff86c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pmm66\" (UID: \"10ced9a1-b9c3-4035-a904-d4fb44ff86c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66" Jul 16 20:22:19.951177 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:19.951020 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2cgq\" (UniqueName: \"kubernetes.io/projected/10ced9a1-b9c3-4035-a904-d4fb44ff86c7-kube-api-access-d2cgq\") pod \"kuadrant-operator-controller-manager-86878c769f-pmm66\" (UID: \"10ced9a1-b9c3-4035-a904-d4fb44ff86c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66" Jul 16 20:22:19.951314 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:19.951293 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ced9a1-b9c3-4035-a904-d4fb44ff86c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pmm66\" (UID: \"10ced9a1-b9c3-4035-a904-d4fb44ff86c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66" Jul 16 20:22:19.959376 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:19.959348 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2cgq\" (UniqueName: \"kubernetes.io/projected/10ced9a1-b9c3-4035-a904-d4fb44ff86c7-kube-api-access-d2cgq\") pod \"kuadrant-operator-controller-manager-86878c769f-pmm66\" (UID: \"10ced9a1-b9c3-4035-a904-d4fb44ff86c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66" Jul 16 20:22:20.069707 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:20.069616 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66" Jul 16 20:22:20.222213 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:20.222176 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66"] Jul 16 20:22:20.224051 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:22:20.224027 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ced9a1_b9c3_4035_a904_d4fb44ff86c7.slice/crio-8917c6064cc14cedbd3980056707bfb169b5fea92125f673731b76406abb4a65 WatchSource:0}: Error finding container 8917c6064cc14cedbd3980056707bfb169b5fea92125f673731b76406abb4a65: Status 404 returned error can't find the container with id 8917c6064cc14cedbd3980056707bfb169b5fea92125f673731b76406abb4a65 Jul 16 20:22:20.833851 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:20.833814 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66" event={"ID":"10ced9a1-b9c3-4035-a904-d4fb44ff86c7","Type":"ContainerStarted","Data":"3c970c7bf8cf7d709ef965e4130549a975d34fd212908949ca5450c20a192211"} Jul 16 20:22:20.834271 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:20.833870 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66" event={"ID":"10ced9a1-b9c3-4035-a904-d4fb44ff86c7","Type":"ContainerStarted","Data":"8917c6064cc14cedbd3980056707bfb169b5fea92125f673731b76406abb4a65"} Jul 16 20:22:20.834271 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:20.833896 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66" Jul 16 20:22:20.866810 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:20.866743 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66" podStartSLOduration=1.8667258329999998 podStartE2EDuration="1.866725833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:22:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:22:20.866049225 +0000 UTC m=+1337.329402258" watchObservedRunningTime="2026-07-16 20:22:20.866725833 +0000 UTC m=+1337.330078864" Jul 16 20:22:31.841411 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:22:31.841333 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pmm66" Jul 16 20:24:36.189791 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:24:36.189743 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:25:04.078815 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:25:04.078784 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:25:04.082877 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:25:04.082851 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:25:34.440317 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:25:34.440277 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:26:23.438476 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:26:23.438432 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:26:34.557644 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:26:34.557596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:22.094087 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:22.094046 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:28.552224 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:28.552130 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:36.789450 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:36.789409 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:41.883427 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:41.883389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:44.725819 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:44.725751 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:44.826445 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:44.826399 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:45.193950 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:45.193916 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:51.353623 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:51.353586 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:51.455309 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:51.455272 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:51.555711 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:51.555672 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:51.657338 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:51.657236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:52.838369 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:52.838334 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:53.650534 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:53.650486 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:53.752112 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:53.752072 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:28:55.516617 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:28:55.516557 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:19.377026 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:19.376984 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:28.138975 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:28.138933 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:32.759144 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:32.759102 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:38.493924 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:38.493877 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:38.591773 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:38.591734 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:42.949704 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:42.949656 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:44.051135 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:44.051095 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:44.203835 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:44.203793 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:44.881552 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:44.881510 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:45.139204 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:45.139090 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:45.463952 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:45.463864 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:45.687686 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:45.687647 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:45.784756 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:45.784666 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:49.265045 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:49.265004 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:49.330273 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:49.330215 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:50.802575 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:50.802533 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:50.903599 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:50.903542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:29:52.995140 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:29:52.995101 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:30:04.110150 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:30:04.110118 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:30:04.115367 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:30:04.115345 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:30:10.772776 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:30:10.772735 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:30:10.875270 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:30:10.875229 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:30:49.444541 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:30:49.444503 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:30:57.329501 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:30:57.329440 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:30:57.431264 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:30:57.431218 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:31:01.698537 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:31:01.698503 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:31:01.801672 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:31:01.801573 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:31:05.293270 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:31:05.293223 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:31:05.351557 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:31:05.351525 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:31:05.424840 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:31:05.424754 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:08.612621 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:08.612567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:13.250456 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:13.250421 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:19.101099 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:19.101060 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:19.204983 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:19.204944 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:24.526994 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:24.526950 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:24.699926 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:24.699880 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:25.796630 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:25.796580 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:25.942117 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:25.942057 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:26.099036 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:26.098996 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:26.524476 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:26.524382 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:26.624645 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:26.624609 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:26.726449 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:26.726413 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:31.985601 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:31.985561 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:32.046828 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:32.046793 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:32:35.286402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:32:35.286372 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:30.904491 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:30.904440 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:35.318781 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:35.318719 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:41.298359 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:41.298322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:41.397803 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:41.397756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:45.498825 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:45.498789 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:46.062749 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:46.062708 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:46.155568 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:46.155534 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:46.255541 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:46.255501 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:47.643404 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:47.643366 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:52.192214 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:52.192175 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:53.436569 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:53.436526 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:53.543469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:53.543412 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:53.637409 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:53.637375 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:53.736915 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:53.736828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:54.134030 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:33:54.133993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:20.089698 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:34:20.089652 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:24.755186 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:34:24.755147 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:25.876804 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:34:25.876704 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:25.991692 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:34:25.991653 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:26.079035 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:34:26.078996 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:41.902142 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:34:41.902103 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:47.734163 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:34:47.734129 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:47.836587 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:34:47.836549 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:47.934105 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:34:47.934063 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:51.532394 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:34:51.532330 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:51.629244 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:34:51.629204 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:58.447484 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:34:58.447448 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:59.245269 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:34:59.245235 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:04.141942 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:04.141910 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:35:04.149277 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:04.149252 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:35:05.130518 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:05.130453 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:05.199220 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:05.199180 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:05.284196 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:05.284155 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:05.383075 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:05.382975 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:05.483123 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:05.483087 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:06.138899 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:06.138857 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:06.237894 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:06.237850 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:06.747255 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:06.747223 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:07.864159 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:07.864123 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:13.811779 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:13.811731 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:13.888290 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:13.888244 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:14.469374 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:14.469330 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:20.322800 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:20.322724 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:20.393477 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:20.393442 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:20.549081 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:20.549041 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:20.847643 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:20.847609 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:21.139346 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:21.139256 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:24.142347 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:24.142306 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:24.230906 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:24.230871 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:24.304391 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:24.304355 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:24.406804 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:24.406690 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:24.811456 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:24.811360 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:24.912892 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:24.912853 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:28.606663 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:28.606626 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:29.336744 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:29.336712 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:29.465334 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:29.465296 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:29.723011 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:29.722928 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:35.411307 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:35.411263 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:35.511249 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:35.511210 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:46.215517 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:46.215480 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:50.849148 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:50.849104 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:56.827965 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:56.827869 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:58.156607 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:35:58.156575 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:01.506429 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:01.506395 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:01.767722 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:01.767624 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:01.889330 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:01.889268 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:01.968448 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:01.968415 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:02.068523 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:02.068425 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:08.361207 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:08.361169 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:08.466490 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:08.466448 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:08.568721 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:08.568690 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:10.001859 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:10.001819 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:15.624629 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:15.624586 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:15.728408 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:15.728369 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:21.335708 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:21.335656 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:21.636503 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:21.636371 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:22.110699 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:22.110650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:24.391459 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:24.391422 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:24.493613 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:24.493578 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:24.611120 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:24.611088 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:25.182626 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:25.182595 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:25.308132 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:25.308091 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:26.388598 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:26.388562 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:28.851326 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:28.851281 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:34.420049 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:36:34.420000 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:12.247685 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:37:12.247639 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:16.889689 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:37:16.889649 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:21.967120 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:37:21.967061 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:58.907280 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:37:58.907239 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:59.047876 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:37:59.047843 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:04.600695 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:04.600661 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:04.701182 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:04.701148 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:09.046757 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:09.046721 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:09.537863 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:09.537830 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:10.309360 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:10.309323 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:10.408807 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:10.408751 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:10.537716 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:10.537670 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:11.192414 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:11.192378 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:11.291277 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:11.291222 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:11.390867 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:11.390826 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:12.722551 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:12.722516 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:18.565303 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:18.565263 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:18.664931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:18.664891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:19.241101 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:19.241059 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:24.950087 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:24.950048 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:25.053356 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:25.053311 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:25.149853 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:25.149816 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:35.695569 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:35.695533 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:35.954454 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:35.954366 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:41.320187 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:41.320151 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:41.421467 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:41.421430 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:56.901721 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:38:56.901623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:02.812292 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:02.812248 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:02.874476 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:02.874441 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:03.177999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:03.177965 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:03.494494 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:03.494398 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:04.360276 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:04.360231 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:06.203197 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:06.203152 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:06.299969 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:06.299933 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:06.425756 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:06.425718 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:06.683191 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:06.683149 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:06.950056 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:06.949964 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:07.051773 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:07.051725 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:10.673192 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:10.673161 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:10.983248 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:10.983152 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:11.246510 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.246413 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv"] Jul 16 20:39:11.250326 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.250302 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.253039 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.253016 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e69c2e-openshift-default-dockercfg-pggvp\"" Jul 16 20:39:11.262827 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.262802 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv"] Jul 16 20:39:11.279574 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.279541 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:11.400594 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.400554 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-credential-socket\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.400594 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.400592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-envoy\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.400838 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.400614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-workload-socket\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.400838 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.400636 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-workload-certs\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.400838 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.400658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-podinfo\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.400838 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.400675 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptzj8\" (UniqueName: \"kubernetes.io/projected/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-kube-api-access-ptzj8\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.400838 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.400701 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istiod-ca-cert\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.400838 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.400823 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-token\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.401082 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.400956 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-data\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.502231 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.502131 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-token\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.502231 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.502203 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-data\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.502456 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.502258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-credential-socket\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.502456 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.502281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-envoy\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.502456 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.502309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-workload-socket\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.502456 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.502393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-workload-certs\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.502456 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.502439 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-podinfo\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.502714 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.502469 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzj8\" (UniqueName: \"kubernetes.io/projected/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-kube-api-access-ptzj8\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.502714 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.502512 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istiod-ca-cert\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.502714 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.502641 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-data\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.502714 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.502665 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-workload-socket\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.502968 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.502720 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-credential-socket\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.503033 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.502976 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-workload-certs\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.503340 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.503318 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istiod-ca-cert\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.504593 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.504571 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-envoy\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.504873 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.504855 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-podinfo\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.510321 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.510295 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-token\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.510413 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.510369 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzj8\" (UniqueName: \"kubernetes.io/projected/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-kube-api-access-ptzj8\") pod \"e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.564507 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.564458 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:11.717867 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.715698 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv"] Jul 16 20:39:11.720863 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:39:11.720825 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4f36a2_f9b3_4cb4_8c28_d2d1979340f4.slice/crio-72a805af3c22d891a92191a7f5027835a4be86cb64cbfbcb137802028e5e7d6c WatchSource:0}: Error finding container 72a805af3c22d891a92191a7f5027835a4be86cb64cbfbcb137802028e5e7d6c: Status 404 returned error can't find the container with id 72a805af3c22d891a92191a7f5027835a4be86cb64cbfbcb137802028e5e7d6c Jul 16 20:39:11.723489 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.723456 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:39:11.723574 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.723527 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:39:11.723574 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.723556 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:39:11.732686 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:11.732615 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:12.166884 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:12.166853 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" event={"ID":"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4","Type":"ContainerStarted","Data":"17256b18756e6f5fb9b8843da3296203fce383a154e698272420d8296a2497c2"} Jul 16 20:39:12.167095 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:12.166902 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" event={"ID":"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4","Type":"ContainerStarted","Data":"72a805af3c22d891a92191a7f5027835a4be86cb64cbfbcb137802028e5e7d6c"} Jul 16 20:39:12.190045 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:12.189993 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" podStartSLOduration=1.1899759030000001 podStartE2EDuration="1.189975903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:39:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:39:12.187142625 +0000 UTC m=+2348.650495656" watchObservedRunningTime="2026-07-16 20:39:12.189975903 +0000 UTC m=+2348.653328936" Jul 16 20:39:12.565323 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:12.565234 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:12.569918 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:12.569891 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:13.172268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:13.172241 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:13.173288 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:13.173267 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:14.083792 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:14.083730 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:14.181347 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:14.181315 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:14.328331 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:14.328292 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:14.713716 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:14.713665 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:14.809654 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:14.809601 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:14.910380 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:14.910339 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:15.010348 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:15.010255 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:18.593148 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:18.593112 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:28.174122 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:28.174081 2575 patch_prober.go:28] interesting pod/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 16 20:39:28.174547 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:28.174159 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" podUID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 16 20:39:28.260212 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:28.260179 2575 generic.go:356] "Generic (PLEG): container finished" podID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerID="17256b18756e6f5fb9b8843da3296203fce383a154e698272420d8296a2497c2" exitCode=0 Jul 16 20:39:28.260395 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:28.260261 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" event={"ID":"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4","Type":"ContainerDied","Data":"17256b18756e6f5fb9b8843da3296203fce383a154e698272420d8296a2497c2"} Jul 16 20:39:28.260715 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:28.260697 2575 scope.go:117] "RemoveContainer" containerID="17256b18756e6f5fb9b8843da3296203fce383a154e698272420d8296a2497c2" Jul 16 20:39:28.261887 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:28.261848 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:39:28.261984 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:28.261944 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:39:28.262025 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:28.261991 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:39:28.755335 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:28.755278 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:28.851014 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:28.850977 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:29.267976 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:29.267939 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" event={"ID":"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4","Type":"ContainerStarted","Data":"4d60fc1beb1076d948efad0c84c355823f59b67542f0133144d9c14ce1d7afc5"} Jul 16 20:39:29.564912 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:29.564814 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:29.565101 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:29.565075 2575 patch_prober.go:28] interesting pod/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 16 20:39:29.565145 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:29.565127 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" podUID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 16 20:39:30.565754 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:30.565715 2575 patch_prober.go:28] interesting pod/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 16 20:39:30.566228 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:30.565817 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" podUID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 16 20:39:31.565775 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:31.565735 2575 patch_prober.go:28] interesting pod/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 16 20:39:31.565964 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:31.565831 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" podUID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 16 20:39:32.565843 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:32.565803 2575 patch_prober.go:28] interesting pod/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 16 20:39:32.566036 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:32.565860 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" podUID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 16 20:39:33.568989 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:33.568956 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:33.569429 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:33.569199 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:33.570030 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:33.570015 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:39:36.516746 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:36.516703 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:36.618570 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:36.618536 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:41.122968 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:41.122933 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:52.372889 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:52.372846 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:52.470744 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:39:52.470710 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:04.174418 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:04.174390 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:40:04.186115 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:04.186088 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:40:08.080507 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:08.080468 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:08.165325 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:08.165273 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:11.546533 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:11.546468 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:15.219122 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.219081 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk"] Jul 16 20:40:15.222676 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.222632 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.226402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.225942 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e69c2e\"/\"default-dockercfg-gvcsq\"" Jul 16 20:40:15.227163 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.227135 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e69c2e\"/\"test-model-e69c2e-kserve-self-signed-certs\"" Jul 16 20:40:15.227651 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.227626 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e69c2e\"/\"kube-root-ca.crt\"" Jul 16 20:40:15.227756 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.227697 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e69c2e\"/\"openshift-service-ca.crt\"" Jul 16 20:40:15.236301 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.236270 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk"] Jul 16 20:40:15.242371 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.242340 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:15.309520 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.309483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-tls-certs\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.309704 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.309541 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-home\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.309704 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.309623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-tmp-dir\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.309704 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.309694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-model-cache\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.309848 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.309797 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-dshm\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.309848 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.309822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8h8k\" (UniqueName: \"kubernetes.io/projected/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-kube-api-access-g8h8k\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.410329 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.410286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-dshm\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.410329 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.410330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8h8k\" (UniqueName: \"kubernetes.io/projected/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-kube-api-access-g8h8k\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.410597 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.410371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-tls-certs\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.410597 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.410404 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-home\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.410597 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.410427 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-tmp-dir\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.410597 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.410452 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-model-cache\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.410903 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.410877 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-home\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.410903 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.410893 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-tmp-dir\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.410978 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.410955 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-model-cache\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.412710 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.412684 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-dshm\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.413043 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.413022 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-tls-certs\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.422554 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.422527 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8h8k\" (UniqueName: \"kubernetes.io/projected/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-kube-api-access-g8h8k\") pod \"test-model-e69c2e-kserve-584bdbcd6f-4dbfk\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.539028 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.538938 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:15.688268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:15.688237 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk"] Jul 16 20:40:15.689903 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:40:15.689878 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f35a7d3_b912_4b64_be16_0ae8b45ebb40.slice/crio-d05908fd52013d2b455b5778aac70e99d81740334962990e3f0d6a2fe448feae WatchSource:0}: Error finding container d05908fd52013d2b455b5778aac70e99d81740334962990e3f0d6a2fe448feae: Status 404 returned error can't find the container with id d05908fd52013d2b455b5778aac70e99d81740334962990e3f0d6a2fe448feae Jul 16 20:40:16.523566 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:16.523527 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" event={"ID":"6f35a7d3-b912-4b64-be16-0ae8b45ebb40","Type":"ContainerStarted","Data":"19ebefa4e127434a718f8f9d9370f30f427ec4230bffa154188b3b0e14c0a706"} Jul 16 20:40:16.523566 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:16.523574 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" event={"ID":"6f35a7d3-b912-4b64-be16-0ae8b45ebb40","Type":"ContainerStarted","Data":"d05908fd52013d2b455b5778aac70e99d81740334962990e3f0d6a2fe448feae"} Jul 16 20:40:16.541719 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:16.541662 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" podStartSLOduration=1.541645419 podStartE2EDuration="1.541645419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:40:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:40:16.540380525 +0000 UTC m=+2413.003733557" watchObservedRunningTime="2026-07-16 20:40:16.541645419 +0000 UTC m=+2413.004998449" Jul 16 20:40:25.539953 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:25.539914 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:25.540427 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:25.539979 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:25.553168 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:25.553140 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:25.584130 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:25.584056 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:33.182625 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:33.182590 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:34.267570 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:34.266919 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk"] Jul 16 20:40:34.297258 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:34.297221 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:34.915486 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:34.915451 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:35.013426 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:35.013384 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:44.926932 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:44.926872 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:49.290121 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.290075 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" podUID="6f35a7d3-b912-4b64-be16-0ae8b45ebb40" containerName="main" containerID="cri-o://19ebefa4e127434a718f8f9d9370f30f427ec4230bffa154188b3b0e14c0a706" gracePeriod=45 Jul 16 20:40:49.517518 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.517476 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:49.559261 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.559235 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:49.639861 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.639828 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-tmp-dir\") pod \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " Jul 16 20:40:49.640050 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.639871 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-home\") pod \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " Jul 16 20:40:49.640050 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.639893 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-model-cache\") pod \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " Jul 16 20:40:49.640050 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.639956 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8h8k\" (UniqueName: \"kubernetes.io/projected/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-kube-api-access-g8h8k\") pod \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " Jul 16 20:40:49.640050 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.640002 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-tls-certs\") pod \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " Jul 16 20:40:49.640050 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.640023 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-dshm\") pod \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\" (UID: \"6f35a7d3-b912-4b64-be16-0ae8b45ebb40\") " Jul 16 20:40:49.640293 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.640168 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6f35a7d3-b912-4b64-be16-0ae8b45ebb40" (UID: "6f35a7d3-b912-4b64-be16-0ae8b45ebb40"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:40:49.640293 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.640180 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-home" (OuterVolumeSpecName: "home") pod "6f35a7d3-b912-4b64-be16-0ae8b45ebb40" (UID: "6f35a7d3-b912-4b64-be16-0ae8b45ebb40"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:40:49.640293 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.640192 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f35a7d3-b912-4b64-be16-0ae8b45ebb40" (UID: "6f35a7d3-b912-4b64-be16-0ae8b45ebb40"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:40:49.640432 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.640331 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-tmp-dir\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:40:49.640432 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.640350 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-home\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:40:49.640432 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.640364 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-model-cache\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:40:49.642418 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.642387 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-kube-api-access-g8h8k" (OuterVolumeSpecName: "kube-api-access-g8h8k") pod "6f35a7d3-b912-4b64-be16-0ae8b45ebb40" (UID: "6f35a7d3-b912-4b64-be16-0ae8b45ebb40"). InnerVolumeSpecName "kube-api-access-g8h8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:40:49.642552 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.642498 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-dshm" (OuterVolumeSpecName: "dshm") pod "6f35a7d3-b912-4b64-be16-0ae8b45ebb40" (UID: "6f35a7d3-b912-4b64-be16-0ae8b45ebb40"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:40:49.642615 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.642569 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6f35a7d3-b912-4b64-be16-0ae8b45ebb40" (UID: "6f35a7d3-b912-4b64-be16-0ae8b45ebb40"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:40:49.702674 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.702635 2575 generic.go:356] "Generic (PLEG): container finished" podID="6f35a7d3-b912-4b64-be16-0ae8b45ebb40" containerID="19ebefa4e127434a718f8f9d9370f30f427ec4230bffa154188b3b0e14c0a706" exitCode=0 Jul 16 20:40:49.702674 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.702677 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" Jul 16 20:40:49.702939 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.702718 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" event={"ID":"6f35a7d3-b912-4b64-be16-0ae8b45ebb40","Type":"ContainerDied","Data":"19ebefa4e127434a718f8f9d9370f30f427ec4230bffa154188b3b0e14c0a706"} Jul 16 20:40:49.702939 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.702760 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk" event={"ID":"6f35a7d3-b912-4b64-be16-0ae8b45ebb40","Type":"ContainerDied","Data":"d05908fd52013d2b455b5778aac70e99d81740334962990e3f0d6a2fe448feae"} Jul 16 20:40:49.703547 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.702838 2575 scope.go:117] "RemoveContainer" containerID="19ebefa4e127434a718f8f9d9370f30f427ec4230bffa154188b3b0e14c0a706" Jul 16 20:40:49.713129 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.713110 2575 scope.go:117] "RemoveContainer" containerID="19ebefa4e127434a718f8f9d9370f30f427ec4230bffa154188b3b0e14c0a706" Jul 16 20:40:49.713410 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:40:49.713390 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19ebefa4e127434a718f8f9d9370f30f427ec4230bffa154188b3b0e14c0a706\": container with ID starting with 19ebefa4e127434a718f8f9d9370f30f427ec4230bffa154188b3b0e14c0a706 not found: ID does not exist" containerID="19ebefa4e127434a718f8f9d9370f30f427ec4230bffa154188b3b0e14c0a706" Jul 16 20:40:49.713459 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.713420 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ebefa4e127434a718f8f9d9370f30f427ec4230bffa154188b3b0e14c0a706"} err="failed to get container status \"19ebefa4e127434a718f8f9d9370f30f427ec4230bffa154188b3b0e14c0a706\": rpc error: code = NotFound desc = could not find container \"19ebefa4e127434a718f8f9d9370f30f427ec4230bffa154188b3b0e14c0a706\": container with ID starting with 19ebefa4e127434a718f8f9d9370f30f427ec4230bffa154188b3b0e14c0a706 not found: ID does not exist" Jul 16 20:40:49.724519 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.724482 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk"] Jul 16 20:40:49.729879 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.729849 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e69c2e/test-model-e69c2e-kserve-584bdbcd6f-4dbfk"] Jul 16 20:40:49.741101 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.741071 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8h8k\" (UniqueName: \"kubernetes.io/projected/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-kube-api-access-g8h8k\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:40:49.741101 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.741103 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-tls-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:40:49.741288 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:49.741118 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f35a7d3-b912-4b64-be16-0ae8b45ebb40-dshm\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:40:50.019941 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:50.019901 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f35a7d3-b912-4b64-be16-0ae8b45ebb40" path="/var/lib/kubelet/pods/6f35a7d3-b912-4b64-be16-0ae8b45ebb40/volumes" Jul 16 20:40:55.616281 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:55.616231 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:55.716719 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:40:55.716681 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:00.274238 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:00.274189 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:02.969714 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:02.969678 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:11.077378 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:11.077332 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:15.686428 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:15.686389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:21.707362 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:21.707329 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:21.808104 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:21.808068 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:26.350367 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:26.350335 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv"] Jul 16 20:41:26.350850 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:26.350608 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" podUID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerName="istio-proxy" containerID="cri-o://4d60fc1beb1076d948efad0c84c355823f59b67542f0133144d9c14ce1d7afc5" gracePeriod=30 Jul 16 20:41:26.375917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:26.375876 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:26.626710 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:26.626595 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:26.982131 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:26.982036 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:27.298443 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:27.298343 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:27.743241 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:27.743203 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:29.761835 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:29.761796 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:29.861252 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:29.861212 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:30.060739 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:30.060650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:30.291921 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:30.291886 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:30.622430 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:30.622394 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:30.724193 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:30.724158 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:31.618946 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.618881 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:41:31.635588 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.635552 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-workload-certs\") pod \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " Jul 16 20:41:31.635805 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.635598 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-workload-socket\") pod \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " Jul 16 20:41:31.635805 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.635644 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-credential-socket\") pod \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " Jul 16 20:41:31.635805 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.635668 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istiod-ca-cert\") pod \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " Jul 16 20:41:31.635805 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.635706 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-podinfo\") pod \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " Jul 16 20:41:31.635805 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.635741 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-token\") pod \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " Jul 16 20:41:31.636080 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.635818 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-data\") pod \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " Jul 16 20:41:31.636080 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.635846 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-envoy\") pod \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " Jul 16 20:41:31.636080 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.635887 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptzj8\" (UniqueName: \"kubernetes.io/projected/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-kube-api-access-ptzj8\") pod \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\" (UID: \"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4\") " Jul 16 20:41:31.636080 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.635909 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" (UID: "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:41:31.636080 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.636016 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" (UID: "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:41:31.636322 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.636250 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-credential-socket\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:41:31.636322 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.636274 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-workload-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:41:31.636727 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.636526 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" (UID: "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:41:31.636727 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.636698 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" (UID: "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:41:31.637223 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.637194 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" (UID: "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:41:31.638417 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.638392 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" (UID: "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 20:41:31.638600 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.638561 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" (UID: "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:41:31.638694 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.638669 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" (UID: "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:41:31.638735 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.638687 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-kube-api-access-ptzj8" (OuterVolumeSpecName: "kube-api-access-ptzj8") pod "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" (UID: "2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4"). InnerVolumeSpecName "kube-api-access-ptzj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:41:31.736698 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.736654 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-workload-socket\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:41:31.736698 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.736689 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istiod-ca-cert\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:41:31.736698 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.736704 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-podinfo\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:41:31.736966 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.736715 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-token\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:41:31.736966 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.736727 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-data\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:41:31.736966 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.736737 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-istio-envoy\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:41:31.736966 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.736748 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptzj8\" (UniqueName: \"kubernetes.io/projected/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4-kube-api-access-ptzj8\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:41:31.928841 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.928733 2575 generic.go:356] "Generic (PLEG): container finished" podID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerID="4d60fc1beb1076d948efad0c84c355823f59b67542f0133144d9c14ce1d7afc5" exitCode=0 Jul 16 20:41:31.928841 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.928785 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" event={"ID":"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4","Type":"ContainerDied","Data":"4d60fc1beb1076d948efad0c84c355823f59b67542f0133144d9c14ce1d7afc5"} Jul 16 20:41:31.928841 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.928804 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" Jul 16 20:41:31.928841 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.928829 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv" event={"ID":"2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4","Type":"ContainerDied","Data":"72a805af3c22d891a92191a7f5027835a4be86cb64cbfbcb137802028e5e7d6c"} Jul 16 20:41:31.929171 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.928855 2575 scope.go:117] "RemoveContainer" containerID="4d60fc1beb1076d948efad0c84c355823f59b67542f0133144d9c14ce1d7afc5" Jul 16 20:41:31.938831 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.938808 2575 scope.go:117] "RemoveContainer" containerID="17256b18756e6f5fb9b8843da3296203fce383a154e698272420d8296a2497c2" Jul 16 20:41:31.947203 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.947183 2575 scope.go:117] "RemoveContainer" containerID="4d60fc1beb1076d948efad0c84c355823f59b67542f0133144d9c14ce1d7afc5" Jul 16 20:41:31.947482 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:41:31.947463 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d60fc1beb1076d948efad0c84c355823f59b67542f0133144d9c14ce1d7afc5\": container with ID starting with 4d60fc1beb1076d948efad0c84c355823f59b67542f0133144d9c14ce1d7afc5 not found: ID does not exist" containerID="4d60fc1beb1076d948efad0c84c355823f59b67542f0133144d9c14ce1d7afc5" Jul 16 20:41:31.947532 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.947493 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d60fc1beb1076d948efad0c84c355823f59b67542f0133144d9c14ce1d7afc5"} err="failed to get container status \"4d60fc1beb1076d948efad0c84c355823f59b67542f0133144d9c14ce1d7afc5\": rpc error: code = NotFound desc = could not find container \"4d60fc1beb1076d948efad0c84c355823f59b67542f0133144d9c14ce1d7afc5\": container with ID starting with 4d60fc1beb1076d948efad0c84c355823f59b67542f0133144d9c14ce1d7afc5 not found: ID does not exist" Jul 16 20:41:31.947532 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.947511 2575 scope.go:117] "RemoveContainer" containerID="17256b18756e6f5fb9b8843da3296203fce383a154e698272420d8296a2497c2" Jul 16 20:41:31.947777 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:41:31.947749 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17256b18756e6f5fb9b8843da3296203fce383a154e698272420d8296a2497c2\": container with ID starting with 17256b18756e6f5fb9b8843da3296203fce383a154e698272420d8296a2497c2 not found: ID does not exist" containerID="17256b18756e6f5fb9b8843da3296203fce383a154e698272420d8296a2497c2" Jul 16 20:41:31.947837 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.947787 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17256b18756e6f5fb9b8843da3296203fce383a154e698272420d8296a2497c2"} err="failed to get container status \"17256b18756e6f5fb9b8843da3296203fce383a154e698272420d8296a2497c2\": rpc error: code = NotFound desc = could not find container \"17256b18756e6f5fb9b8843da3296203fce383a154e698272420d8296a2497c2\": container with ID starting with 17256b18756e6f5fb9b8843da3296203fce383a154e698272420d8296a2497c2 not found: ID does not exist" Jul 16 20:41:31.978578 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.978538 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv"] Jul 16 20:41:31.993999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:31.993960 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e69c2e-openshift-default-7975db759-tpgwv"] Jul 16 20:41:32.019170 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:32.019137 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" path="/var/lib/kubelet/pods/2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4/volumes" Jul 16 20:41:34.233282 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:34.233240 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:34.703556 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:34.703527 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:35.020388 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:35.020301 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:35.269963 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:35.269926 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:37.856312 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:37.856279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:37.959276 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:37.959236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:38.061021 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:38.060989 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:38.407103 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:38.407069 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:38.508268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:38.508236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:38.612508 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:38.612467 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:42.302320 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:42.302287 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:50.899238 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:50.899196 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:50.999451 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:41:50.999416 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:00.412387 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:00.412295 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:00.510925 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:00.510891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:00.695575 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:00.695485 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:05.474539 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:05.474496 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:11.147781 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:11.147717 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:11.429485 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:11.429385 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:11.571522 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:11.571488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:16.233256 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:16.233215 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:16.505652 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:16.505544 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:27.215848 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:27.215792 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:31.728488 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:31.728446 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:37.752160 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:37.752109 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:37.851603 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:37.851568 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:42.388523 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:42.388456 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:42.604104 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:42.604067 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:42.964270 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:42.964231 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:43.264229 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:43.264124 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:43.825815 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:43.825753 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:46.198254 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:46.198215 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:46.290620 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:46.290582 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:46.361711 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:46.361658 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:46.849376 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:46.849345 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:46.950272 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:46.950240 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:47.052935 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:47.052902 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:50.691487 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:50.691442 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:51.013404 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.013313 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:51.279535 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.279433 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx"] Jul 16 20:42:51.279990 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.279971 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerName="istio-proxy" Jul 16 20:42:51.280096 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.279993 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerName="istio-proxy" Jul 16 20:42:51.280096 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.280005 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerName="istio-proxy" Jul 16 20:42:51.280096 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.280013 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerName="istio-proxy" Jul 16 20:42:51.280096 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.280038 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f35a7d3-b912-4b64-be16-0ae8b45ebb40" containerName="main" Jul 16 20:42:51.280096 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.280047 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f35a7d3-b912-4b64-be16-0ae8b45ebb40" containerName="main" Jul 16 20:42:51.280348 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.280167 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerName="istio-proxy" Jul 16 20:42:51.280348 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.280180 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d4f36a2-f9b3-4cb4-8c28-d2d1979340f4" containerName="istio-proxy" Jul 16 20:42:51.280348 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.280190 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f35a7d3-b912-4b64-be16-0ae8b45ebb40" containerName="main" Jul 16 20:42:51.283632 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.283610 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.286271 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.286246 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-8a0b5e-openshift-default-dockercfg-mvk6m\"" Jul 16 20:42:51.295851 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.295826 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx"] Jul 16 20:42:51.310394 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.310350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:51.351167 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.351124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f512ca60-2754-4dab-8e66-5417c2f77232-istiod-ca-cert\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.351361 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.351205 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-workload-socket\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.351361 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.351241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-istio-envoy\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.351361 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.351267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f512ca60-2754-4dab-8e66-5417c2f77232-istio-podinfo\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.351361 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.351295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-credential-socket\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.351361 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.351320 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f512ca60-2754-4dab-8e66-5417c2f77232-istio-token\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.351361 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.351348 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb6r9\" (UniqueName: \"kubernetes.io/projected/f512ca60-2754-4dab-8e66-5417c2f77232-kube-api-access-lb6r9\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.351593 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.351429 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-workload-certs\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.351593 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.351457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-istio-data\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.452332 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.452296 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-credential-socket\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.452332 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.452335 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f512ca60-2754-4dab-8e66-5417c2f77232-istio-token\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.452595 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.452354 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb6r9\" (UniqueName: \"kubernetes.io/projected/f512ca60-2754-4dab-8e66-5417c2f77232-kube-api-access-lb6r9\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.452595 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.452393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-workload-certs\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.452595 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.452413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-istio-data\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.452595 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.452454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f512ca60-2754-4dab-8e66-5417c2f77232-istiod-ca-cert\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.452595 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.452506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-workload-socket\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.452595 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.452533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-istio-envoy\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.452595 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.452560 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f512ca60-2754-4dab-8e66-5417c2f77232-istio-podinfo\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.452993 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.452880 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-credential-socket\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.452993 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.452909 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-workload-certs\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.453106 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.453008 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-workload-socket\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.453106 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.453089 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-istio-data\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.453458 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.453388 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f512ca60-2754-4dab-8e66-5417c2f77232-istiod-ca-cert\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.455084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.455063 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-istio-envoy\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.455559 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.455536 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f512ca60-2754-4dab-8e66-5417c2f77232-istio-podinfo\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.461653 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.461628 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f512ca60-2754-4dab-8e66-5417c2f77232-istio-token\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.461832 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.461815 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb6r9\" (UniqueName: \"kubernetes.io/projected/f512ca60-2754-4dab-8e66-5417c2f77232-kube-api-access-lb6r9\") pod \"e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.499294 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.499236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:51.594692 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.594663 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:51.751144 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.751115 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx"] Jul 16 20:42:51.753514 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:42:51.753487 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf512ca60_2754_4dab_8e66_5417c2f77232.slice/crio-5b33d0edc3c68fb213d4291f722a5c241b7ee4265ad86a3e77fe3b0a6ce3a13f WatchSource:0}: Error finding container 5b33d0edc3c68fb213d4291f722a5c241b7ee4265ad86a3e77fe3b0a6ce3a13f: Status 404 returned error can't find the container with id 5b33d0edc3c68fb213d4291f722a5c241b7ee4265ad86a3e77fe3b0a6ce3a13f Jul 16 20:42:51.755894 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.755861 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:42:51.755981 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.755944 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:42:51.755981 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:51.755976 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:42:52.360673 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:52.360628 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" event={"ID":"f512ca60-2754-4dab-8e66-5417c2f77232","Type":"ContainerStarted","Data":"12b0e2ed9b15aff6b87354081b5e028bd165582ed842cbb4d72b7b53f2fbec3a"} Jul 16 20:42:52.360917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:52.360696 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" event={"ID":"f512ca60-2754-4dab-8e66-5417c2f77232","Type":"ContainerStarted","Data":"5b33d0edc3c68fb213d4291f722a5c241b7ee4265ad86a3e77fe3b0a6ce3a13f"} Jul 16 20:42:52.397050 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:52.396990 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" podStartSLOduration=1.396974559 podStartE2EDuration="1.396974559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:42:52.39495173 +0000 UTC m=+2568.858304782" watchObservedRunningTime="2026-07-16 20:42:52.396974559 +0000 UTC m=+2568.860327588" Jul 16 20:42:52.436328 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:52.436289 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:52.595522 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:52.595480 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:52.601395 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:52.601368 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:53.366464 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:53.366430 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:53.367349 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:53.367329 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:42:54.309483 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:54.309450 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:54.397785 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:54.397730 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:54.467277 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:54.467233 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:54.986176 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:54.986132 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:55.082031 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:55.081996 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:55.183968 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:55.183932 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:58.793110 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:42:58.793073 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:43:08.054440 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:08.054320 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:43:08.153989 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:08.153949 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:43:09.408018 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:09.407972 2575 patch_prober.go:28] interesting pod/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 16 20:43:09.408436 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:09.408054 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" podUID="f512ca60-2754-4dab-8e66-5417c2f77232" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 16 20:43:11.477702 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:11.477670 2575 generic.go:356] "Generic (PLEG): container finished" podID="f512ca60-2754-4dab-8e66-5417c2f77232" containerID="12b0e2ed9b15aff6b87354081b5e028bd165582ed842cbb4d72b7b53f2fbec3a" exitCode=0 Jul 16 20:43:11.478154 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:11.477753 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" event={"ID":"f512ca60-2754-4dab-8e66-5417c2f77232","Type":"ContainerDied","Data":"12b0e2ed9b15aff6b87354081b5e028bd165582ed842cbb4d72b7b53f2fbec3a"} Jul 16 20:43:11.478197 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:11.478170 2575 scope.go:117] "RemoveContainer" containerID="12b0e2ed9b15aff6b87354081b5e028bd165582ed842cbb4d72b7b53f2fbec3a" Jul 16 20:43:11.479139 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:11.479113 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:43:11.479203 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:11.479184 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:43:11.479251 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:11.479215 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 16 20:43:12.485829 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:12.485786 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" event={"ID":"f512ca60-2754-4dab-8e66-5417c2f77232","Type":"ContainerStarted","Data":"a6c5f56df692b1611fe98f4b3a1badfbf22a4fddb541a6853b692739d73a1ea7"} Jul 16 20:43:12.595693 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:12.595657 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:43:12.595928 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:12.595906 2575 patch_prober.go:28] interesting pod/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 16 20:43:12.595981 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:12.595958 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" podUID="f512ca60-2754-4dab-8e66-5417c2f77232" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 16 20:43:13.595796 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:13.595739 2575 patch_prober.go:28] interesting pod/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 16 20:43:13.596364 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:13.595828 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" podUID="f512ca60-2754-4dab-8e66-5417c2f77232" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 16 20:43:14.381244 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:14.381146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:43:14.596048 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:14.596006 2575 patch_prober.go:28] interesting pod/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 16 20:43:14.596448 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:14.596069 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" podUID="f512ca60-2754-4dab-8e66-5417c2f77232" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 16 20:43:15.595993 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:15.595959 2575 patch_prober.go:28] interesting pod/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 16 20:43:15.596172 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:15.596015 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" podUID="f512ca60-2754-4dab-8e66-5417c2f77232" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 16 20:43:16.599170 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:16.599140 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:43:16.599623 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:16.599498 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:43:16.600294 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:16.600271 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:43:16.933210 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:16.933113 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:43:17.035464 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:17.035428 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:43:58.756327 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:43:58.756288 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:44:53.120460 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:44:53.120420 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:44:53.218641 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:44:53.218596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:44:54.738268 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:44:54.738232 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:44:54.838947 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:44:54.838911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:45:04.205821 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:45:04.205729 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:45:04.219089 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:45:04.219057 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:46:03.037344 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:46:03.037300 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:46:04.659781 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:46:04.659741 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:46:16.710424 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:46:16.710384 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:46:34.336300 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:46:34.336261 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:14.522819 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:47:14.522756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:51.831949 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:47:51.831903 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:52.640982 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:47:52.640941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:59.043139 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:47:59.043053 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:48:09.294875 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:09.294840 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:48:09.364432 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:09.364390 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:48:16.925059 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:16.925020 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n"] Jul 16 20:48:16.928579 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:16.928558 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:16.931232 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:16.931208 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8a0b5e\"/\"kube-root-ca.crt\"" Jul 16 20:48:16.932199 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:16.932167 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8a0b5e\"/\"default-dockercfg-kbrhp\"" Jul 16 20:48:16.932199 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:16.932181 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8a0b5e\"/\"openshift-service-ca.crt\"" Jul 16 20:48:16.932387 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:16.932202 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8a0b5e\"/\"rate-test-model-8a0b5e-kserve-self-signed-certs\"" Jul 16 20:48:16.939346 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:16.939317 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n"] Jul 16 20:48:16.966525 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:16.966470 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:48:17.007144 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.007103 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-tmp-dir\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.007144 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.007140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-model-cache\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.007366 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.007239 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-tls-certs\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.007366 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.007278 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-dshm\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.007366 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.007307 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnjqj\" (UniqueName: \"kubernetes.io/projected/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-kube-api-access-bnjqj\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.007366 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.007353 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-home\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.108592 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.108551 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-tls-certs\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.108592 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.108599 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-dshm\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.108857 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.108717 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnjqj\" (UniqueName: \"kubernetes.io/projected/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-kube-api-access-bnjqj\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.108857 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.108804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-home\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.108973 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.108907 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-tmp-dir\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.108973 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.108936 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-model-cache\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.109224 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.109196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-home\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.109342 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.109299 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-tmp-dir\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.109415 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.109375 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-model-cache\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.111025 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.111005 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-dshm\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.111169 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.111151 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-tls-certs\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.119131 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.119102 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnjqj\" (UniqueName: \"kubernetes.io/projected/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-kube-api-access-bnjqj\") pod \"rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.239633 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.239538 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:17.388999 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:17.388974 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n"] Jul 16 20:48:17.391126 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:48:17.391094 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75525a82_9f5f_4f2f_a5e4_cef2a12f63b3.slice/crio-a07256c6c38ed63c615d30ff062e261b3d7c748095721d5873ff2d13527b1c29 WatchSource:0}: Error finding container a07256c6c38ed63c615d30ff062e261b3d7c748095721d5873ff2d13527b1c29: Status 404 returned error can't find the container with id a07256c6c38ed63c615d30ff062e261b3d7c748095721d5873ff2d13527b1c29 Jul 16 20:48:18.092276 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:18.092235 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:48:18.112448 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:18.112403 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" event={"ID":"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3","Type":"ContainerStarted","Data":"4a0e4abd96e7d69e441ed262f2c36f29a0ca6c00f3012f5e56875773e3b3490a"} Jul 16 20:48:18.112622 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:18.112459 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" event={"ID":"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3","Type":"ContainerStarted","Data":"a07256c6c38ed63c615d30ff062e261b3d7c748095721d5873ff2d13527b1c29"} Jul 16 20:48:18.130646 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:18.130573 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" podStartSLOduration=2.130549635 podStartE2EDuration="2.130549635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:48:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:48:18.128882437 +0000 UTC m=+2894.592235470" watchObservedRunningTime="2026-07-16 20:48:18.130549635 +0000 UTC m=+2894.593902668" Jul 16 20:48:18.194294 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:18.194247 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:48:27.240402 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:27.240360 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:27.240961 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:27.240421 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:27.253627 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:27.253598 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:48:28.178640 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:48:28.178607 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:49:13.492899 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:13.492834 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:49:14.322664 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:14.322630 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n"] Jul 16 20:49:14.347643 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:14.347604 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:49:16.568193 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:16.568155 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:49:29.344438 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.344315 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" podUID="75525a82-9f5f-4f2f-a5e4-cef2a12f63b3" containerName="main" containerID="cri-o://4a0e4abd96e7d69e441ed262f2c36f29a0ca6c00f3012f5e56875773e3b3490a" gracePeriod=45 Jul 16 20:49:29.498917 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.498879 2575 generic.go:356] "Generic (PLEG): container finished" podID="75525a82-9f5f-4f2f-a5e4-cef2a12f63b3" containerID="4a0e4abd96e7d69e441ed262f2c36f29a0ca6c00f3012f5e56875773e3b3490a" exitCode=0 Jul 16 20:49:29.499090 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.498954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" event={"ID":"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3","Type":"ContainerDied","Data":"4a0e4abd96e7d69e441ed262f2c36f29a0ca6c00f3012f5e56875773e3b3490a"} Jul 16 20:49:29.614261 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.614234 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:49:29.711780 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.711735 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-home\") pod \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " Jul 16 20:49:29.711982 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.711840 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnjqj\" (UniqueName: \"kubernetes.io/projected/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-kube-api-access-bnjqj\") pod \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " Jul 16 20:49:29.711982 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.711866 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-tls-certs\") pod \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " Jul 16 20:49:29.711982 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.711888 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-model-cache\") pod \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " Jul 16 20:49:29.711982 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.711927 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-dshm\") pod \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " Jul 16 20:49:29.712192 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.712005 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-tmp-dir\") pod \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\" (UID: \"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3\") " Jul 16 20:49:29.712192 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.712079 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-home" (OuterVolumeSpecName: "home") pod "75525a82-9f5f-4f2f-a5e4-cef2a12f63b3" (UID: "75525a82-9f5f-4f2f-a5e4-cef2a12f63b3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:49:29.712192 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.712158 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-model-cache" (OuterVolumeSpecName: "model-cache") pod "75525a82-9f5f-4f2f-a5e4-cef2a12f63b3" (UID: "75525a82-9f5f-4f2f-a5e4-cef2a12f63b3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:49:29.712326 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.712295 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "75525a82-9f5f-4f2f-a5e4-cef2a12f63b3" (UID: "75525a82-9f5f-4f2f-a5e4-cef2a12f63b3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:49:29.712444 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.712336 2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-home\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:49:29.712444 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.712349 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-model-cache\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:49:29.714287 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.714259 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-dshm" (OuterVolumeSpecName: "dshm") pod "75525a82-9f5f-4f2f-a5e4-cef2a12f63b3" (UID: "75525a82-9f5f-4f2f-a5e4-cef2a12f63b3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:49:29.714385 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.714286 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "75525a82-9f5f-4f2f-a5e4-cef2a12f63b3" (UID: "75525a82-9f5f-4f2f-a5e4-cef2a12f63b3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:49:29.714385 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.714326 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-kube-api-access-bnjqj" (OuterVolumeSpecName: "kube-api-access-bnjqj") pod "75525a82-9f5f-4f2f-a5e4-cef2a12f63b3" (UID: "75525a82-9f5f-4f2f-a5e4-cef2a12f63b3"). InnerVolumeSpecName "kube-api-access-bnjqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:49:29.813180 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.813139 2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-tls-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:49:29.813180 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.813172 2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-dshm\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:49:29.813180 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.813182 2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-tmp-dir\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:49:29.813180 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:29.813191 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnjqj\" (UniqueName: \"kubernetes.io/projected/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3-kube-api-access-bnjqj\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:49:30.505177 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:30.505147 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" Jul 16 20:49:30.505177 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:30.505173 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n" event={"ID":"75525a82-9f5f-4f2f-a5e4-cef2a12f63b3","Type":"ContainerDied","Data":"a07256c6c38ed63c615d30ff062e261b3d7c748095721d5873ff2d13527b1c29"} Jul 16 20:49:30.505826 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:30.505218 2575 scope.go:117] "RemoveContainer" containerID="4a0e4abd96e7d69e441ed262f2c36f29a0ca6c00f3012f5e56875773e3b3490a" Jul 16 20:49:30.521355 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:30.521319 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n"] Jul 16 20:49:30.527531 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:30.527501 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8a0b5e/rate-test-model-8a0b5e-kserve-74c8d76b6c-bmx6n"] Jul 16 20:49:32.020493 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:32.020445 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75525a82-9f5f-4f2f-a5e4-cef2a12f63b3" path="/var/lib/kubelet/pods/75525a82-9f5f-4f2f-a5e4-cef2a12f63b3/volumes" Jul 16 20:49:33.973109 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:33.973070 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:49:34.072416 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:34.072375 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:49:44.102745 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:44.102707 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:49:48.550423 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:48.550382 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:49:54.077190 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:54.077117 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:49:54.179810 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:54.179741 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:49:54.873941 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:54.873898 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:49:54.974323 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:54.974287 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:49:59.273429 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:59.273388 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:49:59.511642 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:49:59.511606 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:50:00.225337 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:00.225289 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:50:00.322352 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:00.322310 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:50:01.707744 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:01.707707 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:50:04.239933 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:04.239899 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:50:04.253422 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:04.253395 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:50:10.332100 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:10.332056 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:50:14.786189 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:14.786147 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:50:21.205818 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:21.205759 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:50:21.284888 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:21.284836 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:50:25.437417 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:25.437363 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx"] Jul 16 20:50:25.437939 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:25.437650 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" podUID="f512ca60-2754-4dab-8e66-5417c2f77232" containerName="istio-proxy" containerID="cri-o://a6c5f56df692b1611fe98f4b3a1badfbf22a4fddb541a6853b692739d73a1ea7" gracePeriod=30 Jul 16 20:50:25.478448 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:25.478410 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:50:25.684395 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:25.684354 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:50:26.177740 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:26.177706 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77d4cfbbcc-pjts2_ed9c02e7-93fe-49df-9c08-44b13569f562/authorino/0.log" Jul 16 20:50:30.706811 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.706727 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:50:30.792635 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.792600 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb6r9\" (UniqueName: \"kubernetes.io/projected/f512ca60-2754-4dab-8e66-5417c2f77232-kube-api-access-lb6r9\") pod \"f512ca60-2754-4dab-8e66-5417c2f77232\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " Jul 16 20:50:30.792852 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.792654 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-workload-socket\") pod \"f512ca60-2754-4dab-8e66-5417c2f77232\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " Jul 16 20:50:30.792852 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.792796 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f512ca60-2754-4dab-8e66-5417c2f77232-istiod-ca-cert\") pod \"f512ca60-2754-4dab-8e66-5417c2f77232\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " Jul 16 20:50:30.792852 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.792841 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-istio-envoy\") pod \"f512ca60-2754-4dab-8e66-5417c2f77232\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " Jul 16 20:50:30.793022 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.792859 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f512ca60-2754-4dab-8e66-5417c2f77232-istio-podinfo\") pod \"f512ca60-2754-4dab-8e66-5417c2f77232\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " Jul 16 20:50:30.793022 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.792925 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-workload-certs\") pod \"f512ca60-2754-4dab-8e66-5417c2f77232\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " Jul 16 20:50:30.793022 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.792949 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-istio-data\") pod \"f512ca60-2754-4dab-8e66-5417c2f77232\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " Jul 16 20:50:30.793022 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.792968 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-credential-socket\") pod \"f512ca60-2754-4dab-8e66-5417c2f77232\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " Jul 16 20:50:30.793022 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.792988 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f512ca60-2754-4dab-8e66-5417c2f77232-istio-token\") pod \"f512ca60-2754-4dab-8e66-5417c2f77232\" (UID: \"f512ca60-2754-4dab-8e66-5417c2f77232\") " Jul 16 20:50:30.793290 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.793021 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f512ca60-2754-4dab-8e66-5417c2f77232" (UID: "f512ca60-2754-4dab-8e66-5417c2f77232"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:50:30.793290 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.793110 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f512ca60-2754-4dab-8e66-5417c2f77232-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f512ca60-2754-4dab-8e66-5417c2f77232" (UID: "f512ca60-2754-4dab-8e66-5417c2f77232"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:50:30.793290 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.793219 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f512ca60-2754-4dab-8e66-5417c2f77232" (UID: "f512ca60-2754-4dab-8e66-5417c2f77232"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:50:30.793441 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.793332 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-workload-certs\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:50:30.793441 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.793351 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-workload-socket\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:50:30.793441 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.793363 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f512ca60-2754-4dab-8e66-5417c2f77232-istiod-ca-cert\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:50:30.793441 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.793368 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f512ca60-2754-4dab-8e66-5417c2f77232" (UID: "f512ca60-2754-4dab-8e66-5417c2f77232"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:50:30.793994 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.793968 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-istio-data" (OuterVolumeSpecName: "istio-data") pod "f512ca60-2754-4dab-8e66-5417c2f77232" (UID: "f512ca60-2754-4dab-8e66-5417c2f77232"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:50:30.795161 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.795135 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f512ca60-2754-4dab-8e66-5417c2f77232" (UID: "f512ca60-2754-4dab-8e66-5417c2f77232"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:50:30.795256 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.795217 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f512ca60-2754-4dab-8e66-5417c2f77232-kube-api-access-lb6r9" (OuterVolumeSpecName: "kube-api-access-lb6r9") pod "f512ca60-2754-4dab-8e66-5417c2f77232" (UID: "f512ca60-2754-4dab-8e66-5417c2f77232"). InnerVolumeSpecName "kube-api-access-lb6r9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:50:30.795311 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.795274 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f512ca60-2754-4dab-8e66-5417c2f77232-istio-token" (OuterVolumeSpecName: "istio-token") pod "f512ca60-2754-4dab-8e66-5417c2f77232" (UID: "f512ca60-2754-4dab-8e66-5417c2f77232"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:50:30.795407 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.795390 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f512ca60-2754-4dab-8e66-5417c2f77232-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f512ca60-2754-4dab-8e66-5417c2f77232" (UID: "f512ca60-2754-4dab-8e66-5417c2f77232"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 20:50:30.822680 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.822634 2575 generic.go:356] "Generic (PLEG): container finished" podID="f512ca60-2754-4dab-8e66-5417c2f77232" containerID="a6c5f56df692b1611fe98f4b3a1badfbf22a4fddb541a6853b692739d73a1ea7" exitCode=0 Jul 16 20:50:30.822680 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.822683 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" Jul 16 20:50:30.822680 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.822688 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" event={"ID":"f512ca60-2754-4dab-8e66-5417c2f77232","Type":"ContainerDied","Data":"a6c5f56df692b1611fe98f4b3a1badfbf22a4fddb541a6853b692739d73a1ea7"} Jul 16 20:50:30.822986 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.822733 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx" event={"ID":"f512ca60-2754-4dab-8e66-5417c2f77232","Type":"ContainerDied","Data":"5b33d0edc3c68fb213d4291f722a5c241b7ee4265ad86a3e77fe3b0a6ce3a13f"} Jul 16 20:50:30.822986 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.822755 2575 scope.go:117] "RemoveContainer" containerID="a6c5f56df692b1611fe98f4b3a1badfbf22a4fddb541a6853b692739d73a1ea7" Jul 16 20:50:30.835886 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.835863 2575 scope.go:117] "RemoveContainer" containerID="12b0e2ed9b15aff6b87354081b5e028bd165582ed842cbb4d72b7b53f2fbec3a" Jul 16 20:50:30.844891 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.844868 2575 scope.go:117] "RemoveContainer" containerID="a6c5f56df692b1611fe98f4b3a1badfbf22a4fddb541a6853b692739d73a1ea7" Jul 16 20:50:30.845224 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:50:30.845200 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6c5f56df692b1611fe98f4b3a1badfbf22a4fddb541a6853b692739d73a1ea7\": container with ID starting with a6c5f56df692b1611fe98f4b3a1badfbf22a4fddb541a6853b692739d73a1ea7 not found: ID does not exist" containerID="a6c5f56df692b1611fe98f4b3a1badfbf22a4fddb541a6853b692739d73a1ea7" Jul 16 20:50:30.845297 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.845258 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6c5f56df692b1611fe98f4b3a1badfbf22a4fddb541a6853b692739d73a1ea7"} err="failed to get container status \"a6c5f56df692b1611fe98f4b3a1badfbf22a4fddb541a6853b692739d73a1ea7\": rpc error: code = NotFound desc = could not find container \"a6c5f56df692b1611fe98f4b3a1badfbf22a4fddb541a6853b692739d73a1ea7\": container with ID starting with a6c5f56df692b1611fe98f4b3a1badfbf22a4fddb541a6853b692739d73a1ea7 not found: ID does not exist" Jul 16 20:50:30.845297 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.845281 2575 scope.go:117] "RemoveContainer" containerID="12b0e2ed9b15aff6b87354081b5e028bd165582ed842cbb4d72b7b53f2fbec3a" Jul 16 20:50:30.845503 ip-10-0-134-169 kubenswrapper[2575]: E0716 20:50:30.845489 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12b0e2ed9b15aff6b87354081b5e028bd165582ed842cbb4d72b7b53f2fbec3a\": container with ID starting with 12b0e2ed9b15aff6b87354081b5e028bd165582ed842cbb4d72b7b53f2fbec3a not found: ID does not exist" containerID="12b0e2ed9b15aff6b87354081b5e028bd165582ed842cbb4d72b7b53f2fbec3a" Jul 16 20:50:30.845552 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.845505 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12b0e2ed9b15aff6b87354081b5e028bd165582ed842cbb4d72b7b53f2fbec3a"} err="failed to get container status \"12b0e2ed9b15aff6b87354081b5e028bd165582ed842cbb4d72b7b53f2fbec3a\": rpc error: code = NotFound desc = could not find container \"12b0e2ed9b15aff6b87354081b5e028bd165582ed842cbb4d72b7b53f2fbec3a\": container with ID starting with 12b0e2ed9b15aff6b87354081b5e028bd165582ed842cbb4d72b7b53f2fbec3a not found: ID does not exist" Jul 16 20:50:30.852844 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.852811 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx"] Jul 16 20:50:30.858882 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.858853 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-8a0b5e-openshift-default-7b7876d9f9-jhvkx"] Jul 16 20:50:30.894173 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.894134 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-istio-data\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:50:30.894173 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.894166 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-credential-socket\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:50:30.894173 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.894177 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f512ca60-2754-4dab-8e66-5417c2f77232-istio-token\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:50:30.894425 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.894188 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb6r9\" (UniqueName: \"kubernetes.io/projected/f512ca60-2754-4dab-8e66-5417c2f77232-kube-api-access-lb6r9\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:50:30.894425 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.894198 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f512ca60-2754-4dab-8e66-5417c2f77232-istio-envoy\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:50:30.894425 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:30.894206 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f512ca60-2754-4dab-8e66-5417c2f77232-istio-podinfo\") on node \"ip-10-0-134-169.ec2.internal\" DevicePath \"\"" Jul 16 20:50:31.541298 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:31.541265 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-x8586_e7ddc294-dbfe-49c0-b69c-4fe014fedca9/manager/0.log" Jul 16 20:50:31.786053 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:31.786019 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cc6f6c9cc-hjtnc_9ed584e7-82e8-4a64-aaa2-7717f39a7529/manager/0.log" Jul 16 20:50:31.906758 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:31.906729 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jtwg5_9a586cbd-16d9-4ae8-a6b9-83d7faff22c7/server/0.log" Jul 16 20:50:32.018601 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:32.018564 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f512ca60-2754-4dab-8e66-5417c2f77232" path="/var/lib/kubelet/pods/f512ca60-2754-4dab-8e66-5417c2f77232/volumes" Jul 16 20:50:32.032462 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:32.032424 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fb4k4_96bb6697-a0e5-473e-ad38-e76d568f1871/manager/0.log" Jul 16 20:50:32.285291 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:32.285211 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64c594d8d4-h48xp_4a0c2983-50b3-4351-b4b0-9d1b399c253d/copy-manifests/0.log" Jul 16 20:50:32.294941 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:32.294915 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64c594d8d4-h48xp_4a0c2983-50b3-4351-b4b0-9d1b399c253d/manager/0.log" Jul 16 20:50:32.805294 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:32.805255 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-95db78549-89sj2_f81a4f3b-2ce0-416a-85b7-94949476f900/maas-api/0.log" Jul 16 20:50:35.974555 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:35.974517 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77d4cfbbcc-pjts2_ed9c02e7-93fe-49df-9c08-44b13569f562/authorino/0.log" Jul 16 20:50:36.094558 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:36.094533 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v6dvw_771f7f08-73ad-4939-9830-559e2576cbe1/manager/0.log" Jul 16 20:50:36.211819 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:36.211789 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5rmrj_ee8548e9-c103-47e8-b365-a81b86d899ea/manager/0.log" Jul 16 20:50:36.325350 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:36.325265 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x8h2j_15664b72-39d4-4f0b-a17b-6e3e6eca8a22/kuadrant-console-plugin/0.log" Jul 16 20:50:36.450130 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:36.450099 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-csmgc_e5370d87-12f5-497d-825e-8d781efde152/registry-server/0.log" Jul 16 20:50:36.585947 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:36.585915 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pmm66_10ced9a1-b9c3-4035-a904-d4fb44ff86c7/manager/0.log" Jul 16 20:50:36.825027 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:36.824987 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xg5tl_873fe72e-97f1-4ec8-9c68-78dde3c1acf7/manager/0.log" Jul 16 20:50:37.470648 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:37.470610 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59f964d6d4-4gjb4_264f4e7d-487b-401b-b119-4ebd50d80fbb/kube-auth-proxy/0.log" Jul 16 20:50:37.716055 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:37.715989 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wpqwg_7026a235-d98f-4857-b366-565ff9b30713/istio-proxy/1.log" Jul 16 20:50:37.835828 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:37.835789 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qbk28_2a3855c5-b00e-4c88-b317-a1e9520c0646/payload-pre-processing/0.log" Jul 16 20:50:38.073705 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:38.073673 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cbd95bbb-tngbx_8150a0a9-0feb-4c1d-9911-a56a59c792aa/router/0.log" Jul 16 20:50:38.434336 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:38.434304 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-w5jx8_7011edfe-745e-478b-8aa4-8bc094423937/main/0.log" Jul 16 20:50:39.034200 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:39.034169 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-rqnvl_36086c7e-1e06-4fa1-86f6-0eb9a54cf6a2/main/0.log" Jul 16 20:50:43.465025 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:43.464981 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:50:44.850910 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:44.850872 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:50:44.945461 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:44.945422 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" limit=1024 Jul 16 20:50:47.876323 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:47.876293 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fk2vw_e1d737e2-027f-4074-b311-f888a3d6c24a/global-pull-secret-syncer/0.log" Jul 16 20:50:48.019289 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:48.019254 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9c6q8_115a161c-beda-456d-b996-3eb637a04e98/konnectivity-agent/0.log" Jul 16 20:50:48.159059 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:48.158966 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-169.ec2.internal_63a9f66a5a3b782767a0da7bfdbce0f8/haproxy/0.log" Jul 16 20:50:53.428460 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:53.428421 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77d4cfbbcc-pjts2_ed9c02e7-93fe-49df-9c08-44b13569f562/authorino/0.log" Jul 16 20:50:53.460983 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:53.460943 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v6dvw_771f7f08-73ad-4939-9830-559e2576cbe1/manager/0.log" Jul 16 20:50:53.501448 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:53.501421 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5rmrj_ee8548e9-c103-47e8-b365-a81b86d899ea/manager/0.log" Jul 16 20:50:53.527735 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:53.527706 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x8h2j_15664b72-39d4-4f0b-a17b-6e3e6eca8a22/kuadrant-console-plugin/0.log" Jul 16 20:50:53.589886 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:53.589849 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-csmgc_e5370d87-12f5-497d-825e-8d781efde152/registry-server/0.log" Jul 16 20:50:53.812101 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:53.812009 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pmm66_10ced9a1-b9c3-4035-a904-d4fb44ff86c7/manager/0.log" Jul 16 20:50:53.934830 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:53.934796 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xg5tl_873fe72e-97f1-4ec8-9c68-78dde3c1acf7/manager/0.log" Jul 16 20:50:55.818643 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:55.818554 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-dvfjl_85fd6d59-457c-4fee-b0cf-738b64068a12/cluster-monitoring-operator/0.log" Jul 16 20:50:56.168125 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:56.168079 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-thvgr_a73911a2-66d4-4113-87d4-c33c2c2e63b8/node-exporter/0.log" Jul 16 20:50:56.191169 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:56.191130 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-thvgr_a73911a2-66d4-4113-87d4-c33c2c2e63b8/kube-rbac-proxy/0.log" Jul 16 20:50:56.214792 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:56.214744 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-thvgr_a73911a2-66d4-4113-87d4-c33c2c2e63b8/init-textfile/0.log" Jul 16 20:50:58.045931 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.045901 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-q8cx9_686d2769-c251-462c-b369-72a88d8b4eb3/networking-console-plugin/0.log" Jul 16 20:50:58.404603 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.404566 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7"] Jul 16 20:50:58.404993 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.404979 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f512ca60-2754-4dab-8e66-5417c2f77232" containerName="istio-proxy" Jul 16 20:50:58.405064 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.404994 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f512ca60-2754-4dab-8e66-5417c2f77232" containerName="istio-proxy" Jul 16 20:50:58.405064 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.405018 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f512ca60-2754-4dab-8e66-5417c2f77232" containerName="istio-proxy" Jul 16 20:50:58.405064 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.405024 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f512ca60-2754-4dab-8e66-5417c2f77232" containerName="istio-proxy" Jul 16 20:50:58.405064 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.405031 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75525a82-9f5f-4f2f-a5e4-cef2a12f63b3" containerName="main" Jul 16 20:50:58.405064 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.405036 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="75525a82-9f5f-4f2f-a5e4-cef2a12f63b3" containerName="main" Jul 16 20:50:58.405244 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.405093 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f512ca60-2754-4dab-8e66-5417c2f77232" containerName="istio-proxy" Jul 16 20:50:58.405244 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.405101 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="75525a82-9f5f-4f2f-a5e4-cef2a12f63b3" containerName="main" Jul 16 20:50:58.405244 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.405109 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f512ca60-2754-4dab-8e66-5417c2f77232" containerName="istio-proxy" Jul 16 20:50:58.408425 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.408403 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.411054 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.411026 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lw5rh\"/\"kube-root-ca.crt\"" Jul 16 20:50:58.411164 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.411031 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lw5rh\"/\"openshift-service-ca.crt\"" Jul 16 20:50:58.411895 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.411880 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lw5rh\"/\"default-dockercfg-xznfh\"" Jul 16 20:50:58.416675 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.416652 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7"] Jul 16 20:50:58.443237 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.443204 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dc10cfe-c2e8-45ee-b519-5011375e1903-sys\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.443434 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.443264 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dc10cfe-c2e8-45ee-b519-5011375e1903-lib-modules\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.443434 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.443297 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdxvx\" (UniqueName: \"kubernetes.io/projected/1dc10cfe-c2e8-45ee-b519-5011375e1903-kube-api-access-cdxvx\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.443434 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.443366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1dc10cfe-c2e8-45ee-b519-5011375e1903-podres\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.443434 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.443411 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1dc10cfe-c2e8-45ee-b519-5011375e1903-proc\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.543887 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.543849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dc10cfe-c2e8-45ee-b519-5011375e1903-lib-modules\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.544084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.543898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdxvx\" (UniqueName: \"kubernetes.io/projected/1dc10cfe-c2e8-45ee-b519-5011375e1903-kube-api-access-cdxvx\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.544084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.543934 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1dc10cfe-c2e8-45ee-b519-5011375e1903-podres\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.544084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.543963 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1dc10cfe-c2e8-45ee-b519-5011375e1903-proc\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.544084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.544011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dc10cfe-c2e8-45ee-b519-5011375e1903-sys\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.544084 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.544046 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dc10cfe-c2e8-45ee-b519-5011375e1903-lib-modules\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.544325 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.544083 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1dc10cfe-c2e8-45ee-b519-5011375e1903-proc\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.544325 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.544100 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dc10cfe-c2e8-45ee-b519-5011375e1903-sys\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.544325 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.544101 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1dc10cfe-c2e8-45ee-b519-5011375e1903-podres\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.552905 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.552881 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdxvx\" (UniqueName: \"kubernetes.io/projected/1dc10cfe-c2e8-45ee-b519-5011375e1903-kube-api-access-cdxvx\") pod \"perf-node-gather-daemonset-8nns7\" (UID: \"1dc10cfe-c2e8-45ee-b519-5011375e1903\") " pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.675480 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.675378 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/1.log" Jul 16 20:50:58.683616 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.683590 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hlv9f_dd78c5ca-602a-4ec2-8614-d9de444124e8/console-operator/2.log" Jul 16 20:50:58.719104 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.719076 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.870256 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.870231 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7"] Jul 16 20:50:58.872235 ip-10-0-134-169 kubenswrapper[2575]: W0716 20:50:58.872207 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1dc10cfe_c2e8_45ee_b519_5011375e1903.slice/crio-d3d1c2138aab341ac48bc69893ea039ded6922d2520ee943b0a6e5f68018439e WatchSource:0}: Error finding container d3d1c2138aab341ac48bc69893ea039ded6922d2520ee943b0a6e5f68018439e: Status 404 returned error can't find the container with id d3d1c2138aab341ac48bc69893ea039ded6922d2520ee943b0a6e5f68018439e Jul 16 20:50:58.982324 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.982287 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" event={"ID":"1dc10cfe-c2e8-45ee-b519-5011375e1903","Type":"ContainerStarted","Data":"15c1c77c7d84bc80de42124fc3e624fb4b839f4ef942cea9384ed2900a160c2d"} Jul 16 20:50:58.982531 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.982339 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" event={"ID":"1dc10cfe-c2e8-45ee-b519-5011375e1903","Type":"ContainerStarted","Data":"d3d1c2138aab341ac48bc69893ea039ded6922d2520ee943b0a6e5f68018439e"} Jul 16 20:50:58.982531 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.982418 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:50:58.999326 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:58.999272 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" podStartSLOduration=0.999254466 podStartE2EDuration="999.254466ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:50:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:50:58.998945739 +0000 UTC m=+3055.462298770" watchObservedRunningTime="2026-07-16 20:50:58.999254466 +0000 UTC m=+3055.462607499" Jul 16 20:50:59.881225 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:50:59.881194 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-rjkcf_92546ba6-c8be-4bca-bdd4-a4f1d283bdb7/volume-data-source-validator/0.log" Jul 16 20:51:00.951163 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:00.951129 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-472fn_704043dc-663b-4a9f-a7aa-f80384bdbb39/dns/0.log" Jul 16 20:51:00.975259 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:00.975229 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-472fn_704043dc-663b-4a9f-a7aa-f80384bdbb39/kube-rbac-proxy/0.log" Jul 16 20:51:01.139519 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:01.139492 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hs9v2_dc797cd1-de45-4071-85e2-8c551bee19af/dns-node-resolver/0.log" Jul 16 20:51:01.797067 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:01.797033 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k8pmr_034aaa90-6ffb-454d-9c1b-8c43d45e428f/node-ca/0.log" Jul 16 20:51:03.107128 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:03.107091 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59f964d6d4-4gjb4_264f4e7d-487b-401b-b119-4ebd50d80fbb/kube-auth-proxy/0.log" Jul 16 20:51:03.164937 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:03.164904 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wpqwg_7026a235-d98f-4857-b366-565ff9b30713/istio-proxy/0.log" Jul 16 20:51:03.220285 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:03.220253 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wpqwg_7026a235-d98f-4857-b366-565ff9b30713/istio-proxy/1.log" Jul 16 20:51:03.258644 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:03.258604 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qbk28_2a3855c5-b00e-4c88-b317-a1e9520c0646/payload-pre-processing/0.log" Jul 16 20:51:03.321292 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:03.321260 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cbd95bbb-tngbx_8150a0a9-0feb-4c1d-9911-a56a59c792aa/router/0.log" Jul 16 20:51:04.130855 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:04.130829 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qgzz2_4681653d-f640-4ade-b608-ef327d5d7fa6/serve-healthcheck-canary/0.log" Jul 16 20:51:04.636298 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:04.636263 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-lpkxh_f501e4af-fcc0-4f89-8cf0-bc3831c009e2/insights-operator/0.log" Jul 16 20:51:04.637686 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:04.637647 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-lpkxh_f501e4af-fcc0-4f89-8cf0-bc3831c009e2/insights-operator/1.log" Jul 16 20:51:04.726138 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:04.726113 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ft2n2_ddcc157a-aae4-4081-9097-d3ac4cc32e64/kube-rbac-proxy/0.log" Jul 16 20:51:04.748572 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:04.748536 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ft2n2_ddcc157a-aae4-4081-9097-d3ac4cc32e64/exporter/0.log" Jul 16 20:51:04.769181 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:04.769155 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ft2n2_ddcc157a-aae4-4081-9097-d3ac4cc32e64/extractor/0.log" Jul 16 20:51:05.004126 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:05.004051 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lw5rh/perf-node-gather-daemonset-8nns7" Jul 16 20:51:07.123469 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:07.123440 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-x8586_e7ddc294-dbfe-49c0-b69c-4fe014fedca9/manager/0.log" Jul 16 20:51:07.525421 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:07.525385 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cc6f6c9cc-hjtnc_9ed584e7-82e8-4a64-aaa2-7717f39a7529/manager/0.log" Jul 16 20:51:07.550135 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:07.550110 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jtwg5_9a586cbd-16d9-4ae8-a6b9-83d7faff22c7/server/0.log" Jul 16 20:51:07.659897 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:07.659797 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fb4k4_96bb6697-a0e5-473e-ad38-e76d568f1871/manager/0.log" Jul 16 20:51:07.750052 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:07.750019 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64c594d8d4-h48xp_4a0c2983-50b3-4351-b4b0-9d1b399c253d/manager/0.log" Jul 16 20:51:07.774486 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:07.774455 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64c594d8d4-h48xp_4a0c2983-50b3-4351-b4b0-9d1b399c253d/copy-manifests/0.log" Jul 16 20:51:08.615638 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:08.615611 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59f964d6d4-4gjb4_264f4e7d-487b-401b-b119-4ebd50d80fbb/kube-auth-proxy/0.log" Jul 16 20:51:08.651203 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:08.651171 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wpqwg_7026a235-d98f-4857-b366-565ff9b30713/istio-proxy/0.log" Jul 16 20:51:08.705921 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:08.705888 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wpqwg_7026a235-d98f-4857-b366-565ff9b30713/istio-proxy/1.log" Jul 16 20:51:08.733521 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:08.733491 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qbk28_2a3855c5-b00e-4c88-b317-a1e9520c0646/payload-pre-processing/0.log" Jul 16 20:51:08.778140 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:08.778051 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cbd95bbb-tngbx_8150a0a9-0feb-4c1d-9911-a56a59c792aa/router/0.log" Jul 16 20:51:10.247188 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:10.247157 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59f964d6d4-4gjb4_264f4e7d-487b-401b-b119-4ebd50d80fbb/kube-auth-proxy/0.log" Jul 16 20:51:10.283831 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:10.283797 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wpqwg_7026a235-d98f-4857-b366-565ff9b30713/istio-proxy/0.log" Jul 16 20:51:10.339374 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:10.339340 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wpqwg_7026a235-d98f-4857-b366-565ff9b30713/istio-proxy/1.log" Jul 16 20:51:10.371520 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:10.371425 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qbk28_2a3855c5-b00e-4c88-b317-a1e9520c0646/payload-pre-processing/0.log" Jul 16 20:51:10.416890 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:10.416865 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cbd95bbb-tngbx_8150a0a9-0feb-4c1d-9911-a56a59c792aa/router/0.log" Jul 16 20:51:14.210819 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:14.210785 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-k27tg_a44f15c0-556c-44a8-904c-61f1e1994097/migrator/0.log" Jul 16 20:51:14.233322 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:14.233287 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-k27tg_a44f15c0-556c-44a8-904c-61f1e1994097/graceful-termination/0.log" Jul 16 20:51:14.622868 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:14.622837 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-zsw8q_a6107c67-4cd3-4a39-8c05-98e0275776ac/kube-storage-version-migrator-operator/1.log" Jul 16 20:51:14.624623 ip-10-0-134-169 kubenswrapper[2575]: I0716 20:51:14.624594 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-zsw8q_a6107c67-4cd3-4a39-8c05-98e0275776ac/kube-storage-version-migrator-operator/0.log"