Jul 01 16:06:45.252038 ip-10-0-130-217 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 01 16:06:45.252052 ip-10-0-130-217 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 01 16:06:45.252061 ip-10-0-130-217 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 01 16:06:45.252373 ip-10-0-130-217 systemd[1]: Failed to start Kubernetes Kubelet. Jul 01 16:06:55.501435 ip-10-0-130-217 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 01 16:06:55.501453 ip-10-0-130-217 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 50cdfd375b284f05908b5dfd30e97db4 -- Jul 01 16:09:05.195937 ip-10-0-130-217 systemd[1]: Starting Kubernetes Kubelet... Jul 01 16:09:05.641582 ip-10-0-130-217 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:09:05.641582 ip-10-0-130-217 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 16:09:05.641582 ip-10-0-130-217 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:09:05.641582 ip-10-0-130-217 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 16:09:05.641582 ip-10-0-130-217 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:09:05.643333 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.643191 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 16:09:05.649684 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649669 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:09:05.649684 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649684 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649687 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649691 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649694 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649697 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649700 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649703 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649705 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649708 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649711 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649714 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649716 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649719 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649722 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649724 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649728 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649731 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649733 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649736 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:09:05.649749 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649738 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649741 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649743 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649746 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649748 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649751 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649754 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649756 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649759 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649762 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649768 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649772 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649776 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649780 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649816 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649823 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649827 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649831 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649835 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:09:05.650195 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649838 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649842 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649844 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649847 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649850 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649853 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649855 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649858 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649863 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649866 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649868 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649870 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649875 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649880 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649886 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649891 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649895 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649898 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649901 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:09:05.650653 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649904 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649907 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649909 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649913 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649915 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649918 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649921 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649925 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649929 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649932 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649936 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649938 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649941 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649944 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649946 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649949 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649952 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649955 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649958 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649960 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:09:05.651104 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649963 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649965 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649968 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649971 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649974 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649976 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649979 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649984 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649987 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649989 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649992 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649995 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.649997 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650000 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650002 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650005 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650008 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650011 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650013 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650017 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:09:05.651579 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650020 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650766 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650783 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650787 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650790 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650793 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650798 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650801 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650804 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650807 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650810 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650812 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650815 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650817 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650820 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650822 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650825 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650827 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650830 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:09:05.652068 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650832 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650835 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650837 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650840 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650843 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650845 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650848 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650850 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650853 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650856 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650858 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650860 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650863 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650867 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650869 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650872 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650875 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650878 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650881 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650883 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:09:05.652520 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650886 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650888 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650890 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650893 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650895 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650898 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650900 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650903 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650905 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650907 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650910 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650912 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650916 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650918 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650921 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650923 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650926 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650928 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650931 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650933 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:09:05.653018 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650936 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650938 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650941 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650943 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650946 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650950 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650952 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650955 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650957 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650960 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650963 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650965 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650968 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650971 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650974 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650976 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650979 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650981 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650984 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:09:05.653514 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650986 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650989 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650991 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650994 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650996 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.650999 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651001 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651004 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651006 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651009 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651012 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651016 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651019 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651022 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651025 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651028 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651031 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651034 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651038 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651041 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:09:05.653978 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651043 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651046 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651402 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651407 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651409 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651412 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651415 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651418 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651421 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651424 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651427 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651429 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651432 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651434 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651437 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651440 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651442 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651445 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651447 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651450 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:09:05.654471 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651453 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651455 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651458 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651460 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651463 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651465 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651467 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651470 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651472 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651476 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651478 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651481 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651484 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651486 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651489 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651491 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651494 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651498 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651501 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:09:05.654964 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651505 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651508 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651511 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651513 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651516 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651518 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651521 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651523 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651525 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651528 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651530 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651533 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651535 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651537 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651540 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651543 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651545 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651548 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651552 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:09:05.655415 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651555 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651558 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651561 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651564 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651566 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651569 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651573 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651576 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651579 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651582 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651585 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651588 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651591 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651594 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651596 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651599 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651601 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651604 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651606 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651609 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:09:05.655908 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651611 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651614 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651617 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651619 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651622 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651624 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651626 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651644 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651647 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651650 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651652 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651655 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651657 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651660 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651662 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651665 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651668 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651670 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651673 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651675 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:09:05.656379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651678 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651680 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.651683 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651751 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651758 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651764 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651770 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651774 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651777 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651781 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651785 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651788 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651791 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651795 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651799 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651802 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651805 2577 flags.go:64] FLAG: --cgroup-root="" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651808 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651811 2577 flags.go:64] FLAG: --client-ca-file="" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651813 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651816 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651820 2577 flags.go:64] FLAG: --cluster-domain="" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651823 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 16:09:05.656864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651826 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651829 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651832 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651840 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651843 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651847 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651850 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651853 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651856 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651859 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651863 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651866 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651870 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651873 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651876 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651879 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651883 2577 flags.go:64] FLAG: --enable-server="true" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651885 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651889 2577 flags.go:64] FLAG: --event-burst="100" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651892 2577 flags.go:64] FLAG: --event-qps="50" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651895 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651898 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651901 2577 flags.go:64] FLAG: --eviction-hard="" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651905 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 16:09:05.657452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651908 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651911 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651913 2577 flags.go:64] FLAG: --eviction-soft="" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651916 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651919 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651922 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651925 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651928 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651931 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651934 2577 flags.go:64] FLAG: --feature-gates="" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651937 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651944 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651947 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651950 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651953 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651956 2577 flags.go:64] FLAG: --help="false" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651959 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-130-217.ec2.internal" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651962 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651965 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651968 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651971 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651974 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651977 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 16:09:05.658040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651980 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651983 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651986 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651989 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651992 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651995 2577 flags.go:64] FLAG: --kube-reserved="" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.651998 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652001 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652004 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652007 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652010 2577 flags.go:64] FLAG: --lock-file="" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652012 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652015 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652018 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652023 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652026 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652029 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652031 2577 flags.go:64] FLAG: --logging-format="text" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652034 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652038 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652041 2577 flags.go:64] FLAG: --manifest-url="" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652044 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652049 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652052 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652055 2577 flags.go:64] FLAG: --max-pods="110" Jul 01 16:09:05.658738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652058 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652061 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652064 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652067 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652070 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652073 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652076 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652084 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652088 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652091 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652094 2577 flags.go:64] FLAG: --pod-cidr="" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652097 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652102 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652105 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652108 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652111 2577 flags.go:64] FLAG: --port="10250" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652114 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652117 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08a90c1ef4db6a261" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652120 2577 flags.go:64] FLAG: --qos-reserved="" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652123 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652126 2577 flags.go:64] FLAG: --register-node="true" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652129 2577 flags.go:64] FLAG: --register-with-taints="" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652132 2577 flags.go:64] FLAG: --registry-burst="10" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652135 2577 flags.go:64] FLAG: --registry-qps="5" Jul 01 16:09:05.659427 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652138 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652140 2577 flags.go:64] FLAG: --reserved-memory="" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652144 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652147 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652151 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652154 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652157 2577 flags.go:64] FLAG: --runonce="false" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652159 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652162 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652165 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652168 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652171 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652174 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652178 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652181 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652184 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652187 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652190 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652192 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652195 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652198 2577 flags.go:64] FLAG: --system-cgroups="" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652201 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652207 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652210 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652212 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 16:09:05.660326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652216 2577 flags.go:64] FLAG: --tls-min-version="" Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652219 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652222 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652224 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652228 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652231 2577 flags.go:64] FLAG: --v="2" Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652234 2577 flags.go:64] FLAG: --version="false" Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652238 2577 flags.go:64] FLAG: --vmodule="" Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652242 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.652245 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652376 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652381 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652384 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652387 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652390 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652392 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652395 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652397 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652400 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652403 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652405 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652408 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652410 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:09:05.660984 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652413 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652416 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652419 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652421 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652424 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652426 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652430 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652432 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652435 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652438 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652440 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652442 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652445 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652448 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652450 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652453 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652456 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652458 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652461 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:09:05.661545 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652463 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652467 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652470 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652472 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652475 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652479 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652482 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652485 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652488 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652491 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652494 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652496 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652499 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652501 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652504 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652507 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652509 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652512 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652514 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:09:05.662027 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652518 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652521 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652524 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652526 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652529 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652532 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652534 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652537 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652540 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652542 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652544 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652547 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652549 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652552 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652556 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652559 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652561 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652564 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652566 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652569 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:09:05.662482 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652572 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652574 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652577 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652579 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652582 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652585 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652588 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652590 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652593 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652596 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652600 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652603 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652607 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652610 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652613 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652617 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652620 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652623 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652626 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:09:05.662983 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652641 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652645 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652647 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652650 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652653 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652655 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652658 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652662 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.652665 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.653359 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.661770 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.661784 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.662654 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.662662 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 16:09:05.663442 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662718 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662723 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662726 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662729 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662732 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662735 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662737 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662740 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662745 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662749 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662752 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662755 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662758 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662761 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662764 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662767 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662770 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662772 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662775 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662778 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:09:05.663828 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662780 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662783 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662786 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662788 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662791 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662794 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662797 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662799 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662803 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662806 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662808 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662811 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662813 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662816 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662818 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662821 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662824 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662827 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662829 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:09:05.664306 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662833 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662837 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662840 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662843 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662846 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662848 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662851 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662853 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662856 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662858 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662861 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662863 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662866 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662870 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662872 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662875 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662877 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662880 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662883 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662885 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:09:05.664798 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662888 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662891 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662893 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662896 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662898 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662901 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662904 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662906 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662909 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662911 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662914 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662917 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662919 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662922 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662925 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662927 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662930 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662932 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662935 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662938 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:09:05.665282 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662941 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662944 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662946 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662948 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662951 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662954 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662957 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662960 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662964 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662968 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662971 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662974 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662977 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662980 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662983 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662986 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662989 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662992 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662995 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:09:05.665778 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.662997 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.663002 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663111 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663116 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663120 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663122 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663125 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663127 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663130 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663132 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663135 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663137 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663140 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663142 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663145 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663148 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:09:05.666241 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663150 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663153 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663155 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663158 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663160 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663163 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663166 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663169 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663171 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663174 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663176 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663179 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663183 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663186 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663190 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663193 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663196 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663198 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663201 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:09:05.666620 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663204 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663206 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663209 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663212 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663214 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663217 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663220 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663222 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663225 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663227 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663230 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663233 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663236 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663238 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663240 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663243 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663246 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663248 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663251 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:09:05.667080 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663253 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663256 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663260 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663263 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663266 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663270 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663273 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663276 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663279 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663281 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663284 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663287 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663290 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663292 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663294 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663297 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663299 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663302 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663304 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:09:05.667538 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663307 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663310 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663314 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663317 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663320 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663322 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663325 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663328 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663330 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663333 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663336 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663338 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663341 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663343 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663346 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663349 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663351 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663354 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663356 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663359 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:09:05.667998 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663361 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:09:05.668486 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663364 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:09:05.668486 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663366 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:09:05.668486 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663369 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:09:05.668486 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663372 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:09:05.668486 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663374 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:09:05.668486 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663376 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:09:05.668486 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:05.663379 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:09:05.668486 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.663384 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:09:05.668486 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.663487 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 16:09:05.668724 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.668494 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 16:09:05.669961 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.669949 2577 server.go:1019] "Starting client certificate rotation" Jul 01 16:09:05.670064 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.670048 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:09:05.670092 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.670080 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:09:05.672767 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.672754 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:09:05.675601 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.675584 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:09:05.685421 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.685401 2577 log.go:25] "Validated CRI v1 runtime API" Jul 01 16:09:05.688054 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.688039 2577 log.go:25] "Validated CRI v1 image API" Jul 01 16:09:05.688842 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.688825 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 16:09:05.691296 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.691273 2577 fs.go:135] Filesystem UUIDs: map[2e0fef76-90bc-4268-81bc-04c30349dd89:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ca494c85-d317-481b-bdcf-89540a6a4986:/dev/nvme0n1p4] Jul 01 16:09:05.691355 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.691297 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 16:09:05.696308 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.696284 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:09:05.697180 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.697065 2577 manager.go:216] Machine: {Timestamp:2026-07-01 16:09:05.695166533 +0000 UTC m=+0.374791802 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098229 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a0b18f4081f2ba8344d4230c19fc4 SystemUUID:ec2a0b18-f408-1f2b-a834-4d4230c19fc4 BootID:50cdfd37-5b28-4f05-908b-5dfd30e97db4 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:30:d8:0e:91:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:30:d8:0e:91:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:09:86:97:c1:1e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 16:09:05.697180 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.697174 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 16:09:05.697305 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.697254 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 16:09:05.701071 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.700877 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 16:09:05.701203 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.701074 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-217.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 16:09:05.701976 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.701966 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 16:09:05.702014 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.701978 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 16:09:05.702014 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.701986 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:09:05.702839 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.702829 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:09:05.704127 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.704117 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 16:09:05.708329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.708317 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:09:05.708441 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.708431 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 16:09:05.708478 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.708461 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 01 16:09:05.708478 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.708470 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 16:09:05.708545 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.708483 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 16:09:05.708545 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.708492 2577 kubelet.go:398] "Adding apiserver pod source" Jul 01 16:09:05.708545 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.708499 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 16:09:05.708882 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.708870 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:09:05.708914 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.708892 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:09:05.711096 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.711080 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 16:09:05.712908 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.712895 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 16:09:05.712980 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.712924 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 16:09:05.713538 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.713526 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 16:09:05.713609 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.713541 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 16:09:05.713609 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.713547 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 16:09:05.713609 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.713553 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 16:09:05.713609 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.713562 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 16:09:05.713609 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.713567 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 16:09:05.713760 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.713731 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 16:09:05.713760 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.713738 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 16:09:05.713760 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.713745 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 16:09:05.713760 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.713750 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 16:09:05.713872 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.713762 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 16:09:05.713872 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.713771 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 16:09:05.715446 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.715435 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 16:09:05.715446 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.715445 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 16:09:05.716962 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.716941 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-217.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 16:09:05.716962 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.716944 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 16:09:05.717078 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.716973 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-217.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 16:09:05.718658 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.718644 2577 server.go:1268] "Started kubelet" Jul 01 16:09:05.718746 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.718708 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 16:09:05.718796 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.718729 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 16:09:05.718846 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.718796 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 16:09:05.719517 ip-10-0-130-217 systemd[1]: Started Kubernetes Kubelet. Jul 01 16:09:05.719688 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.719671 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xrccw" Jul 01 16:09:05.719752 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.719715 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 01 16:09:05.720308 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.720261 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 16:09:05.724934 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.724911 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 16:09:05.727404 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.727389 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xrccw" Jul 01 16:09:05.728528 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.728509 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 16:09:05.728528 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.728519 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 16:09:05.728688 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.728606 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found" Jul 01 16:09:05.729298 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.729277 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 16:09:05.729298 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.729278 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 16:09:05.729451 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.729303 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 16:09:05.729451 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.729354 2577 factory.go:55] Registering systemd factory Jul 01 16:09:05.729451 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.729369 2577 factory.go:223] Registration of the systemd container factory successfully Jul 01 16:09:05.729451 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.729424 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 01 16:09:05.729451 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.729434 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 01 16:09:05.729686 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.729581 2577 factory.go:153] Registering CRI-O factory Jul 01 16:09:05.729686 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.729606 2577 factory.go:223] Registration of the crio container factory successfully Jul 01 16:09:05.729686 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.729676 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 16:09:05.729807 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.729696 2577 factory.go:103] Registering Raw factory Jul 01 16:09:05.729807 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.729708 2577 manager.go:1196] Started watching for new ooms in manager Jul 01 16:09:05.730038 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.729070 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-217.ec2.internal.18be363ec5bbf523 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-217.ec2.internal,UID:ip-10-0-130-217.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-217.ec2.internal,},FirstTimestamp:2026-07-01 16:09:05.718596899 +0000 UTC m=+0.398222167,LastTimestamp:2026-07-01 16:09:05.718596899 +0000 UTC m=+0.398222167,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-217.ec2.internal,}" Jul 01 16:09:05.730208 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.730195 2577 manager.go:349] Starting recovery of all containers Jul 01 16:09:05.740795 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.740611 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:09:05.741409 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.741393 2577 manager.go:354] Recovery completed Jul 01 16:09:05.743791 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.743770 2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-217.ec2.internal\" not found" node="ip-10-0-130-217.ec2.internal" Jul 01 16:09:05.746541 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.746529 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:09:05.748220 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.748205 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:09:05.748265 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.748233 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:09:05.748265 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.748243 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:09:05.748817 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.748708 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 16:09:05.748817 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.748715 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:09:05.748817 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.748716 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 16:09:05.748817 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.748769 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:09:05.749426 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.749414 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:09:05.749467 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.749437 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:09:05.749467 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.749446 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:09:05.750444 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.750432 2577 policy_none.go:49] "None policy: Start" Jul 01 16:09:05.750485 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.750447 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 16:09:05.750485 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.750457 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 16:09:05.751757 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.751745 2577 policy_none.go:47] "Start" Jul 01 16:09:05.788229 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.788216 2577 manager.go:337] "Starting Device Plugin manager" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.788245 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.788254 2577 server.go:87] "Starting device plugin registration server" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.788538 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.788595 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.788726 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.788814 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.788825 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.789296 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.789345 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-217.ec2.internal\" not found" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.795360 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.796472 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.796504 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.796522 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.796551 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 16:09:05.812140 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.799147 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:09:05.889411 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.889375 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:09:05.890484 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.890467 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:09:05.890568 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.890500 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:09:05.890568 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.890519 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:09:05.890568 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.890559 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-217.ec2.internal" Jul 01 16:09:05.897536 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.897485 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal"] Jul 01 16:09:05.897588 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.897552 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:09:05.898359 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.898339 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:09:05.898449 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.898377 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:09:05.898449 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.898395 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:09:05.899352 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.899337 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-217.ec2.internal" Jul 01 16:09:05.899416 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.899365 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-217.ec2.internal\": node \"ip-10-0-130-217.ec2.internal\" not found" Jul 01 16:09:05.900361 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.900346 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:09:05.900464 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.900450 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" Jul 01 16:09:05.900512 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.900477 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:09:05.901063 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.901047 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:09:05.901144 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.901072 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:09:05.901144 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.901090 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:09:05.901239 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.901071 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:09:05.901239 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.901166 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:09:05.901239 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.901178 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:09:05.902760 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.902742 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal" Jul 01 16:09:05.902852 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.902765 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:09:05.903459 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.903444 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:09:05.903533 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.903472 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:09:05.903533 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.903481 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:09:05.915949 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.915929 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found" Jul 01 16:09:05.928257 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.928234 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-217.ec2.internal\" not found" node="ip-10-0-130-217.ec2.internal" Jul 01 16:09:05.930278 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.930262 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd1094fc4a9f440f8c23b90cb63f4403-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal\" (UID: \"cd1094fc4a9f440f8c23b90cb63f4403\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" Jul 01 16:09:05.930335 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.930284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd1094fc4a9f440f8c23b90cb63f4403-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal\" (UID: \"cd1094fc4a9f440f8c23b90cb63f4403\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" Jul 01 16:09:05.930335 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:05.930302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fcd975de0452e008bc237379d64b3e7d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-217.ec2.internal\" (UID: \"fcd975de0452e008bc237379d64b3e7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal" Jul 01 16:09:05.932682 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:05.932668 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-217.ec2.internal\" not found" node="ip-10-0-130-217.ec2.internal" Jul 01 16:09:06.016488 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.016466 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found" Jul 01 16:09:06.030988 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.030961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd1094fc4a9f440f8c23b90cb63f4403-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal\" (UID: \"cd1094fc4a9f440f8c23b90cb63f4403\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" Jul 01 16:09:06.031070 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.030994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd1094fc4a9f440f8c23b90cb63f4403-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal\" (UID: \"cd1094fc4a9f440f8c23b90cb63f4403\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" Jul 01 16:09:06.031070 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.031013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fcd975de0452e008bc237379d64b3e7d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-217.ec2.internal\" (UID: \"fcd975de0452e008bc237379d64b3e7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal" Jul 01 16:09:06.031070 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.031037 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fcd975de0452e008bc237379d64b3e7d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-217.ec2.internal\" (UID: \"fcd975de0452e008bc237379d64b3e7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal" Jul 01 16:09:06.031070 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.031051 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd1094fc4a9f440f8c23b90cb63f4403-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal\" (UID: \"cd1094fc4a9f440f8c23b90cb63f4403\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" Jul 01 16:09:06.031210 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.031083 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd1094fc4a9f440f8c23b90cb63f4403-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal\" (UID: \"cd1094fc4a9f440f8c23b90cb63f4403\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" Jul 01 16:09:06.116898 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.116870 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found" Jul 01 16:09:06.217653 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.217564 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found" Jul 01 16:09:06.232955 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.232929 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" Jul 01 16:09:06.237464 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.237449 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal" Jul 01 16:09:06.318027 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.317996 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found" Jul 01 16:09:06.418541 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.418514 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found" Jul 01 16:09:06.519081 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.518996 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found" Jul 01 16:09:06.619566 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.619538 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found" Jul 01 16:09:06.658844 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.658820 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:09:06.669062 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.669045 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 16:09:06.669170 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.669143 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 16:09:06.669217 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.669203 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 16:09:06.669254 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.669207 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 16:09:06.709347 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.709328 2577 apiserver.go:52] "Watching apiserver" Jul 01 16:09:06.727448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.727427 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:09:06.728614 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.728595 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 16:09:06.728971 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.728955 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" Jul 01 16:09:06.729027 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.728977 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 16:09:06.729285 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.729267 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-ckhcp","openshift-image-registry/node-ca-5h5b6","openshift-multus/multus-additional-cni-plugins-p59n9","openshift-network-diagnostics/network-check-target-z4n5q","openshift-network-operator/iptables-alerter-cg5h4","openshift-ovn-kubernetes/ovnkube-node-jvpld","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm","openshift-cluster-node-tuning-operator/tuned-kjpx4","openshift-dns/node-resolver-b86ld","openshift-multus/multus-pt8dd","openshift-multus/network-metrics-daemon-b46xt","kube-system/global-pull-secret-syncer-j8fcp"] Jul 01 16:09:06.731141 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.731128 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5h5b6" Jul 01 16:09:06.732921 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.732900 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.732921 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.732911 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8m965\"" Jul 01 16:09:06.733079 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.732924 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 16:04:05 +0000 UTC" deadline="2028-01-20 19:05:44.336204123 +0000 UTC" Jul 01 16:09:06.733079 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.732961 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13634h56m37.603246814s" Jul 01 16:09:06.733079 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.733017 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 16:09:06.733079 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.733019 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 16:09:06.733379 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.733366 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 16:09:06.734357 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.734343 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/534f29c6-46ba-43f3-b9eb-25c35d9302b1-host\") pod \"node-ca-5h5b6\" (UID: \"534f29c6-46ba-43f3-b9eb-25c35d9302b1\") " pod="openshift-image-registry/node-ca-5h5b6" Jul 01 16:09:06.734412 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.734367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/534f29c6-46ba-43f3-b9eb-25c35d9302b1-serviceca\") pod \"node-ca-5h5b6\" (UID: \"534f29c6-46ba-43f3-b9eb-25c35d9302b1\") " pod="openshift-image-registry/node-ca-5h5b6" Jul 01 16:09:06.734412 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.734387 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45t5h\" (UniqueName: \"kubernetes.io/projected/534f29c6-46ba-43f3-b9eb-25c35d9302b1-kube-api-access-45t5h\") pod \"node-ca-5h5b6\" (UID: \"534f29c6-46ba-43f3-b9eb-25c35d9302b1\") " pod="openshift-image-registry/node-ca-5h5b6" Jul 01 16:09:06.734518 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.734503 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.734589 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.734575 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 16:09:06.734662 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.734623 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 16:09:06.734719 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.734687 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 16:09:06.734769 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.734735 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4nrcz\"" Jul 01 16:09:06.734769 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.734757 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 16:09:06.735114 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.735099 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 16:09:06.735705 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.735691 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b86ld" Jul 01 16:09:06.736354 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.736327 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 16:09:06.736354 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.736341 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 16:09:06.736643 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.736596 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 16:09:06.736757 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.736728 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m9p7v\"" Jul 01 16:09:06.737185 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.737170 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.737511 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.737495 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-svqpf\"" Jul 01 16:09:06.737591 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.737576 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 16:09:06.737659 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.737616 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 16:09:06.738536 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.738522 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ckhcp" Jul 01 16:09:06.738931 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.738915 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:09:06.738931 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.738922 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jrq6f\"" Jul 01 16:09:06.739122 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.739110 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 16:09:06.739987 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.739975 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:06.740043 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.740027 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:06.740282 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.740266 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 16:09:06.740363 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.740349 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-phhrz\"" Jul 01 16:09:06.740424 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.740349 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 16:09:06.741549 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.741536 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cg5h4" Jul 01 16:09:06.743160 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.743144 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.743915 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.743899 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 16:09:06.744060 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.744046 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:09:06.744354 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.744337 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wkqvc\"" Jul 01 16:09:06.744425 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.744341 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:09:06.744462 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.744427 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 16:09:06.744462 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.744446 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal" Jul 01 16:09:06.745187 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.745171 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.746225 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.746197 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 16:09:06.746225 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.746209 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 16:09:06.746225 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.746199 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 16:09:06.746516 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.746251 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 16:09:06.746516 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.746311 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 16:09:06.746615 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.746603 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p5mvt\"" Jul 01 16:09:06.746676 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.746615 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 16:09:06.747085 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.747067 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 16:09:06.747191 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.747176 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:09:06.747529 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.747511 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:06.747623 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.747569 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:06.747910 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.747897 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sdhdl\"" Jul 01 16:09:06.748419 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.748400 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal"] Jul 01 16:09:06.748500 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.748456 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:06.748557 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.748519 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:06.753400 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.753367 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:09:06.753562 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.753541 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal"] Jul 01 16:09:06.762336 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.762316 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rnhlk" Jul 01 16:09:06.770279 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.770224 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rnhlk" Jul 01 16:09:06.830188 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.830165 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 16:09:06.834968 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.834947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21eb759a-7b1e-4ac1-aab1-00429b75021c-env-overrides\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.835071 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.834974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-sysconfig\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.835071 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.834990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-sysctl-conf\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.835071 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835016 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcr6n\" (UniqueName: \"kubernetes.io/projected/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-kube-api-access-zcr6n\") pod \"network-metrics-daemon-b46xt\" (UID: \"3af13f32-337f-4a5e-8cbe-078f1e9a95b0\") " pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:06.835071 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-run-ovn-kubernetes\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.835191 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835084 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/887c4c96-28a9-4186-94ff-331743b555e5-agent-certs\") pod \"konnectivity-agent-ckhcp\" (UID: \"887c4c96-28a9-4186-94ff-331743b555e5\") " pod="kube-system/konnectivity-agent-ckhcp" Jul 01 16:09:06.835191 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/97f53243-652b-4225-88e1-8f0b6c55bcd0-hosts-file\") pod \"node-resolver-b86ld\" (UID: \"97f53243-652b-4225-88e1-8f0b6c55bcd0\") " pod="openshift-dns/node-resolver-b86ld" Jul 01 16:09:06.835191 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-var-lib-cni-multus\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.835191 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-etc-kubernetes\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.835307 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/887c4c96-28a9-4186-94ff-331743b555e5-konnectivity-ca\") pod \"konnectivity-agent-ckhcp\" (UID: \"887c4c96-28a9-4186-94ff-331743b555e5\") " pod="kube-system/konnectivity-agent-ckhcp" Jul 01 16:09:06.835307 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835232 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21eb759a-7b1e-4ac1-aab1-00429b75021c-ovn-node-metrics-cert\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.835307 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-sysctl-d\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.835307 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-systemd\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.835307 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835296 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-host\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.835449 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/81a3ab17-7e6c-4684-ac86-b8daef81a806-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.835449 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835333 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvjss\" (UniqueName: \"kubernetes.io/projected/81a3ab17-7e6c-4684-ac86-b8daef81a806-kube-api-access-lvjss\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.835449 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-run-netns\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.835449 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-multus-cni-dir\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.835449 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-multus-conf-dir\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.835449 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835427 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-run-multus-certs\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.835449 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835442 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmfrd\" (UniqueName: \"kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd\") pod \"network-check-target-z4n5q\" (UID: \"7cc7e9af-2dad-4fcd-8ac1-70b401e4f840\") " pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:06.835668 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835456 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-kubelet\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.835668 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835470 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81a3ab17-7e6c-4684-ac86-b8daef81a806-system-cni-dir\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.835668 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81a3ab17-7e6c-4684-ac86-b8daef81a806-cni-binary-copy\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.835668 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835507 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-var-lib-openvswitch\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.835668 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-modprobe-d\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.835668 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-var-lib-kubelet\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.835668 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-multus-daemon-config\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.835668 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-sys-fs\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.835668 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-cni-bin\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.835668 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835614 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bkcs\" (UniqueName: \"kubernetes.io/projected/21eb759a-7b1e-4ac1-aab1-00429b75021c-kube-api-access-9bkcs\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.835668 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-run\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.835668 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835666 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-cnibin\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-run-k8s-cni-cncf-io\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835704 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dcd6392-4268-44d2-8d6e-deaddbab6a82-iptables-alerter-script\") pod \"iptables-alerter-cg5h4\" (UID: \"5dcd6392-4268-44d2-8d6e-deaddbab6a82\") " pod="openshift-network-operator/iptables-alerter-cg5h4" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dcd6392-4268-44d2-8d6e-deaddbab6a82-host-slash\") pod \"iptables-alerter-cg5h4\" (UID: \"5dcd6392-4268-44d2-8d6e-deaddbab6a82\") " pod="openshift-network-operator/iptables-alerter-cg5h4" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835846 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-sys\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-lib-modules\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmq66\" (UniqueName: \"kubernetes.io/projected/97f53243-652b-4225-88e1-8f0b6c55bcd0-kube-api-access-dmq66\") pod \"node-resolver-b86ld\" (UID: \"97f53243-652b-4225-88e1-8f0b6c55bcd0\") " pod="openshift-dns/node-resolver-b86ld" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-multus-socket-dir-parent\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835954 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-dbus\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.835984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/534f29c6-46ba-43f3-b9eb-25c35d9302b1-serviceca\") pod \"node-ca-5h5b6\" (UID: \"534f29c6-46ba-43f3-b9eb-25c35d9302b1\") " pod="openshift-image-registry/node-ca-5h5b6" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-device-dir\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-var-lib-kubelet\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836067 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9283711-3b60-4b7e-9695-298047af3fc8-etc-tuned\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmmff\" (UniqueName: \"kubernetes.io/projected/5dcd6392-4268-44d2-8d6e-deaddbab6a82-kube-api-access-nmmff\") pod \"iptables-alerter-cg5h4\" (UID: \"5dcd6392-4268-44d2-8d6e-deaddbab6a82\") " pod="openshift-network-operator/iptables-alerter-cg5h4" Jul 01 16:09:06.836152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836144 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-socket-dir\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/81a3ab17-7e6c-4684-ac86-b8daef81a806-os-release\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/81a3ab17-7e6c-4684-ac86-b8daef81a806-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836240 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs\") pod \"network-metrics-daemon-b46xt\" (UID: \"3af13f32-337f-4a5e-8cbe-078f1e9a95b0\") " pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45t5h\" (UniqueName: \"kubernetes.io/projected/534f29c6-46ba-43f3-b9eb-25c35d9302b1-kube-api-access-45t5h\") pod \"node-ca-5h5b6\" (UID: \"534f29c6-46ba-43f3-b9eb-25c35d9302b1\") " pod="openshift-image-registry/node-ca-5h5b6" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-etc-selinux\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836347 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-systemd-units\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-run-netns\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836433 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81a3ab17-7e6c-4684-ac86-b8daef81a806-cnibin\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-var-lib-cni-bin\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836482 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9283711-3b60-4b7e-9695-298047af3fc8-tmp\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/534f29c6-46ba-43f3-b9eb-25c35d9302b1-serviceca\") pod \"node-ca-5h5b6\" (UID: \"534f29c6-46ba-43f3-b9eb-25c35d9302b1\") " pod="openshift-image-registry/node-ca-5h5b6" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-kubelet-config\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/534f29c6-46ba-43f3-b9eb-25c35d9302b1-host\") pod \"node-ca-5h5b6\" (UID: \"534f29c6-46ba-43f3-b9eb-25c35d9302b1\") " pod="openshift-image-registry/node-ca-5h5b6" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xhm8\" (UniqueName: \"kubernetes.io/projected/104d35a0-cb4a-455d-adff-52d3a872984f-kube-api-access-2xhm8\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836607 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-etc-openvswitch\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.836761 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21eb759a-7b1e-4ac1-aab1-00429b75021c-ovnkube-script-lib\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836626 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/534f29c6-46ba-43f3-b9eb-25c35d9302b1-host\") pod \"node-ca-5h5b6\" (UID: \"534f29c6-46ba-43f3-b9eb-25c35d9302b1\") " pod="openshift-image-registry/node-ca-5h5b6" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97f53243-652b-4225-88e1-8f0b6c55bcd0-tmp-dir\") pod \"node-resolver-b86ld\" (UID: \"97f53243-652b-4225-88e1-8f0b6c55bcd0\") " pod="openshift-dns/node-resolver-b86ld" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836684 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-system-cni-dir\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836714 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81a3ab17-7e6c-4684-ac86-b8daef81a806-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-registration-dir\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836758 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-slash\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-node-log\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836793 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-cni-netd\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21eb759a-7b1e-4ac1-aab1-00429b75021c-ovnkube-config\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-kubernetes\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836849 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-os-release\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836862 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-run-openvswitch\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgm9g\" (UniqueName: \"kubernetes.io/projected/f9283711-3b60-4b7e-9695-298047af3fc8-kube-api-access-dgm9g\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-cni-binary-copy\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.836961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-hostroot\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.837329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.837000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmnqm\" (UniqueName: \"kubernetes.io/projected/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-kube-api-access-tmnqm\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.837814 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.837039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-run-systemd\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.837814 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.837062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-run-ovn\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.837814 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.837080 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-log-socket\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.856486 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.856467 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 16:09:06.859343 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.859328 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45t5h\" (UniqueName: \"kubernetes.io/projected/534f29c6-46ba-43f3-b9eb-25c35d9302b1-kube-api-access-45t5h\") pod \"node-ca-5h5b6\" (UID: \"534f29c6-46ba-43f3-b9eb-25c35d9302b1\") " pod="openshift-image-registry/node-ca-5h5b6" Jul 01 16:09:06.903747 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:06.903720 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd975de0452e008bc237379d64b3e7d.slice/crio-c0145cdfc78c0749f46136c15e50a576c9ef37840b193cfb1099f2c95a178c2e WatchSource:0}: Error finding container c0145cdfc78c0749f46136c15e50a576c9ef37840b193cfb1099f2c95a178c2e: Status 404 returned error can't find the container with id c0145cdfc78c0749f46136c15e50a576c9ef37840b193cfb1099f2c95a178c2e Jul 01 16:09:06.909594 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.909310 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:09:06.929382 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:06.929360 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1094fc4a9f440f8c23b90cb63f4403.slice/crio-225e45e926a9907156a98c49c110352ba5288fc9e673f956c3afabef5ce75747 WatchSource:0}: Error finding container 225e45e926a9907156a98c49c110352ba5288fc9e673f956c3afabef5ce75747: Status 404 returned error can't find the container with id 225e45e926a9907156a98c49c110352ba5288fc9e673f956c3afabef5ce75747 Jul 01 16:09:06.937283 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-etc-openvswitch\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.937364 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21eb759a-7b1e-4ac1-aab1-00429b75021c-ovnkube-script-lib\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.937364 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97f53243-652b-4225-88e1-8f0b6c55bcd0-tmp-dir\") pod \"node-resolver-b86ld\" (UID: \"97f53243-652b-4225-88e1-8f0b6c55bcd0\") " pod="openshift-dns/node-resolver-b86ld" Jul 01 16:09:06.937468 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937363 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-etc-openvswitch\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.937468 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-system-cni-dir\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.937468 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937459 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:06.937612 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81a3ab17-7e6c-4684-ac86-b8daef81a806-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.937612 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937501 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-system-cni-dir\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.937612 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-registration-dir\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.937612 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-slash\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.937612 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-node-log\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.937612 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937583 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97f53243-652b-4225-88e1-8f0b6c55bcd0-tmp-dir\") pod \"node-resolver-b86ld\" (UID: \"97f53243-652b-4225-88e1-8f0b6c55bcd0\") " pod="openshift-dns/node-resolver-b86ld" Jul 01 16:09:06.937612 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.937592 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937620 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-node-log\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937649 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-slash\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.937673 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret podName:380e01c0-55b2-48ce-ae9e-b1a515fed1a5 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:07.437652392 +0000 UTC m=+2.117277647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret") pod "global-pull-secret-syncer-j8fcp" (UID: "380e01c0-55b2-48ce-ae9e-b1a515fed1a5") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937656 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-registration-dir\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-cni-netd\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937688 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81a3ab17-7e6c-4684-ac86-b8daef81a806-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21eb759a-7b1e-4ac1-aab1-00429b75021c-ovnkube-config\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-kubernetes\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937748 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-cni-netd\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-os-release\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937793 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-kubernetes\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-run-openvswitch\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937826 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-run-openvswitch\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.937873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgm9g\" (UniqueName: \"kubernetes.io/projected/f9283711-3b60-4b7e-9695-298047af3fc8-kube-api-access-dgm9g\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937876 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21eb759a-7b1e-4ac1-aab1-00429b75021c-ovnkube-script-lib\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-cni-binary-copy\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937888 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-os-release\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-hostroot\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmnqm\" (UniqueName: \"kubernetes.io/projected/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-kube-api-access-tmnqm\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937958 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-run-systemd\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937967 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-hostroot\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.937979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-run-ovn\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-run-ovn\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-log-socket\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938046 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21eb759a-7b1e-4ac1-aab1-00429b75021c-env-overrides\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-sysconfig\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-sysctl-conf\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcr6n\" (UniqueName: \"kubernetes.io/projected/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-kube-api-access-zcr6n\") pod \"network-metrics-daemon-b46xt\" (UID: \"3af13f32-337f-4a5e-8cbe-078f1e9a95b0\") " pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938133 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-sysconfig\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-run-ovn-kubernetes\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938169 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-run-systemd\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.938473 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/887c4c96-28a9-4186-94ff-331743b555e5-agent-certs\") pod \"konnectivity-agent-ckhcp\" (UID: \"887c4c96-28a9-4186-94ff-331743b555e5\") " pod="kube-system/konnectivity-agent-ckhcp" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938207 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-log-socket\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/97f53243-652b-4225-88e1-8f0b6c55bcd0-hosts-file\") pod \"node-resolver-b86ld\" (UID: \"97f53243-652b-4225-88e1-8f0b6c55bcd0\") " pod="openshift-dns/node-resolver-b86ld" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-var-lib-cni-multus\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-run-ovn-kubernetes\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938213 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21eb759a-7b1e-4ac1-aab1-00429b75021c-ovnkube-config\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-etc-kubernetes\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/887c4c96-28a9-4186-94ff-331743b555e5-konnectivity-ca\") pod \"konnectivity-agent-ckhcp\" (UID: \"887c4c96-28a9-4186-94ff-331743b555e5\") " pod="kube-system/konnectivity-agent-ckhcp" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21eb759a-7b1e-4ac1-aab1-00429b75021c-ovn-node-metrics-cert\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938308 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/97f53243-652b-4225-88e1-8f0b6c55bcd0-hosts-file\") pod \"node-resolver-b86ld\" (UID: \"97f53243-652b-4225-88e1-8f0b6c55bcd0\") " pod="openshift-dns/node-resolver-b86ld" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-sysctl-d\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938350 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-etc-kubernetes\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938352 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-systemd\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938383 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-host\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938384 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-cni-binary-copy\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938396 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-systemd\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938406 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/81a3ab17-7e6c-4684-ac86-b8daef81a806-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938417 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21eb759a-7b1e-4ac1-aab1-00429b75021c-env-overrides\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.939318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvjss\" (UniqueName: \"kubernetes.io/projected/81a3ab17-7e6c-4684-ac86-b8daef81a806-kube-api-access-lvjss\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-run-netns\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938487 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-sysctl-conf\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-multus-cni-dir\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938525 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-sysctl-d\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-multus-conf-dir\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-run-multus-certs\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-run-netns\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938564 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-var-lib-cni-multus\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938609 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-host\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938643 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-run-multus-certs\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938625 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-multus-cni-dir\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfrd\" (UniqueName: \"kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd\") pod \"network-check-target-z4n5q\" (UID: \"7cc7e9af-2dad-4fcd-8ac1-70b401e4f840\") " pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-kubelet\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81a3ab17-7e6c-4684-ac86-b8daef81a806-system-cni-dir\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81a3ab17-7e6c-4684-ac86-b8daef81a806-cni-binary-copy\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-var-lib-openvswitch\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-modprobe-d\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.940117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938785 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-kubelet\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-var-lib-kubelet\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-multus-daemon-config\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938860 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-sys-fs\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-cni-bin\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bkcs\" (UniqueName: \"kubernetes.io/projected/21eb759a-7b1e-4ac1-aab1-00429b75021c-kube-api-access-9bkcs\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-run\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938935 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/887c4c96-28a9-4186-94ff-331743b555e5-konnectivity-ca\") pod \"konnectivity-agent-ckhcp\" (UID: \"887c4c96-28a9-4186-94ff-331743b555e5\") " pod="kube-system/konnectivity-agent-ckhcp" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-cnibin\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939014 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-cnibin\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939065 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-sys-fs\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939075 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/81a3ab17-7e6c-4684-ac86-b8daef81a806-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939102 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-cni-bin\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-var-lib-openvswitch\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939152 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-var-lib-kubelet\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-run\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.938807 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-multus-conf-dir\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939188 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-etc-modprobe-d\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.940889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939196 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81a3ab17-7e6c-4684-ac86-b8daef81a806-system-cni-dir\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-run-k8s-cni-cncf-io\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939227 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81a3ab17-7e6c-4684-ac86-b8daef81a806-cni-binary-copy\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dcd6392-4268-44d2-8d6e-deaddbab6a82-iptables-alerter-script\") pod \"iptables-alerter-cg5h4\" (UID: \"5dcd6392-4268-44d2-8d6e-deaddbab6a82\") " pod="openshift-network-operator/iptables-alerter-cg5h4" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939283 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-run-k8s-cni-cncf-io\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dcd6392-4268-44d2-8d6e-deaddbab6a82-host-slash\") pod \"iptables-alerter-cg5h4\" (UID: \"5dcd6392-4268-44d2-8d6e-deaddbab6a82\") " pod="openshift-network-operator/iptables-alerter-cg5h4" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939376 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dcd6392-4268-44d2-8d6e-deaddbab6a82-host-slash\") pod \"iptables-alerter-cg5h4\" (UID: \"5dcd6392-4268-44d2-8d6e-deaddbab6a82\") " pod="openshift-network-operator/iptables-alerter-cg5h4" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939385 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-multus-daemon-config\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-sys\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939401 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939427 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-lib-modules\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmq66\" (UniqueName: \"kubernetes.io/projected/97f53243-652b-4225-88e1-8f0b6c55bcd0-kube-api-access-dmq66\") pod \"node-resolver-b86ld\" (UID: \"97f53243-652b-4225-88e1-8f0b6c55bcd0\") " pod="openshift-dns/node-resolver-b86ld" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-multus-socket-dir-parent\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939510 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-sys\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.941789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-dbus\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939523 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-lib-modules\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939542 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-multus-socket-dir-parent\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-device-dir\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939586 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-device-dir\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-var-lib-kubelet\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939605 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-dbus\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939626 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9283711-3b60-4b7e-9695-298047af3fc8-etc-tuned\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmmff\" (UniqueName: \"kubernetes.io/projected/5dcd6392-4268-44d2-8d6e-deaddbab6a82-kube-api-access-nmmff\") pod \"iptables-alerter-cg5h4\" (UID: \"5dcd6392-4268-44d2-8d6e-deaddbab6a82\") " pod="openshift-network-operator/iptables-alerter-cg5h4" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939688 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9283711-3b60-4b7e-9695-298047af3fc8-var-lib-kubelet\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939697 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-socket-dir\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939777 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-socket-dir\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/81a3ab17-7e6c-4684-ac86-b8daef81a806-os-release\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939819 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dcd6392-4268-44d2-8d6e-deaddbab6a82-iptables-alerter-script\") pod \"iptables-alerter-cg5h4\" (UID: \"5dcd6392-4268-44d2-8d6e-deaddbab6a82\") " pod="openshift-network-operator/iptables-alerter-cg5h4" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/81a3ab17-7e6c-4684-ac86-b8daef81a806-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/81a3ab17-7e6c-4684-ac86-b8daef81a806-os-release\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs\") pod \"network-metrics-daemon-b46xt\" (UID: \"3af13f32-337f-4a5e-8cbe-078f1e9a95b0\") " pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:06.942448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-etc-selinux\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-systemd-units\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-run-netns\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.939991 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-systemd-units\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.940004 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.940036 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21eb759a-7b1e-4ac1-aab1-00429b75021c-host-run-netns\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.940005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81a3ab17-7e6c-4684-ac86-b8daef81a806-cnibin\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.940037 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/104d35a0-cb4a-455d-adff-52d3a872984f-etc-selinux\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.940044 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81a3ab17-7e6c-4684-ac86-b8daef81a806-cnibin\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.940067 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs podName:3af13f32-337f-4a5e-8cbe-078f1e9a95b0 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:07.440050192 +0000 UTC m=+2.119675456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs") pod "network-metrics-daemon-b46xt" (UID: "3af13f32-337f-4a5e-8cbe-078f1e9a95b0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.940104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-var-lib-cni-bin\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.940133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9283711-3b60-4b7e-9695-298047af3fc8-tmp\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.940143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-host-var-lib-cni-bin\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.940157 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-kubelet-config\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.940185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xhm8\" (UniqueName: \"kubernetes.io/projected/104d35a0-cb4a-455d-adff-52d3a872984f-kube-api-access-2xhm8\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.940237 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/81a3ab17-7e6c-4684-ac86-b8daef81a806-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.940250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-kubelet-config\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:06.942952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.941028 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/887c4c96-28a9-4186-94ff-331743b555e5-agent-certs\") pod \"konnectivity-agent-ckhcp\" (UID: \"887c4c96-28a9-4186-94ff-331743b555e5\") " pod="kube-system/konnectivity-agent-ckhcp" Jul 01 16:09:06.943422 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.941711 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21eb759a-7b1e-4ac1-aab1-00429b75021c-ovn-node-metrics-cert\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:06.943422 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.941865 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9283711-3b60-4b7e-9695-298047af3fc8-etc-tuned\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.943422 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.942369 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9283711-3b60-4b7e-9695-298047af3fc8-tmp\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.948122 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.948105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgm9g\" (UniqueName: \"kubernetes.io/projected/f9283711-3b60-4b7e-9695-298047af3fc8-kube-api-access-dgm9g\") pod \"tuned-kjpx4\" (UID: \"f9283711-3b60-4b7e-9695-298047af3fc8\") " pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:06.948818 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.948800 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:09:06.948904 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.948822 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:09:06.948904 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.948839 2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmfrd for pod openshift-network-diagnostics/network-check-target-z4n5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:06.948904 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:06.948897 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd podName:7cc7e9af-2dad-4fcd-8ac1-70b401e4f840 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:07.448881615 +0000 UTC m=+2.128506883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qmfrd" (UniqueName: "kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd") pod "network-check-target-z4n5q" (UID: "7cc7e9af-2dad-4fcd-8ac1-70b401e4f840") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:06.950340 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.950319 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvjss\" (UniqueName: \"kubernetes.io/projected/81a3ab17-7e6c-4684-ac86-b8daef81a806-kube-api-access-lvjss\") pod \"multus-additional-cni-plugins-p59n9\" (UID: \"81a3ab17-7e6c-4684-ac86-b8daef81a806\") " pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:06.950467 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.950438 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmmff\" (UniqueName: \"kubernetes.io/projected/5dcd6392-4268-44d2-8d6e-deaddbab6a82-kube-api-access-nmmff\") pod \"iptables-alerter-cg5h4\" (UID: \"5dcd6392-4268-44d2-8d6e-deaddbab6a82\") " pod="openshift-network-operator/iptables-alerter-cg5h4" Jul 01 16:09:06.950619 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.950596 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xhm8\" (UniqueName: \"kubernetes.io/projected/104d35a0-cb4a-455d-adff-52d3a872984f-kube-api-access-2xhm8\") pod \"aws-ebs-csi-driver-node-lqlzm\" (UID: \"104d35a0-cb4a-455d-adff-52d3a872984f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:06.950898 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.950881 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmq66\" (UniqueName: \"kubernetes.io/projected/97f53243-652b-4225-88e1-8f0b6c55bcd0-kube-api-access-dmq66\") pod \"node-resolver-b86ld\" (UID: \"97f53243-652b-4225-88e1-8f0b6c55bcd0\") " pod="openshift-dns/node-resolver-b86ld" Jul 01 16:09:06.951294 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.951275 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmnqm\" (UniqueName: \"kubernetes.io/projected/8c235d4f-2efb-48d0-86aa-3fd65f4f25a6-kube-api-access-tmnqm\") pod \"multus-pt8dd\" (UID: \"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6\") " pod="openshift-multus/multus-pt8dd" Jul 01 16:09:06.951751 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.951733 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcr6n\" (UniqueName: \"kubernetes.io/projected/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-kube-api-access-zcr6n\") pod \"network-metrics-daemon-b46xt\" (UID: \"3af13f32-337f-4a5e-8cbe-078f1e9a95b0\") " pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:06.952413 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:06.952398 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bkcs\" (UniqueName: \"kubernetes.io/projected/21eb759a-7b1e-4ac1-aab1-00429b75021c-kube-api-access-9bkcs\") pod \"ovnkube-node-jvpld\" (UID: \"21eb759a-7b1e-4ac1-aab1-00429b75021c\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:07.075504 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.075434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5h5b6" Jul 01 16:09:07.084147 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:07.084124 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod534f29c6_46ba_43f3_b9eb_25c35d9302b1.slice/crio-ccd4ad14c79538e46428bec84ea7cccfa5c2dfa444be25582fe7a37f1f6d5a65 WatchSource:0}: Error finding container ccd4ad14c79538e46428bec84ea7cccfa5c2dfa444be25582fe7a37f1f6d5a65: Status 404 returned error can't find the container with id ccd4ad14c79538e46428bec84ea7cccfa5c2dfa444be25582fe7a37f1f6d5a65 Jul 01 16:09:07.094885 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.094868 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p59n9" Jul 01 16:09:07.101722 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:07.101697 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a3ab17_7e6c_4684_ac86_b8daef81a806.slice/crio-229b096367ca7367581a22cca3828f6d7a282d27250c64f515e99b3c9a79a74b WatchSource:0}: Error finding container 229b096367ca7367581a22cca3828f6d7a282d27250c64f515e99b3c9a79a74b: Status 404 returned error can't find the container with id 229b096367ca7367581a22cca3828f6d7a282d27250c64f515e99b3c9a79a74b Jul 01 16:09:07.114192 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.114174 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" Jul 01 16:09:07.118527 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.118508 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b86ld" Jul 01 16:09:07.121882 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:07.121833 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod104d35a0_cb4a_455d_adff_52d3a872984f.slice/crio-eec0382bd7f09b37c008ff82af56d12e47a11d1070e606ad89563be3d8d077b0 WatchSource:0}: Error finding container eec0382bd7f09b37c008ff82af56d12e47a11d1070e606ad89563be3d8d077b0: Status 404 returned error can't find the container with id eec0382bd7f09b37c008ff82af56d12e47a11d1070e606ad89563be3d8d077b0 Jul 01 16:09:07.125719 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:07.125699 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f53243_652b_4225_88e1_8f0b6c55bcd0.slice/crio-b8dee710165f9fa87cf0d5cc49b79087a25d78cccb653e1b08636b115e34c709 WatchSource:0}: Error finding container b8dee710165f9fa87cf0d5cc49b79087a25d78cccb653e1b08636b115e34c709: Status 404 returned error can't find the container with id b8dee710165f9fa87cf0d5cc49b79087a25d78cccb653e1b08636b115e34c709 Jul 01 16:09:07.138243 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.138228 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pt8dd" Jul 01 16:09:07.144853 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.144832 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ckhcp" Jul 01 16:09:07.145621 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:07.145602 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c235d4f_2efb_48d0_86aa_3fd65f4f25a6.slice/crio-c326a1255616e769ea6c9bacb879203c494a6dffe116519086e0f860bd2d0b70 WatchSource:0}: Error finding container c326a1255616e769ea6c9bacb879203c494a6dffe116519086e0f860bd2d0b70: Status 404 returned error can't find the container with id c326a1255616e769ea6c9bacb879203c494a6dffe116519086e0f860bd2d0b70 Jul 01 16:09:07.153722 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:07.153701 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887c4c96_28a9_4186_94ff_331743b555e5.slice/crio-46da3f3a14eb351e7b1ddb87ac09a1a2728fb931a67cf302176b933afd3946a2 WatchSource:0}: Error finding container 46da3f3a14eb351e7b1ddb87ac09a1a2728fb931a67cf302176b933afd3946a2: Status 404 returned error can't find the container with id 46da3f3a14eb351e7b1ddb87ac09a1a2728fb931a67cf302176b933afd3946a2 Jul 01 16:09:07.155015 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.155001 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cg5h4" Jul 01 16:09:07.161623 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:07.161601 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcd6392_4268_44d2_8d6e_deaddbab6a82.slice/crio-4f399941e7b59f13d4fb0dc7c9329c8a6a648d7e27149b6d370a021dcf3148d6 WatchSource:0}: Error finding container 4f399941e7b59f13d4fb0dc7c9329c8a6a648d7e27149b6d370a021dcf3148d6: Status 404 returned error can't find the container with id 4f399941e7b59f13d4fb0dc7c9329c8a6a648d7e27149b6d370a021dcf3148d6 Jul 01 16:09:07.169183 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.169168 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:07.173686 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.173670 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" Jul 01 16:09:07.176481 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:07.176462 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21eb759a_7b1e_4ac1_aab1_00429b75021c.slice/crio-7af1664d595b76414f0b5355c46d7c3ce2fbb978d3dc5021c7cdf572b8b0eba7 WatchSource:0}: Error finding container 7af1664d595b76414f0b5355c46d7c3ce2fbb978d3dc5021c7cdf572b8b0eba7: Status 404 returned error can't find the container with id 7af1664d595b76414f0b5355c46d7c3ce2fbb978d3dc5021c7cdf572b8b0eba7 Jul 01 16:09:07.180800 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:07.180781 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9283711_3b60_4b7e_9695_298047af3fc8.slice/crio-fb3796a54046de2b559777ca9c258ba3ba29733e94b54908c9604b9f6c8c29b6 WatchSource:0}: Error finding container fb3796a54046de2b559777ca9c258ba3ba29733e94b54908c9604b9f6c8c29b6: Status 404 returned error can't find the container with id fb3796a54046de2b559777ca9c258ba3ba29733e94b54908c9604b9f6c8c29b6 Jul 01 16:09:07.444180 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.444107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:07.444306 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.444198 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs\") pod \"network-metrics-daemon-b46xt\" (UID: \"3af13f32-337f-4a5e-8cbe-078f1e9a95b0\") " pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:07.444306 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:07.444282 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:07.444306 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:07.444301 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:07.444454 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:07.444347 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret podName:380e01c0-55b2-48ce-ae9e-b1a515fed1a5 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:08.444329232 +0000 UTC m=+3.123954492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret") pod "global-pull-secret-syncer-j8fcp" (UID: "380e01c0-55b2-48ce-ae9e-b1a515fed1a5") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:07.444454 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:07.444366 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs podName:3af13f32-337f-4a5e-8cbe-078f1e9a95b0 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:08.444357463 +0000 UTC m=+3.123982721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs") pod "network-metrics-daemon-b46xt" (UID: "3af13f32-337f-4a5e-8cbe-078f1e9a95b0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:07.535983 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.535955 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:09:07.544822 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.544797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfrd\" (UniqueName: \"kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd\") pod \"network-check-target-z4n5q\" (UID: \"7cc7e9af-2dad-4fcd-8ac1-70b401e4f840\") " pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:07.544943 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:07.544909 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:09:07.544943 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:07.544925 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:09:07.544943 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:07.544935 2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmfrd for pod openshift-network-diagnostics/network-check-target-z4n5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:07.545088 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:07.544986 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd podName:7cc7e9af-2dad-4fcd-8ac1-70b401e4f840 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:08.544971253 +0000 UTC m=+3.224596524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qmfrd" (UniqueName: "kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd") pod "network-check-target-z4n5q" (UID: "7cc7e9af-2dad-4fcd-8ac1-70b401e4f840") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:07.777692 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.774223 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:04:06 +0000 UTC" deadline="2028-01-01 06:23:11.097847585 +0000 UTC" Jul 01 16:09:07.777692 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.774254 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13166h14m3.323597468s" Jul 01 16:09:07.809602 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.809534 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p59n9" event={"ID":"81a3ab17-7e6c-4684-ac86-b8daef81a806","Type":"ContainerStarted","Data":"229b096367ca7367581a22cca3828f6d7a282d27250c64f515e99b3c9a79a74b"} Jul 01 16:09:07.813696 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.813664 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5h5b6" event={"ID":"534f29c6-46ba-43f3-b9eb-25c35d9302b1","Type":"ContainerStarted","Data":"ccd4ad14c79538e46428bec84ea7cccfa5c2dfa444be25582fe7a37f1f6d5a65"} Jul 01 16:09:07.815441 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.815368 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" event={"ID":"21eb759a-7b1e-4ac1-aab1-00429b75021c","Type":"ContainerStarted","Data":"7af1664d595b76414f0b5355c46d7c3ce2fbb978d3dc5021c7cdf572b8b0eba7"} Jul 01 16:09:07.824594 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.824567 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b86ld" event={"ID":"97f53243-652b-4225-88e1-8f0b6c55bcd0","Type":"ContainerStarted","Data":"b8dee710165f9fa87cf0d5cc49b79087a25d78cccb653e1b08636b115e34c709"} Jul 01 16:09:07.826393 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.826332 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" event={"ID":"104d35a0-cb4a-455d-adff-52d3a872984f","Type":"ContainerStarted","Data":"eec0382bd7f09b37c008ff82af56d12e47a11d1070e606ad89563be3d8d077b0"} Jul 01 16:09:07.828353 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.828296 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" event={"ID":"cd1094fc4a9f440f8c23b90cb63f4403","Type":"ContainerStarted","Data":"225e45e926a9907156a98c49c110352ba5288fc9e673f956c3afabef5ce75747"} Jul 01 16:09:07.830785 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.830721 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal" event={"ID":"fcd975de0452e008bc237379d64b3e7d","Type":"ContainerStarted","Data":"c0145cdfc78c0749f46136c15e50a576c9ef37840b193cfb1099f2c95a178c2e"} Jul 01 16:09:07.832948 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.832838 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" event={"ID":"f9283711-3b60-4b7e-9695-298047af3fc8","Type":"ContainerStarted","Data":"fb3796a54046de2b559777ca9c258ba3ba29733e94b54908c9604b9f6c8c29b6"} Jul 01 16:09:07.839486 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.839429 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cg5h4" event={"ID":"5dcd6392-4268-44d2-8d6e-deaddbab6a82","Type":"ContainerStarted","Data":"4f399941e7b59f13d4fb0dc7c9329c8a6a648d7e27149b6d370a021dcf3148d6"} Jul 01 16:09:07.840875 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.840820 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ckhcp" event={"ID":"887c4c96-28a9-4186-94ff-331743b555e5","Type":"ContainerStarted","Data":"46da3f3a14eb351e7b1ddb87ac09a1a2728fb931a67cf302176b933afd3946a2"} Jul 01 16:09:07.845330 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:07.845303 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pt8dd" event={"ID":"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6","Type":"ContainerStarted","Data":"c326a1255616e769ea6c9bacb879203c494a6dffe116519086e0f860bd2d0b70"} Jul 01 16:09:08.158224 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:08.158146 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:09:08.452326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:08.452233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs\") pod \"network-metrics-daemon-b46xt\" (UID: \"3af13f32-337f-4a5e-8cbe-078f1e9a95b0\") " pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:08.452326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:08.452317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:08.452546 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:08.452477 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:08.452546 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:08.452539 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret podName:380e01c0-55b2-48ce-ae9e-b1a515fed1a5 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:10.452521119 +0000 UTC m=+5.132146388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret") pod "global-pull-secret-syncer-j8fcp" (UID: "380e01c0-55b2-48ce-ae9e-b1a515fed1a5") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:08.453024 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:08.452981 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:08.453126 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:08.453036 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs podName:3af13f32-337f-4a5e-8cbe-078f1e9a95b0 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:10.453020132 +0000 UTC m=+5.132645388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs") pod "network-metrics-daemon-b46xt" (UID: "3af13f32-337f-4a5e-8cbe-078f1e9a95b0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:08.553278 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:08.553240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfrd\" (UniqueName: \"kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd\") pod \"network-check-target-z4n5q\" (UID: \"7cc7e9af-2dad-4fcd-8ac1-70b401e4f840\") " pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:08.553468 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:08.553438 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:09:08.553468 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:08.553461 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:09:08.553573 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:08.553474 2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmfrd for pod openshift-network-diagnostics/network-check-target-z4n5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:08.553624 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:08.553581 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd podName:7cc7e9af-2dad-4fcd-8ac1-70b401e4f840 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:10.553545606 +0000 UTC m=+5.233170864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qmfrd" (UniqueName: "kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd") pod "network-check-target-z4n5q" (UID: "7cc7e9af-2dad-4fcd-8ac1-70b401e4f840") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:08.679335 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:08.679305 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:09:08.775277 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:08.775164 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:04:06 +0000 UTC" deadline="2028-02-26 13:12:23.888302056 +0000 UTC" Jul 01 16:09:08.775277 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:08.775221 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14517h3m15.113084576s" Jul 01 16:09:08.797831 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:08.797802 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:08.798271 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:08.797928 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:08.798271 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:08.798021 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:08.798271 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:08.798109 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:08.798662 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:08.798466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:08.798662 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:08.798567 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:10.470862 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:10.470583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:10.471338 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:10.470959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs\") pod \"network-metrics-daemon-b46xt\" (UID: \"3af13f32-337f-4a5e-8cbe-078f1e9a95b0\") " pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:10.471338 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:10.470721 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:10.471338 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:10.471152 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret podName:380e01c0-55b2-48ce-ae9e-b1a515fed1a5 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:14.471133861 +0000 UTC m=+9.150759130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret") pod "global-pull-secret-syncer-j8fcp" (UID: "380e01c0-55b2-48ce-ae9e-b1a515fed1a5") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:10.471484 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:10.471082 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:10.471546 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:10.471527 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs podName:3af13f32-337f-4a5e-8cbe-078f1e9a95b0 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:14.471508152 +0000 UTC m=+9.151133430 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs") pod "network-metrics-daemon-b46xt" (UID: "3af13f32-337f-4a5e-8cbe-078f1e9a95b0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:10.571841 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:10.571714 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfrd\" (UniqueName: \"kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd\") pod \"network-check-target-z4n5q\" (UID: \"7cc7e9af-2dad-4fcd-8ac1-70b401e4f840\") " pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:10.572015 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:10.571848 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:09:10.572015 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:10.571868 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:09:10.572015 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:10.571880 2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmfrd for pod openshift-network-diagnostics/network-check-target-z4n5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:10.572015 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:10.571934 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd podName:7cc7e9af-2dad-4fcd-8ac1-70b401e4f840 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:14.571917737 +0000 UTC m=+9.251543009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qmfrd" (UniqueName: "kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd") pod "network-check-target-z4n5q" (UID: "7cc7e9af-2dad-4fcd-8ac1-70b401e4f840") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:10.797257 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:10.797178 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:10.797426 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:10.797297 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:10.797426 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:10.797312 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:10.797548 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:10.797445 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:10.797548 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:10.797497 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:10.797663 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:10.797568 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:12.797109 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:12.797027 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:12.797109 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:12.797051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:12.797620 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:12.797033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:12.797620 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:12.797152 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:12.797620 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:12.797248 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:12.797620 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:12.797345 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:14.510800 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:14.510762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:14.511174 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:14.510865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs\") pod \"network-metrics-daemon-b46xt\" (UID: \"3af13f32-337f-4a5e-8cbe-078f1e9a95b0\") " pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:14.511174 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:14.510929 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:14.511174 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:14.510967 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:14.511174 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:14.511005 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret podName:380e01c0-55b2-48ce-ae9e-b1a515fed1a5 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:22.510984823 +0000 UTC m=+17.190610082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret") pod "global-pull-secret-syncer-j8fcp" (UID: "380e01c0-55b2-48ce-ae9e-b1a515fed1a5") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:14.511174 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:14.511026 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs podName:3af13f32-337f-4a5e-8cbe-078f1e9a95b0 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:22.511015226 +0000 UTC m=+17.190640488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs") pod "network-metrics-daemon-b46xt" (UID: "3af13f32-337f-4a5e-8cbe-078f1e9a95b0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:14.611480 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:14.611446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfrd\" (UniqueName: \"kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd\") pod \"network-check-target-z4n5q\" (UID: \"7cc7e9af-2dad-4fcd-8ac1-70b401e4f840\") " pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:14.611691 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:14.611582 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:09:14.611691 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:14.611605 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:09:14.611691 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:14.611618 2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmfrd for pod openshift-network-diagnostics/network-check-target-z4n5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:14.611857 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:14.611695 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd podName:7cc7e9af-2dad-4fcd-8ac1-70b401e4f840 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:22.611677066 +0000 UTC m=+17.291302328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qmfrd" (UniqueName: "kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd") pod "network-check-target-z4n5q" (UID: "7cc7e9af-2dad-4fcd-8ac1-70b401e4f840") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:14.797134 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:14.797033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:14.797134 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:14.797065 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:14.797350 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:14.797156 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:14.797350 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:14.797177 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:14.797350 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:14.797267 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:14.797499 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:14.797352 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:16.797217 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:16.796778 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:16.797217 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:16.796820 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:16.797217 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:16.796820 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:16.797217 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:16.796892 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:16.797217 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:16.796994 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:16.797217 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:16.797114 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:18.797143 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:18.797124 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:18.797450 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:18.797244 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:18.797450 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:18.797243 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:18.797450 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:18.797329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:18.797450 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:18.797327 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:18.797450 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:18.797420 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:20.796825 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:20.796790 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:20.797296 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:20.796793 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:20.797296 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:20.796919 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:20.797296 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:20.797005 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:20.797296 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:20.796790 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:20.797296 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:20.797129 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:22.570459 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:22.570422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs\") pod \"network-metrics-daemon-b46xt\" (UID: \"3af13f32-337f-4a5e-8cbe-078f1e9a95b0\") " pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:22.571024 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:22.570480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:22.571024 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:22.570556 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:22.571024 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:22.570595 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:22.571024 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:22.570651 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs podName:3af13f32-337f-4a5e-8cbe-078f1e9a95b0 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:38.570615537 +0000 UTC m=+33.250240794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs") pod "network-metrics-daemon-b46xt" (UID: "3af13f32-337f-4a5e-8cbe-078f1e9a95b0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:22.571024 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:22.570671 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret podName:380e01c0-55b2-48ce-ae9e-b1a515fed1a5 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:38.570661478 +0000 UTC m=+33.250286732 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret") pod "global-pull-secret-syncer-j8fcp" (UID: "380e01c0-55b2-48ce-ae9e-b1a515fed1a5") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:22.671260 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:22.671224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfrd\" (UniqueName: \"kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd\") pod \"network-check-target-z4n5q\" (UID: \"7cc7e9af-2dad-4fcd-8ac1-70b401e4f840\") " pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:22.671437 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:22.671395 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:09:22.671437 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:22.671411 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:09:22.671437 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:22.671422 2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmfrd for pod openshift-network-diagnostics/network-check-target-z4n5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:22.671574 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:22.671483 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd podName:7cc7e9af-2dad-4fcd-8ac1-70b401e4f840 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:38.671465884 +0000 UTC m=+33.351091159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qmfrd" (UniqueName: "kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd") pod "network-check-target-z4n5q" (UID: "7cc7e9af-2dad-4fcd-8ac1-70b401e4f840") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:22.797925 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:22.797476 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:22.797925 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:22.797597 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:22.797925 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:22.797604 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:22.797925 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:22.797674 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:22.797925 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:22.797785 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:22.797925 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:22.797871 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:24.796887 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:24.796856 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:24.796887 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:24.796881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:24.797368 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:24.796890 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:24.797368 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:24.796979 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:24.797368 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:24.797032 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:24.797368 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:24.797112 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:26.797278 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:26.797251 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:26.797734 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:26.797348 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:26.797734 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:26.797392 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:26.797734 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:26.797490 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:26.797734 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:26.797527 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:26.797734 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:26.797594 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:27.895325 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.895128 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal" event={"ID":"fcd975de0452e008bc237379d64b3e7d","Type":"ContainerStarted","Data":"5e7607c5f5f383b27ac4c5247e08ae59ee8260cdafb7163fafe8ace04bd9ff38"} Jul 01 16:09:27.896755 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.896726 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" event={"ID":"f9283711-3b60-4b7e-9695-298047af3fc8","Type":"ContainerStarted","Data":"751eb5a02b2eeaaec35405c2a590ebe7438205bda6617098e30f99b79fe4e4da"} Jul 01 16:09:27.898306 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.898284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pt8dd" event={"ID":"8c235d4f-2efb-48d0-86aa-3fd65f4f25a6","Type":"ContainerStarted","Data":"3e4bdc681b0f6db5ae22afa85d71cd58d278a6294975ae879721f45498d871ea"} Jul 01 16:09:27.901791 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.901772 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvpld_21eb759a-7b1e-4ac1-aab1-00429b75021c/ovn-acl-logging/0.log" Jul 01 16:09:27.902087 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.902067 2577 generic.go:356] "Generic (PLEG): container finished" podID="21eb759a-7b1e-4ac1-aab1-00429b75021c" containerID="1b34e649bc0cce91e62f1d477d943cf10c1e83fe9dff98140d16596e896e4ea1" exitCode=1 Jul 01 16:09:27.902146 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.902098 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" event={"ID":"21eb759a-7b1e-4ac1-aab1-00429b75021c","Type":"ContainerStarted","Data":"d8193c624b3fb9bad4cf555c175fbc0e39ea0ab87d027fb7b95ddd59e50da1d8"} Jul 01 16:09:27.902182 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.902145 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" event={"ID":"21eb759a-7b1e-4ac1-aab1-00429b75021c","Type":"ContainerStarted","Data":"68256417f852bd8897f1f0a7a87ae9afee8f471d3b6b06c6f0811ab3d249e0f1"} Jul 01 16:09:27.902182 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.902174 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" event={"ID":"21eb759a-7b1e-4ac1-aab1-00429b75021c","Type":"ContainerStarted","Data":"7e5d857def2b5d8a5f256e96a4834e6d886b50c281799e18bfa9d61117db430c"} Jul 01 16:09:27.902239 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.902202 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" event={"ID":"21eb759a-7b1e-4ac1-aab1-00429b75021c","Type":"ContainerStarted","Data":"77d9fa244071bc98123d28867b36144a4b11a2f00dee3e03bc486ef6568d0dd7"} Jul 01 16:09:27.902239 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.902228 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" event={"ID":"21eb759a-7b1e-4ac1-aab1-00429b75021c","Type":"ContainerDied","Data":"1b34e649bc0cce91e62f1d477d943cf10c1e83fe9dff98140d16596e896e4ea1"} Jul 01 16:09:27.902295 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.902255 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" event={"ID":"21eb759a-7b1e-4ac1-aab1-00429b75021c","Type":"ContainerStarted","Data":"31f9bc291e35e2459dff8d7ac47d7834d9c54c649db980acbeb524d2636095af"} Jul 01 16:09:27.908643 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.908586 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal" podStartSLOduration=21.908573437 podStartE2EDuration="21.908573437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:27.908224615 +0000 UTC m=+22.587849892" watchObservedRunningTime="2026-07-01 16:09:27.908573437 +0000 UTC m=+22.588198713" Jul 01 16:09:27.924673 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.924618 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kjpx4" podStartSLOduration=1.8505946039999999 podStartE2EDuration="21.92460607s" totalImagesPullingTime="20.074011466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:27.924305175 +0000 UTC m=+22.603930453" watchObservedRunningTime="2026-07-01 16:09:27.92460607 +0000 UTC m=+22.604231347" Jul 01 16:09:27.941079 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:27.941013 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pt8dd" podStartSLOduration=2.7560442590000003 podStartE2EDuration="22.940995903s" totalImagesPullingTime="20.184951644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:27.940621116 +0000 UTC m=+22.620246393" watchObservedRunningTime="2026-07-01 16:09:27.940995903 +0000 UTC m=+22.620621181" Jul 01 16:09:28.797418 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.797169 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:28.797579 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.797183 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:28.797579 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:28.797462 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:28.797579 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:28.797519 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:28.797579 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.797230 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:28.797765 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:28.797616 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:28.905209 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.905171 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b86ld" event={"ID":"97f53243-652b-4225-88e1-8f0b6c55bcd0","Type":"ContainerStarted","Data":"e4e931d7754d7d0350dda130fdaa51b94601d95fa4258afd2a237e0709d088fd"} Jul 01 16:09:28.906597 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.906568 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" event={"ID":"104d35a0-cb4a-455d-adff-52d3a872984f","Type":"ContainerStarted","Data":"00c352372fdf2c1b76b250ff4ac9b43f904aa859116a751a5abe2af11384801c"} Jul 01 16:09:28.907941 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.907920 2577 generic.go:356] "Generic (PLEG): container finished" podID="cd1094fc4a9f440f8c23b90cb63f4403" containerID="792b89c6a468586ddafe5a2654cef09a164a6b53acc487e03d857fc24ad07cb9" exitCode=0 Jul 01 16:09:28.908062 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.907940 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" event={"ID":"cd1094fc4a9f440f8c23b90cb63f4403","Type":"ContainerDied","Data":"792b89c6a468586ddafe5a2654cef09a164a6b53acc487e03d857fc24ad07cb9"} Jul 01 16:09:28.909401 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.909384 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cg5h4" event={"ID":"5dcd6392-4268-44d2-8d6e-deaddbab6a82","Type":"ContainerStarted","Data":"8b072e6e853e787979751b4c1914a91c32f0bf1c494e351c124530d25eb1b8cf"} Jul 01 16:09:28.910583 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.910560 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ckhcp" event={"ID":"887c4c96-28a9-4186-94ff-331743b555e5","Type":"ContainerStarted","Data":"461be7481e1e7fb698cd3159cff26ae1172e930360be645a6cac0fdef3168e91"} Jul 01 16:09:28.911844 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.911826 2577 generic.go:356] "Generic (PLEG): container finished" podID="81a3ab17-7e6c-4684-ac86-b8daef81a806" containerID="0357144d714c5f36c46cd7462be4d6a7da544a3fc7ea34b85ff169ebdbb6e5f0" exitCode=0 Jul 01 16:09:28.911929 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.911887 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p59n9" event={"ID":"81a3ab17-7e6c-4684-ac86-b8daef81a806","Type":"ContainerDied","Data":"0357144d714c5f36c46cd7462be4d6a7da544a3fc7ea34b85ff169ebdbb6e5f0"} Jul 01 16:09:28.913260 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.913184 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5h5b6" event={"ID":"534f29c6-46ba-43f3-b9eb-25c35d9302b1","Type":"ContainerStarted","Data":"a6fedfc0c5770b1c443c6e0d8dd090351a924e9ae2503dc343c4a5ec7e431a8f"} Jul 01 16:09:28.921223 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.921185 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b86ld" podStartSLOduration=3.7926245979999997 podStartE2EDuration="23.921174648s" totalImagesPullingTime="20.12855005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:28.920841565 +0000 UTC m=+23.600466852" watchObservedRunningTime="2026-07-01 16:09:28.921174648 +0000 UTC m=+23.600799924" Jul 01 16:09:28.934537 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.934505 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ckhcp" podStartSLOduration=2.834857533 podStartE2EDuration="22.934493241s" totalImagesPullingTime="20.099635708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:28.934238201 +0000 UTC m=+23.613863480" watchObservedRunningTime="2026-07-01 16:09:28.934493241 +0000 UTC m=+23.614118562" Jul 01 16:09:28.946952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.946919 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cg5h4" podStartSLOduration=2.855393726 podStartE2EDuration="22.946911034s" totalImagesPullingTime="20.091517308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:28.946415179 +0000 UTC m=+23.626040467" watchObservedRunningTime="2026-07-01 16:09:28.946911034 +0000 UTC m=+23.626536310" Jul 01 16:09:28.988863 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:28.988817 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5h5b6" podStartSLOduration=3.819695822 podStartE2EDuration="23.988800232s" totalImagesPullingTime="20.16910441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:28.988395486 +0000 UTC m=+23.668020763" watchObservedRunningTime="2026-07-01 16:09:28.988800232 +0000 UTC m=+23.668425511" Jul 01 16:09:29.062734 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.062703 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:29.139771 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.139744 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:29.329161 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.329093 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 16:09:29.771526 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.771454 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ckhcp" Jul 01 16:09:29.772153 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.772137 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ckhcp" Jul 01 16:09:29.799484 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.799390 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T16:09:29.329113623Z","UUID":"1fe20401-f296-4f7a-b868-0a05ff67d224","Handler":null,"Name":"","Endpoint":""} Jul 01 16:09:29.801141 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.801110 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 16:09:29.801261 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.801155 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 16:09:29.917863 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.917828 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" event={"ID":"104d35a0-cb4a-455d-adff-52d3a872984f","Type":"ContainerStarted","Data":"ac1251d9dac6dddb9cc874f62a62a4960009b125a3baa559c9a24534ec896606"} Jul 01 16:09:29.922294 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.922264 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" event={"ID":"cd1094fc4a9f440f8c23b90cb63f4403","Type":"ContainerStarted","Data":"32fbfb052ed92b26a32baaf5d812e72ba8e74598450a061ae515a5168c81b901"} Jul 01 16:09:29.923065 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.923025 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ckhcp" Jul 01 16:09:29.923356 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.923342 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ckhcp" Jul 01 16:09:29.938481 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.938443 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" podStartSLOduration=23.938430367 podStartE2EDuration="23.938430367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:29.937594142 +0000 UTC m=+24.617219419" watchObservedRunningTime="2026-07-01 16:09:29.938430367 +0000 UTC m=+24.618055643" Jul 01 16:09:29.997562 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:29.997531 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:30.797408 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:30.797383 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:30.797590 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:30.797396 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:30.797590 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:30.797485 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:30.797590 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:30.797506 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:30.797779 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:30.797615 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:30.797779 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:30.797720 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:30.927574 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:30.927541 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvpld_21eb759a-7b1e-4ac1-aab1-00429b75021c/ovn-acl-logging/0.log" Jul 01 16:09:30.928045 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:30.928009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" event={"ID":"21eb759a-7b1e-4ac1-aab1-00429b75021c","Type":"ContainerStarted","Data":"e61715cac42443ba9da5247d13212dd8ca3c6f06220771dfc5ed8e29716bbf04"} Jul 01 16:09:31.933290 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:31.933048 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" event={"ID":"104d35a0-cb4a-455d-adff-52d3a872984f","Type":"ContainerStarted","Data":"565f18165ddd388a28d92d2828b2f47d5fce5aeeec77f6b7ff7443d06eeb51a6"} Jul 01 16:09:31.952343 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:31.952288 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lqlzm" podStartSLOduration=3.793510116 podStartE2EDuration="26.952268471s" totalImagesPullingTime="23.158758355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:31.951597277 +0000 UTC m=+26.631222555" watchObservedRunningTime="2026-07-01 16:09:31.952268471 +0000 UTC m=+26.631893769" Jul 01 16:09:32.590509 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:32.590478 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:32.646621 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:32.646586 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:32.710015 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:32.709984 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:32.788800 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:32.788758 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:32.796742 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:32.796718 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:32.796901 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:32.796718 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:32.796901 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:32.796844 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:32.796901 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:32.796718 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:32.797068 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:32.796910 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:32.797068 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:32.796974 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:32.889619 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:32.889548 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:33.939881 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:33.939593 2577 generic.go:356] "Generic (PLEG): container finished" podID="81a3ab17-7e6c-4684-ac86-b8daef81a806" containerID="848413b6a72f8293a09df740043b5cafb1acb5f4f2e3fcb8f46ce5a2714baac2" exitCode=0 Jul 01 16:09:33.940738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:33.939674 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p59n9" event={"ID":"81a3ab17-7e6c-4684-ac86-b8daef81a806","Type":"ContainerDied","Data":"848413b6a72f8293a09df740043b5cafb1acb5f4f2e3fcb8f46ce5a2714baac2"} Jul 01 16:09:33.943288 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:33.943271 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvpld_21eb759a-7b1e-4ac1-aab1-00429b75021c/ovn-acl-logging/0.log" Jul 01 16:09:33.943726 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:33.943705 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" event={"ID":"21eb759a-7b1e-4ac1-aab1-00429b75021c","Type":"ContainerStarted","Data":"602c6b94cd317295fc4668105b068b68450d4b8f04c27ec5316719906f14394d"} Jul 01 16:09:33.943993 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:33.943971 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:33.944117 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:33.944101 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:33.944198 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:33.944181 2577 scope.go:117] "RemoveContainer" containerID="1b34e649bc0cce91e62f1d477d943cf10c1e83fe9dff98140d16596e896e4ea1" Jul 01 16:09:33.944242 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:33.944195 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:33.959857 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:33.959833 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:33.960480 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:33.960463 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:09:34.797110 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:34.797085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:34.797110 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:34.797100 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:34.797299 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:34.797217 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:34.797299 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:34.797271 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:34.797365 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:34.797338 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:34.797421 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:34.797398 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:34.949047 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:34.949023 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvpld_21eb759a-7b1e-4ac1-aab1-00429b75021c/ovn-acl-logging/0.log" Jul 01 16:09:34.949449 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:34.949358 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" event={"ID":"21eb759a-7b1e-4ac1-aab1-00429b75021c","Type":"ContainerStarted","Data":"04c58c4b9a163f23ad4ba8b81bc467b2e019668b9d751ced552acefad9afafe9"} Jul 01 16:09:34.977326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:34.977273 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" podStartSLOduration=8.877405525 podStartE2EDuration="28.977240953s" totalImagesPullingTime="20.099835428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:34.975656419 +0000 UTC m=+29.655281697" watchObservedRunningTime="2026-07-01 16:09:34.977240953 +0000 UTC m=+29.656866232" Jul 01 16:09:34.992943 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:34.992907 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z4n5q"] Jul 01 16:09:34.993093 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:34.993014 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:34.993149 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:34.993119 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:34.996086 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:34.996062 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j8fcp"] Jul 01 16:09:34.996221 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:34.996141 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:34.996285 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:34.996232 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:34.996749 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:34.996726 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b46xt"] Jul 01 16:09:34.996871 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:34.996816 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:34.996935 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:34.996903 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:35.952768 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:35.952527 2577 generic.go:356] "Generic (PLEG): container finished" podID="81a3ab17-7e6c-4684-ac86-b8daef81a806" containerID="5191aa74443efe95bdc611cf69cd3477f279c32835e5cead8a0705f2061e3ae4" exitCode=0 Jul 01 16:09:35.953129 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:35.952609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p59n9" event={"ID":"81a3ab17-7e6c-4684-ac86-b8daef81a806","Type":"ContainerDied","Data":"5191aa74443efe95bdc611cf69cd3477f279c32835e5cead8a0705f2061e3ae4"} Jul 01 16:09:36.797692 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:36.797661 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:36.797692 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:36.797679 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:36.797878 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:36.797694 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:36.797878 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:36.797773 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:36.797941 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:36.797897 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:36.797974 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:36.797964 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:36.855478 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:36.855401 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:36.936883 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:36.936830 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:37.037202 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:37.037171 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:37.614073 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:37.614042 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:37.666210 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:37.666177 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:37.959216 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:37.959135 2577 generic.go:356] "Generic (PLEG): container finished" podID="81a3ab17-7e6c-4684-ac86-b8daef81a806" containerID="5b31f77469c69d3f15d63366bcf289a64202c818dbe8a208f19081b6fcac4771" exitCode=0 Jul 01 16:09:37.959216 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:37.959184 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p59n9" event={"ID":"81a3ab17-7e6c-4684-ac86-b8daef81a806","Type":"ContainerDied","Data":"5b31f77469c69d3f15d63366bcf289a64202c818dbe8a208f19081b6fcac4771"} Jul 01 16:09:38.595810 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:38.595768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs\") pod \"network-metrics-daemon-b46xt\" (UID: \"3af13f32-337f-4a5e-8cbe-078f1e9a95b0\") " pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:38.596316 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:38.595822 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:38.596316 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:38.595924 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:38.596316 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:38.596005 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs podName:3af13f32-337f-4a5e-8cbe-078f1e9a95b0 nodeName:}" failed. No retries permitted until 2026-07-01 16:10:10.595982502 +0000 UTC m=+65.275607775 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs") pod "network-metrics-daemon-b46xt" (UID: "3af13f32-337f-4a5e-8cbe-078f1e9a95b0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:38.596316 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:38.595924 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:38.596316 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:38.596072 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret podName:380e01c0-55b2-48ce-ae9e-b1a515fed1a5 nodeName:}" failed. No retries permitted until 2026-07-01 16:10:10.596053889 +0000 UTC m=+65.275679154 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret") pod "global-pull-secret-syncer-j8fcp" (UID: "380e01c0-55b2-48ce-ae9e-b1a515fed1a5") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:38.697108 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:38.697068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfrd\" (UniqueName: \"kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd\") pod \"network-check-target-z4n5q\" (UID: \"7cc7e9af-2dad-4fcd-8ac1-70b401e4f840\") " pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:38.697268 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:38.697193 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:09:38.697268 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:38.697214 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:09:38.697268 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:38.697224 2577 projected.go:196] Error preparing data for projected volume kube-api-access-qmfrd for pod openshift-network-diagnostics/network-check-target-z4n5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:38.697400 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:38.697270 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd podName:7cc7e9af-2dad-4fcd-8ac1-70b401e4f840 nodeName:}" failed. No retries permitted until 2026-07-01 16:10:10.697257664 +0000 UTC m=+65.376882933 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qmfrd" (UniqueName: "kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd") pod "network-check-target-z4n5q" (UID: "7cc7e9af-2dad-4fcd-8ac1-70b401e4f840") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:38.797466 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:38.797432 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:38.797664 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:38.797550 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:38.797664 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:38.797559 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8fcp" podUID="380e01c0-55b2-48ce-ae9e-b1a515fed1a5" Jul 01 16:09:38.797664 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:38.797570 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:38.797843 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:38.797690 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b46xt" podUID="3af13f32-337f-4a5e-8cbe-078f1e9a95b0" Jul 01 16:09:38.797843 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:38.797781 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4n5q" podUID="7cc7e9af-2dad-4fcd-8ac1-70b401e4f840" Jul 01 16:09:38.809303 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:38.809277 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:38.910378 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:38.910305 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:40.085421 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.085391 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeReady" Jul 01 16:09:40.085966 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.085552 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 16:09:40.131484 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.131407 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fdgjg"] Jul 01 16:09:40.133646 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.133606 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:40.134114 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.134084 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bnrhw"] Jul 01 16:09:40.135602 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.135521 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ft5w7\"" Jul 01 16:09:40.135712 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.135519 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 16:09:40.135712 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.135679 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 16:09:40.136307 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.136289 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bnrhw" Jul 01 16:09:40.137921 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.137902 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 16:09:40.138100 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.138079 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 16:09:40.138204 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.138137 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-htp2k\"" Jul 01 16:09:40.138204 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.138172 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 16:09:40.143043 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.143017 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fdgjg"] Jul 01 16:09:40.145334 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.145304 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bnrhw"] Jul 01 16:09:40.206613 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.206586 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:40.306781 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.306744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-tmp-dir\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:40.306959 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.306791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3795109-23f9-4bf7-8d5f-20175be5e56f-cert\") pod \"ingress-canary-bnrhw\" (UID: \"f3795109-23f9-4bf7-8d5f-20175be5e56f\") " pod="openshift-ingress-canary/ingress-canary-bnrhw" Jul 01 16:09:40.306959 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.306890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xbk7\" (UniqueName: \"kubernetes.io/projected/f3795109-23f9-4bf7-8d5f-20175be5e56f-kube-api-access-5xbk7\") pod \"ingress-canary-bnrhw\" (UID: \"f3795109-23f9-4bf7-8d5f-20175be5e56f\") " pod="openshift-ingress-canary/ingress-canary-bnrhw" Jul 01 16:09:40.306959 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.306919 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-config-volume\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:40.306959 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.306956 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:40.307177 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.306971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tphsp\" (UniqueName: \"kubernetes.io/projected/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-kube-api-access-tphsp\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:40.307842 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.307815 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:40.407372 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.407295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xbk7\" (UniqueName: \"kubernetes.io/projected/f3795109-23f9-4bf7-8d5f-20175be5e56f-kube-api-access-5xbk7\") pod \"ingress-canary-bnrhw\" (UID: \"f3795109-23f9-4bf7-8d5f-20175be5e56f\") " pod="openshift-ingress-canary/ingress-canary-bnrhw" Jul 01 16:09:40.407372 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.407333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-config-volume\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:40.407372 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.407364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:40.407624 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:40.407454 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:40.407624 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.407453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tphsp\" (UniqueName: \"kubernetes.io/projected/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-kube-api-access-tphsp\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:40.407624 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:40.407524 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls podName:6cfab973-2b3d-4bb4-8ce1-a77cf8609572 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:40.907504889 +0000 UTC m=+35.587130143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls") pod "dns-default-fdgjg" (UID: "6cfab973-2b3d-4bb4-8ce1-a77cf8609572") : secret "dns-default-metrics-tls" not found Jul 01 16:09:40.407624 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.407565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-tmp-dir\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:40.407624 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.407597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3795109-23f9-4bf7-8d5f-20175be5e56f-cert\") pod \"ingress-canary-bnrhw\" (UID: \"f3795109-23f9-4bf7-8d5f-20175be5e56f\") " pod="openshift-ingress-canary/ingress-canary-bnrhw" Jul 01 16:09:40.408015 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.407994 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-config-volume\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:40.408102 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.407998 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-tmp-dir\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:40.412184 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.412160 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3795109-23f9-4bf7-8d5f-20175be5e56f-cert\") pod \"ingress-canary-bnrhw\" (UID: \"f3795109-23f9-4bf7-8d5f-20175be5e56f\") " pod="openshift-ingress-canary/ingress-canary-bnrhw" Jul 01 16:09:40.416095 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.416075 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tphsp\" (UniqueName: \"kubernetes.io/projected/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-kube-api-access-tphsp\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:40.416463 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.416442 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xbk7\" (UniqueName: \"kubernetes.io/projected/f3795109-23f9-4bf7-8d5f-20175be5e56f-kube-api-access-5xbk7\") pod \"ingress-canary-bnrhw\" (UID: \"f3795109-23f9-4bf7-8d5f-20175be5e56f\") " pod="openshift-ingress-canary/ingress-canary-bnrhw" Jul 01 16:09:40.452406 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.452374 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bnrhw" Jul 01 16:09:40.797282 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.797203 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:09:40.797445 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.797319 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:09:40.797445 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.797353 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:09:40.799543 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.799521 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:09:40.799703 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.799522 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v7gln\"" Jul 01 16:09:40.800370 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.800132 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:09:40.800370 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.800159 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:09:40.800370 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.800167 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:09:40.800370 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.800260 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8sl4f\"" Jul 01 16:09:40.910453 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:40.910416 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:40.910652 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:40.910579 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:40.910720 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:40.910659 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls podName:6cfab973-2b3d-4bb4-8ce1-a77cf8609572 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:41.910624152 +0000 UTC m=+36.590249411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls") pod "dns-default-fdgjg" (UID: "6cfab973-2b3d-4bb4-8ce1-a77cf8609572") : secret "dns-default-metrics-tls" not found Jul 01 16:09:41.918334 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:41.918289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:41.918911 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:41.918461 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:41.918911 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:41.918526 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls podName:6cfab973-2b3d-4bb4-8ce1-a77cf8609572 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:43.918509888 +0000 UTC m=+38.598135148 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls") pod "dns-default-fdgjg" (UID: "6cfab973-2b3d-4bb4-8ce1-a77cf8609572") : secret "dns-default-metrics-tls" not found Jul 01 16:09:41.965874 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:41.965843 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8kmq4"] Jul 01 16:09:41.968129 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:41.968106 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:41.970792 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:41.970761 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 16:09:41.970916 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:41.970769 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 16:09:41.970991 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:41.970943 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 16:09:41.971287 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:41.971271 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 16:09:41.971382 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:41.971274 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dd5dp\"" Jul 01 16:09:41.981224 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:41.981189 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8kmq4"] Jul 01 16:09:41.997720 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:41.997506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:42.057506 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.057478 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:42.074177 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.074154 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bnrhw"] Jul 01 16:09:42.078146 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:42.078117 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3795109_23f9_4bf7_8d5f_20175be5e56f.slice/crio-8c51af2fcacd902b8bb0bb4691d11b0c3b9709b2d081a268c918e3c6f7d0a549 WatchSource:0}: Error finding container 8c51af2fcacd902b8bb0bb4691d11b0c3b9709b2d081a268c918e3c6f7d0a549: Status 404 returned error can't find the container with id 8c51af2fcacd902b8bb0bb4691d11b0c3b9709b2d081a268c918e3c6f7d0a549 Jul 01 16:09:42.120260 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.120231 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.120409 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.120279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d61ef3f-9eca-48a4-957a-06523c974be6-data-volume\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.120409 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.120309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1d61ef3f-9eca-48a4-957a-06523c974be6-crio-socket\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.120409 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.120334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.120409 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.120355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp8rq\" (UniqueName: \"kubernetes.io/projected/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-api-access-kp8rq\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.220808 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.220767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.220918 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.220840 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d61ef3f-9eca-48a4-957a-06523c974be6-data-volume\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.220918 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:42.220867 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:42.220993 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:42.220930 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm podName:1d61ef3f-9eca-48a4-957a-06523c974be6 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:42.720915183 +0000 UTC m=+37.400540440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8kmq4" (UID: "1d61ef3f-9eca-48a4-957a-06523c974be6") : configmap "kube-rbac-proxy" not found Jul 01 16:09:42.220993 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.220870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1d61ef3f-9eca-48a4-957a-06523c974be6-crio-socket\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.220993 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.220973 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.221111 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.220996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp8rq\" (UniqueName: \"kubernetes.io/projected/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-api-access-kp8rq\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.221162 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:42.221123 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:42.221162 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.221149 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d61ef3f-9eca-48a4-957a-06523c974be6-data-volume\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.221246 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:42.221185 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls podName:1d61ef3f-9eca-48a4-957a-06523c974be6 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:42.721166555 +0000 UTC m=+37.400791832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8kmq4" (UID: "1d61ef3f-9eca-48a4-957a-06523c974be6") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:42.221330 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.221288 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1d61ef3f-9eca-48a4-957a-06523c974be6-crio-socket\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.229400 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.229379 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp8rq\" (UniqueName: \"kubernetes.io/projected/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-api-access-kp8rq\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.255184 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.255151 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:42.355726 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.355705 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:42.604140 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.604069 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:42.724143 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.724118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.724288 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.724161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:42.724288 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:42.724272 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:42.724445 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:42.724347 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm podName:1d61ef3f-9eca-48a4-957a-06523c974be6 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:43.724327621 +0000 UTC m=+38.403952889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8kmq4" (UID: "1d61ef3f-9eca-48a4-957a-06523c974be6") : configmap "kube-rbac-proxy" not found Jul 01 16:09:42.724445 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:42.724347 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:42.724445 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:42.724386 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls podName:1d61ef3f-9eca-48a4-957a-06523c974be6 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:43.724375696 +0000 UTC m=+38.404000951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8kmq4" (UID: "1d61ef3f-9eca-48a4-957a-06523c974be6") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:42.870146 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.870079 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:42.971556 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.971525 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:42.975015 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.974988 2577 generic.go:356] "Generic (PLEG): container finished" podID="81a3ab17-7e6c-4684-ac86-b8daef81a806" containerID="36ebb959905954004adb0e6f3e481cb14dd3c5bfb59dd13f2aacda5bf359e69a" exitCode=0 Jul 01 16:09:42.975135 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.975075 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p59n9" event={"ID":"81a3ab17-7e6c-4684-ac86-b8daef81a806","Type":"ContainerDied","Data":"36ebb959905954004adb0e6f3e481cb14dd3c5bfb59dd13f2aacda5bf359e69a"} Jul 01 16:09:42.976338 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:42.976165 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bnrhw" event={"ID":"f3795109-23f9-4bf7-8d5f-20175be5e56f","Type":"ContainerStarted","Data":"8c51af2fcacd902b8bb0bb4691d11b0c3b9709b2d081a268c918e3c6f7d0a549"} Jul 01 16:09:43.731869 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:43.731832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:43.732060 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:43.731886 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:43.732060 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:43.731994 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:43.732060 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:43.731990 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:43.732060 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:43.732046 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls podName:1d61ef3f-9eca-48a4-957a-06523c974be6 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:45.732032727 +0000 UTC m=+40.411657982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8kmq4" (UID: "1d61ef3f-9eca-48a4-957a-06523c974be6") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:43.732060 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:43.732059 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm podName:1d61ef3f-9eca-48a4-957a-06523c974be6 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:45.732052798 +0000 UTC m=+40.411678053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8kmq4" (UID: "1d61ef3f-9eca-48a4-957a-06523c974be6") : configmap "kube-rbac-proxy" not found Jul 01 16:09:43.828441 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:43.828408 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:43.856227 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:43.856201 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-cdwd8"] Jul 01 16:09:43.858467 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:43.858452 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-cdwd8" Jul 01 16:09:43.860557 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:43.860540 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 01 16:09:43.861069 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:43.861053 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 01 16:09:43.861128 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:43.861093 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4px2p\"" Jul 01 16:09:43.869232 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:43.869212 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-cdwd8"] Jul 01 16:09:43.933672 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:43.933623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:43.933804 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:43.933767 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:43.933863 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:43.933838 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls podName:6cfab973-2b3d-4bb4-8ce1-a77cf8609572 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:47.933817927 +0000 UTC m=+42.613443215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls") pod "dns-default-fdgjg" (UID: "6cfab973-2b3d-4bb4-8ce1-a77cf8609572") : secret "dns-default-metrics-tls" not found Jul 01 16:09:43.935932 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:43.935910 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:43.981476 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:43.981443 2577 generic.go:356] "Generic (PLEG): container finished" podID="81a3ab17-7e6c-4684-ac86-b8daef81a806" containerID="25980be7803d68a4c55c3150983ab797fd3130a66d6c8cc1930a666518b1dff7" exitCode=0 Jul 01 16:09:43.981838 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:43.981513 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p59n9" event={"ID":"81a3ab17-7e6c-4684-ac86-b8daef81a806","Type":"ContainerDied","Data":"25980be7803d68a4c55c3150983ab797fd3130a66d6c8cc1930a666518b1dff7"} Jul 01 16:09:44.020643 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.020598 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:44.034697 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.034672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88gm\" (UniqueName: \"kubernetes.io/projected/8322bee6-bf25-42e2-abc9-8ee401d9ac9c-kube-api-access-z88gm\") pod \"migrator-786f9fbc5-cdwd8\" (UID: \"8322bee6-bf25-42e2-abc9-8ee401d9ac9c\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-cdwd8" Jul 01 16:09:44.135590 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.135557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z88gm\" (UniqueName: \"kubernetes.io/projected/8322bee6-bf25-42e2-abc9-8ee401d9ac9c-kube-api-access-z88gm\") pod \"migrator-786f9fbc5-cdwd8\" (UID: \"8322bee6-bf25-42e2-abc9-8ee401d9ac9c\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-cdwd8" Jul 01 16:09:44.145491 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.145465 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88gm\" (UniqueName: \"kubernetes.io/projected/8322bee6-bf25-42e2-abc9-8ee401d9ac9c-kube-api-access-z88gm\") pod \"migrator-786f9fbc5-cdwd8\" (UID: \"8322bee6-bf25-42e2-abc9-8ee401d9ac9c\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-cdwd8" Jul 01 16:09:44.147280 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.147264 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b86ld_97f53243-652b-4225-88e1-8f0b6c55bcd0/dns-node-resolver/0.log" Jul 01 16:09:44.167462 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.167436 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-cdwd8" Jul 01 16:09:44.293987 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.293843 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-cdwd8"] Jul 01 16:09:44.296428 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:44.296400 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8322bee6_bf25_42e2_abc9_8ee401d9ac9c.slice/crio-d26378ee3a2883742e2ee38a9ced68094005b04ec480e36c8a58f1c05da74bff WatchSource:0}: Error finding container d26378ee3a2883742e2ee38a9ced68094005b04ec480e36c8a58f1c05da74bff: Status 404 returned error can't find the container with id d26378ee3a2883742e2ee38a9ced68094005b04ec480e36c8a58f1c05da74bff Jul 01 16:09:44.491955 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.491920 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-55rpq"] Jul 01 16:09:44.495829 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.495766 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" Jul 01 16:09:44.498725 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.498690 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 01 16:09:44.498992 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.498973 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 01 16:09:44.499326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.499305 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 01 16:09:44.499752 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.499737 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 01 16:09:44.499844 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.499759 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-drknp\"" Jul 01 16:09:44.506876 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.506854 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-55rpq"] Jul 01 16:09:44.533908 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.533872 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:44.639530 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.639498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b04e1cd-70e3-414d-9f48-13efbe272508-signing-key\") pod \"service-ca-7bb4f4bcc7-55rpq\" (UID: \"4b04e1cd-70e3-414d-9f48-13efbe272508\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" Jul 01 16:09:44.639753 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.639545 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:44.639753 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.639573 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pt5v\" (UniqueName: \"kubernetes.io/projected/4b04e1cd-70e3-414d-9f48-13efbe272508-kube-api-access-2pt5v\") pod \"service-ca-7bb4f4bcc7-55rpq\" (UID: \"4b04e1cd-70e3-414d-9f48-13efbe272508\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" Jul 01 16:09:44.639753 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.639608 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b04e1cd-70e3-414d-9f48-13efbe272508-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-55rpq\" (UID: \"4b04e1cd-70e3-414d-9f48-13efbe272508\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" Jul 01 16:09:44.740652 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.740607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b04e1cd-70e3-414d-9f48-13efbe272508-signing-key\") pod \"service-ca-7bb4f4bcc7-55rpq\" (UID: \"4b04e1cd-70e3-414d-9f48-13efbe272508\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" Jul 01 16:09:44.740819 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.740690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pt5v\" (UniqueName: \"kubernetes.io/projected/4b04e1cd-70e3-414d-9f48-13efbe272508-kube-api-access-2pt5v\") pod \"service-ca-7bb4f4bcc7-55rpq\" (UID: \"4b04e1cd-70e3-414d-9f48-13efbe272508\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" Jul 01 16:09:44.740819 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.740727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b04e1cd-70e3-414d-9f48-13efbe272508-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-55rpq\" (UID: \"4b04e1cd-70e3-414d-9f48-13efbe272508\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" Jul 01 16:09:44.741593 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.741565 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b04e1cd-70e3-414d-9f48-13efbe272508-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-55rpq\" (UID: \"4b04e1cd-70e3-414d-9f48-13efbe272508\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" Jul 01 16:09:44.743341 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.743316 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b04e1cd-70e3-414d-9f48-13efbe272508-signing-key\") pod \"service-ca-7bb4f4bcc7-55rpq\" (UID: \"4b04e1cd-70e3-414d-9f48-13efbe272508\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" Jul 01 16:09:44.744531 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.744510 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5h5b6_534f29c6-46ba-43f3-b9eb-25c35d9302b1/node-ca/0.log" Jul 01 16:09:44.749557 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.749511 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pt5v\" (UniqueName: \"kubernetes.io/projected/4b04e1cd-70e3-414d-9f48-13efbe272508-kube-api-access-2pt5v\") pod \"service-ca-7bb4f4bcc7-55rpq\" (UID: \"4b04e1cd-70e3-414d-9f48-13efbe272508\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" Jul 01 16:09:44.806812 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.806780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" Jul 01 16:09:44.988353 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.988323 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p59n9" event={"ID":"81a3ab17-7e6c-4684-ac86-b8daef81a806","Type":"ContainerStarted","Data":"b70103a9e1769d5c8fdd9d82ba2ad052c919524f9732eba28538051c14b29ef2"} Jul 01 16:09:44.989617 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:44.989590 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-cdwd8" event={"ID":"8322bee6-bf25-42e2-abc9-8ee401d9ac9c","Type":"ContainerStarted","Data":"d26378ee3a2883742e2ee38a9ced68094005b04ec480e36c8a58f1c05da74bff"} Jul 01 16:09:45.012925 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:45.012836 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p59n9" podStartSLOduration=8.322084104 podStartE2EDuration="40.012815072s" totalImagesPullingTime="31.690730968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:45.012409186 +0000 UTC m=+39.692034475" watchObservedRunningTime="2026-07-01 16:09:45.012815072 +0000 UTC m=+39.692440350" Jul 01 16:09:45.138465 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:45.138429 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:45.193757 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:45.193730 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-55rpq"] Jul 01 16:09:45.196682 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:45.196660 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b04e1cd_70e3_414d_9f48_13efbe272508.slice/crio-5f28ea81f43d0cb86db86310dcbb9c8e7fde80a20c492918cc5f7f07e0486888 WatchSource:0}: Error finding container 5f28ea81f43d0cb86db86310dcbb9c8e7fde80a20c492918cc5f7f07e0486888: Status 404 returned error can't find the container with id 5f28ea81f43d0cb86db86310dcbb9c8e7fde80a20c492918cc5f7f07e0486888 Jul 01 16:09:45.200533 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:45.200484 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:45.693204 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:45.693008 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:45.749474 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:45.749447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:45.749665 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:45.749500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:45.749665 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:45.749582 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:45.749791 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:45.749672 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm podName:1d61ef3f-9eca-48a4-957a-06523c974be6 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:49.749651241 +0000 UTC m=+44.429276513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8kmq4" (UID: "1d61ef3f-9eca-48a4-957a-06523c974be6") : configmap "kube-rbac-proxy" not found Jul 01 16:09:45.749791 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:45.749681 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:45.749791 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:45.749735 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls podName:1d61ef3f-9eca-48a4-957a-06523c974be6 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:49.749722995 +0000 UTC m=+44.429348267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8kmq4" (UID: "1d61ef3f-9eca-48a4-957a-06523c974be6") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:45.994744 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:45.994651 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" event={"ID":"4b04e1cd-70e3-414d-9f48-13efbe272508","Type":"ContainerStarted","Data":"5f28ea81f43d0cb86db86310dcbb9c8e7fde80a20c492918cc5f7f07e0486888"} Jul 01 16:09:45.997194 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:45.997158 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bnrhw" event={"ID":"f3795109-23f9-4bf7-8d5f-20175be5e56f","Type":"ContainerStarted","Data":"86ce5d2e9f8ab33e0fc183203e49e03d43cba41a18c72e138f8b472488d612a4"} Jul 01 16:09:46.014984 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:46.014928 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bnrhw" podStartSLOduration=2.735484553 podStartE2EDuration="6.014909293s" totalImagesPullingTime="3.27942474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:46.01334023 +0000 UTC m=+40.692965508" watchObservedRunningTime="2026-07-01 16:09:46.014909293 +0000 UTC m=+40.694534568" Jul 01 16:09:46.410313 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:46.410279 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:47.001581 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:47.001547 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-cdwd8" event={"ID":"8322bee6-bf25-42e2-abc9-8ee401d9ac9c","Type":"ContainerStarted","Data":"e7323960ac200329c326baac1816f075fd25e247f8545580fce69c545bc99ae4"} Jul 01 16:09:47.002011 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:47.001601 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-cdwd8" event={"ID":"8322bee6-bf25-42e2-abc9-8ee401d9ac9c","Type":"ContainerStarted","Data":"7c54bf09890e43e15e8fb95a778762e03432e0c99ccd2af25d5cb5f176bc3936"} Jul 01 16:09:47.022789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:47.022741 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-cdwd8" podStartSLOduration=1.986823418 podStartE2EDuration="4.022724791s" totalImagesPullingTime="2.035901373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:47.021587442 +0000 UTC m=+41.701212719" watchObservedRunningTime="2026-07-01 16:09:47.022724791 +0000 UTC m=+41.702350067" Jul 01 16:09:47.967778 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:47.967743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:47.967935 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:47.967869 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:47.967935 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:47.967922 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls podName:6cfab973-2b3d-4bb4-8ce1-a77cf8609572 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:55.967908994 +0000 UTC m=+50.647534249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls") pod "dns-default-fdgjg" (UID: "6cfab973-2b3d-4bb4-8ce1-a77cf8609572") : secret "dns-default-metrics-tls" not found Jul 01 16:09:48.073314 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:48.073291 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:49.007936 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:49.007902 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" event={"ID":"4b04e1cd-70e3-414d-9f48-13efbe272508","Type":"ContainerStarted","Data":"1238d3829cccc2450db60cbeb0016d8f693f3c5b8e1e8868b8608cc29431e5ca"} Jul 01 16:09:49.027972 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:49.027925 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-55rpq" podStartSLOduration=2.15686349 podStartE2EDuration="5.027911517s" totalImagesPullingTime="2.871048027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:49.027297886 +0000 UTC m=+43.706923166" watchObservedRunningTime="2026-07-01 16:09:49.027911517 +0000 UTC m=+43.707536793" Jul 01 16:09:49.310963 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:49.310841 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:49.414349 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:49.414306 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:49.514825 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:49.514797 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:49.616049 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:49.615966 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:49.678472 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:49.678445 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:49.783262 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:49.783225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:49.783436 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:49.783286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:49.783436 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:49.783334 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:49.783436 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:49.783397 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm podName:1d61ef3f-9eca-48a4-957a-06523c974be6 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:57.783382177 +0000 UTC m=+52.463007437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8kmq4" (UID: "1d61ef3f-9eca-48a4-957a-06523c974be6") : configmap "kube-rbac-proxy" not found Jul 01 16:09:49.783436 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:49.783411 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:49.783600 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:49.783463 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls podName:1d61ef3f-9eca-48a4-957a-06523c974be6 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:57.783447333 +0000 UTC m=+52.463072601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8kmq4" (UID: "1d61ef3f-9eca-48a4-957a-06523c974be6") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:50.603856 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:50.603827 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:50.995529 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:50.995498 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:51.223981 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:51.223948 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:51.395869 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:51.395840 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:51.597164 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:51.597135 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:52.466606 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:52.466579 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:52.566242 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:52.566212 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:52.799422 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:52.799346 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:53.033487 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:53.033454 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:53.126777 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:53.126750 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:53.227666 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:53.227624 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:53.411622 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:53.411551 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:53.481038 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:53.481009 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:53.593567 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:53.593539 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:54.424649 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:54.424600 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:55.009251 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:55.009217 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:55.110740 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:55.110711 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:55.213971 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:55.213939 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:55.486088 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:55.486056 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:55.592524 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:55.592494 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:55.795863 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:55.795786 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:56.023600 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:56.023571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:56.026726 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:56.026700 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cfab973-2b3d-4bb4-8ce1-a77cf8609572-metrics-tls\") pod \"dns-default-fdgjg\" (UID: \"6cfab973-2b3d-4bb4-8ce1-a77cf8609572\") " pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:56.046641 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:56.046574 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdgjg" Jul 01 16:09:56.187326 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:56.187292 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fdgjg"] Jul 01 16:09:56.190379 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:09:56.190350 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfab973_2b3d_4bb4_8ce1_a77cf8609572.slice/crio-c53596efb34e5985a6bc8c7c337a14b6b56661a236c15e98f7f39182ccb2188a WatchSource:0}: Error finding container c53596efb34e5985a6bc8c7c337a14b6b56661a236c15e98f7f39182ccb2188a: Status 404 returned error can't find the container with id c53596efb34e5985a6bc8c7c337a14b6b56661a236c15e98f7f39182ccb2188a Jul 01 16:09:56.194741 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:56.194717 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:56.483527 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:56.483495 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:56.539946 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:56.539923 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:56.595746 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:56.595721 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:57.027835 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:57.027796 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdgjg" event={"ID":"6cfab973-2b3d-4bb4-8ce1-a77cf8609572","Type":"ContainerStarted","Data":"c53596efb34e5985a6bc8c7c337a14b6b56661a236c15e98f7f39182ccb2188a"} Jul 01 16:09:57.394774 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:57.394741 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:57.794827 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:57.794747 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:57.836730 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:57.836691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:57.836895 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:57.836840 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:57.836895 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:57.836854 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:57.837072 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:09:57.836942 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls podName:1d61ef3f-9eca-48a4-957a-06523c974be6 nodeName:}" failed. No retries permitted until 2026-07-01 16:10:13.836920975 +0000 UTC m=+68.516546230 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8kmq4" (UID: "1d61ef3f-9eca-48a4-957a-06523c974be6") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:57.837569 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:57.837538 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d61ef3f-9eca-48a4-957a-06523c974be6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:09:57.993904 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:57.993870 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:58.188946 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:58.188918 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:58.397806 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:58.397773 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:59.394637 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:59.394610 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:59.593157 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:59.593130 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:59.793262 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:59.793188 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:59.996870 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:09:59.996839 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:00.037941 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:00.037913 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdgjg" event={"ID":"6cfab973-2b3d-4bb4-8ce1-a77cf8609572","Type":"ContainerStarted","Data":"1776d0b89fc6148098bb326f6d8bf9117d4ae675f1c6c430d6df9c784d9a2199"} Jul 01 16:10:00.038095 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:00.037961 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdgjg" event={"ID":"6cfab973-2b3d-4bb4-8ce1-a77cf8609572","Type":"ContainerStarted","Data":"9e8639bf1be4f0aa7cd57d727bc8d2ec0c36de64c463fd4c55f2dfc100d9cf40"} Jul 01 16:10:00.038095 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:00.038046 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fdgjg" Jul 01 16:10:00.057852 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:00.057775 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fdgjg" podStartSLOduration=17.186390534 podStartE2EDuration="20.057762028s" totalImagesPullingTime="2.871371494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:00.055954819 +0000 UTC m=+54.735580095" watchObservedRunningTime="2026-07-01 16:10:00.057762028 +0000 UTC m=+54.737387305" Jul 01 16:10:02.985642 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:02.985599 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db"] Jul 01 16:10:02.988313 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:02.988296 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn"] Jul 01 16:10:02.988434 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:02.988414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" Jul 01 16:10:02.990240 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:02.990220 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:02.993931 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:02.993915 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 01 16:10:02.994158 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:02.994142 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 01 16:10:02.994589 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:02.994573 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 16:10:02.994829 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:02.994811 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 01 16:10:02.994896 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:02.994835 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 16:10:02.994896 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:02.994846 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 01 16:10:02.994999 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:02.994819 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 01 16:10:02.994999 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:02.994819 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 16:10:03.005954 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.005935 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db"] Jul 01 16:10:03.031435 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.031414 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn"] Jul 01 16:10:03.076538 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.076509 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aab686d6-807a-4abe-b5d4-3d706ebf5610-hub\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.076695 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.076547 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aab686d6-807a-4abe-b5d4-3d706ebf5610-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.076695 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.076576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aab686d6-807a-4abe-b5d4-3d706ebf5610-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.076695 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.076593 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfxvh\" (UniqueName: \"kubernetes.io/projected/aab686d6-807a-4abe-b5d4-3d706ebf5610-kube-api-access-bfxvh\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.076695 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.076664 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c16439c3-4d92-44ff-9bae-db3fea889160-tmp\") pod \"klusterlet-addon-workmgr-59d9bd6997-ps9db\" (UID: \"c16439c3-4d92-44ff-9bae-db3fea889160\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" Jul 01 16:10:03.076907 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.076704 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c16439c3-4d92-44ff-9bae-db3fea889160-klusterlet-config\") pod \"klusterlet-addon-workmgr-59d9bd6997-ps9db\" (UID: \"c16439c3-4d92-44ff-9bae-db3fea889160\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" Jul 01 16:10:03.076907 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.076724 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aab686d6-807a-4abe-b5d4-3d706ebf5610-ca\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.076907 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.076812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aab686d6-807a-4abe-b5d4-3d706ebf5610-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.076907 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.076868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trgrt\" (UniqueName: \"kubernetes.io/projected/c16439c3-4d92-44ff-9bae-db3fea889160-kube-api-access-trgrt\") pod \"klusterlet-addon-workmgr-59d9bd6997-ps9db\" (UID: \"c16439c3-4d92-44ff-9bae-db3fea889160\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" Jul 01 16:10:03.092414 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.092389 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:03.177387 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.177360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aab686d6-807a-4abe-b5d4-3d706ebf5610-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.177508 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.177410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aab686d6-807a-4abe-b5d4-3d706ebf5610-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.177558 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.177530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfxvh\" (UniqueName: \"kubernetes.io/projected/aab686d6-807a-4abe-b5d4-3d706ebf5610-kube-api-access-bfxvh\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.177605 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.177558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c16439c3-4d92-44ff-9bae-db3fea889160-tmp\") pod \"klusterlet-addon-workmgr-59d9bd6997-ps9db\" (UID: \"c16439c3-4d92-44ff-9bae-db3fea889160\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" Jul 01 16:10:03.177605 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.177593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c16439c3-4d92-44ff-9bae-db3fea889160-klusterlet-config\") pod \"klusterlet-addon-workmgr-59d9bd6997-ps9db\" (UID: \"c16439c3-4d92-44ff-9bae-db3fea889160\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" Jul 01 16:10:03.177732 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.177652 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aab686d6-807a-4abe-b5d4-3d706ebf5610-ca\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.177732 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.177708 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aab686d6-807a-4abe-b5d4-3d706ebf5610-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.177950 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.177923 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trgrt\" (UniqueName: \"kubernetes.io/projected/c16439c3-4d92-44ff-9bae-db3fea889160-kube-api-access-trgrt\") pod \"klusterlet-addon-workmgr-59d9bd6997-ps9db\" (UID: \"c16439c3-4d92-44ff-9bae-db3fea889160\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" Jul 01 16:10:03.178066 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.178004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aab686d6-807a-4abe-b5d4-3d706ebf5610-hub\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.178136 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.178088 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c16439c3-4d92-44ff-9bae-db3fea889160-tmp\") pod \"klusterlet-addon-workmgr-59d9bd6997-ps9db\" (UID: \"c16439c3-4d92-44ff-9bae-db3fea889160\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" Jul 01 16:10:03.178454 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.178429 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aab686d6-807a-4abe-b5d4-3d706ebf5610-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.180159 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.180130 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aab686d6-807a-4abe-b5d4-3d706ebf5610-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.180271 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.180173 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c16439c3-4d92-44ff-9bae-db3fea889160-klusterlet-config\") pod \"klusterlet-addon-workmgr-59d9bd6997-ps9db\" (UID: \"c16439c3-4d92-44ff-9bae-db3fea889160\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" Jul 01 16:10:03.180271 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.180250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aab686d6-807a-4abe-b5d4-3d706ebf5610-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.180379 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.180319 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aab686d6-807a-4abe-b5d4-3d706ebf5610-ca\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.180379 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.180354 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aab686d6-807a-4abe-b5d4-3d706ebf5610-hub\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.183504 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.183484 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:03.188448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.188425 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfxvh\" (UniqueName: \"kubernetes.io/projected/aab686d6-807a-4abe-b5d4-3d706ebf5610-kube-api-access-bfxvh\") pod \"cluster-proxy-proxy-agent-c4c5f6df9-nx4vn\" (UID: \"aab686d6-807a-4abe-b5d4-3d706ebf5610\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.188584 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.188566 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trgrt\" (UniqueName: \"kubernetes.io/projected/c16439c3-4d92-44ff-9bae-db3fea889160-kube-api-access-trgrt\") pod \"klusterlet-addon-workmgr-59d9bd6997-ps9db\" (UID: \"c16439c3-4d92-44ff-9bae-db3fea889160\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" Jul 01 16:10:03.283535 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.283465 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:03.298109 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.298079 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" Jul 01 16:10:03.315654 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.315622 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" Jul 01 16:10:03.428730 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.428627 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db"] Jul 01 16:10:03.431074 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:10:03.431046 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc16439c3_4d92_44ff_9bae_db3fea889160.slice/crio-60b8dc5db5884724ddb122a0be3fb5578097f263045013a83c00bb7b3fed9cc1 WatchSource:0}: Error finding container 60b8dc5db5884724ddb122a0be3fb5578097f263045013a83c00bb7b3fed9cc1: Status 404 returned error can't find the container with id 60b8dc5db5884724ddb122a0be3fb5578097f263045013a83c00bb7b3fed9cc1 Jul 01 16:10:03.447692 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:03.447667 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn"] Jul 01 16:10:03.450313 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:10:03.450289 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaab686d6_807a_4abe_b5d4_3d706ebf5610.slice/crio-476b535d8479b0f50d2bac10ae63034f37a8639b12101e109a8f81ea7b3a216c WatchSource:0}: Error finding container 476b535d8479b0f50d2bac10ae63034f37a8639b12101e109a8f81ea7b3a216c: Status 404 returned error can't find the container with id 476b535d8479b0f50d2bac10ae63034f37a8639b12101e109a8f81ea7b3a216c Jul 01 16:10:04.052081 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:04.052043 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" event={"ID":"c16439c3-4d92-44ff-9bae-db3fea889160","Type":"ContainerStarted","Data":"60b8dc5db5884724ddb122a0be3fb5578097f263045013a83c00bb7b3fed9cc1"} Jul 01 16:10:04.053074 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:04.053048 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" event={"ID":"aab686d6-807a-4abe-b5d4-3d706ebf5610","Type":"ContainerStarted","Data":"476b535d8479b0f50d2bac10ae63034f37a8639b12101e109a8f81ea7b3a216c"} Jul 01 16:10:05.963812 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:05.963783 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvpld" Jul 01 16:10:06.084469 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:06.084436 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:06.138566 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:06.138539 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:06.194642 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:06.194614 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:10.042412 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.042385 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fdgjg" Jul 01 16:10:10.074333 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.074303 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" event={"ID":"c16439c3-4d92-44ff-9bae-db3fea889160","Type":"ContainerStarted","Data":"b1da41420dfc693a75d7059977c0614622974193fd283d1dc0343c217c37ca91"} Jul 01 16:10:10.074534 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.074518 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" Jul 01 16:10:10.075981 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.075960 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" Jul 01 16:10:10.090389 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.090344 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59d9bd6997-ps9db" podStartSLOduration=2.020097143 podStartE2EDuration="8.090330713s" totalImagesPullingTime="6.07023357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:10.089766845 +0000 UTC m=+64.769392118" watchObservedRunningTime="2026-07-01 16:10:10.090330713 +0000 UTC m=+64.769955986" Jul 01 16:10:10.636805 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.636765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs\") pod \"network-metrics-daemon-b46xt\" (UID: \"3af13f32-337f-4a5e-8cbe-078f1e9a95b0\") " pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:10:10.636980 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.636817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:10:10.639428 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.639408 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:10:10.639497 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.639414 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:10:10.649278 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.649248 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/380e01c0-55b2-48ce-ae9e-b1a515fed1a5-original-pull-secret\") pod \"global-pull-secret-syncer-j8fcp\" (UID: \"380e01c0-55b2-48ce-ae9e-b1a515fed1a5\") " pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:10:10.649391 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.649373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af13f32-337f-4a5e-8cbe-078f1e9a95b0-metrics-certs\") pod \"network-metrics-daemon-b46xt\" (UID: \"3af13f32-337f-4a5e-8cbe-078f1e9a95b0\") " pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:10:10.738089 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.738060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfrd\" (UniqueName: \"kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd\") pod \"network-check-target-z4n5q\" (UID: \"7cc7e9af-2dad-4fcd-8ac1-70b401e4f840\") " pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:10:10.740371 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.740352 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:10:10.751264 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.751242 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:10:10.762106 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.762085 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmfrd\" (UniqueName: \"kubernetes.io/projected/7cc7e9af-2dad-4fcd-8ac1-70b401e4f840-kube-api-access-qmfrd\") pod \"network-check-target-z4n5q\" (UID: \"7cc7e9af-2dad-4fcd-8ac1-70b401e4f840\") " pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:10:10.809518 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.809498 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8fcp" Jul 01 16:10:10.818743 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.818725 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8sl4f\"" Jul 01 16:10:10.823533 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.823514 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v7gln\"" Jul 01 16:10:10.827410 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.827386 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:10:10.831509 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.831493 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b46xt" Jul 01 16:10:10.944790 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.944759 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j8fcp"] Jul 01 16:10:10.949590 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:10:10.949501 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380e01c0_55b2_48ce_ae9e_b1a515fed1a5.slice/crio-12ed4e7c8d08836482e5f1a159498161885886d673c47af589e98ed08a6695f5 WatchSource:0}: Error finding container 12ed4e7c8d08836482e5f1a159498161885886d673c47af589e98ed08a6695f5: Status 404 returned error can't find the container with id 12ed4e7c8d08836482e5f1a159498161885886d673c47af589e98ed08a6695f5 Jul 01 16:10:10.950277 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.950246 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:10.971022 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.970998 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b46xt"] Jul 01 16:10:10.973539 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:10:10.973515 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3af13f32_337f_4a5e_8cbe_078f1e9a95b0.slice/crio-da3c6148d3d01f50b34a6a67171a5b45b9bab5627dd99566792aaccfd045d8f1 WatchSource:0}: Error finding container da3c6148d3d01f50b34a6a67171a5b45b9bab5627dd99566792aaccfd045d8f1: Status 404 returned error can't find the container with id da3c6148d3d01f50b34a6a67171a5b45b9bab5627dd99566792aaccfd045d8f1 Jul 01 16:10:10.988833 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:10.988803 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z4n5q"] Jul 01 16:10:10.992804 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:10:10.992775 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc7e9af_2dad_4fcd_8ac1_70b401e4f840.slice/crio-8d2deacd4fc9e6a80e253548a5d8aa14a4d51293648029ad44b3f04d3c5e63a7 WatchSource:0}: Error finding container 8d2deacd4fc9e6a80e253548a5d8aa14a4d51293648029ad44b3f04d3c5e63a7: Status 404 returned error can't find the container with id 8d2deacd4fc9e6a80e253548a5d8aa14a4d51293648029ad44b3f04d3c5e63a7 Jul 01 16:10:11.048686 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:11.048656 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:11.077768 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:11.077738 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j8fcp" event={"ID":"380e01c0-55b2-48ce-ae9e-b1a515fed1a5","Type":"ContainerStarted","Data":"12ed4e7c8d08836482e5f1a159498161885886d673c47af589e98ed08a6695f5"} Jul 01 16:10:11.078846 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:11.078821 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b46xt" event={"ID":"3af13f32-337f-4a5e-8cbe-078f1e9a95b0","Type":"ContainerStarted","Data":"da3c6148d3d01f50b34a6a67171a5b45b9bab5627dd99566792aaccfd045d8f1"} Jul 01 16:10:11.079949 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:11.079928 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z4n5q" event={"ID":"7cc7e9af-2dad-4fcd-8ac1-70b401e4f840","Type":"ContainerStarted","Data":"8d2deacd4fc9e6a80e253548a5d8aa14a4d51293648029ad44b3f04d3c5e63a7"} Jul 01 16:10:11.153689 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:11.153599 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:11.316788 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:11.316759 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:11.418444 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:11.418373 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:11.504116 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:11.504058 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:11.558843 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:11.558813 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:12.157776 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:12.157746 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:13.089054 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:13.089016 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b46xt" event={"ID":"3af13f32-337f-4a5e-8cbe-078f1e9a95b0","Type":"ContainerStarted","Data":"da4814ad7d3f7ee78cafa8c20e9a2765966e71a9518632115f74c75067c40a3f"} Jul 01 16:10:13.089202 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:13.089081 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b46xt" event={"ID":"3af13f32-337f-4a5e-8cbe-078f1e9a95b0","Type":"ContainerStarted","Data":"52b43cbb2dcde83e6f5321020639939937c8ec0d3b8c37b015643c8fefb2d334"} Jul 01 16:10:13.104906 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:13.104854 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b46xt" podStartSLOduration=66.100037272 podStartE2EDuration="1m7.104836342s" totalImagesPullingTime="1.00479907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:13.104775938 +0000 UTC m=+67.784401212" watchObservedRunningTime="2026-07-01 16:10:13.104836342 +0000 UTC m=+67.784461623" Jul 01 16:10:13.265827 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:13.265796 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:13.367063 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:13.366981 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:13.859644 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:13.859455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:10:13.862234 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:13.862206 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d61ef3f-9eca-48a4-957a-06523c974be6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kmq4\" (UID: \"1d61ef3f-9eca-48a4-957a-06523c974be6\") " pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:10:14.081402 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:14.081370 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dd5dp\"" Jul 01 16:10:14.089552 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:14.089529 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8kmq4" Jul 01 16:10:14.718159 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:14.718132 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:14.821217 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:14.821098 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8kmq4"] Jul 01 16:10:14.826215 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:10:14.826184 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d61ef3f_9eca_48a4_957a_06523c974be6.slice/crio-aab8c3687e78acaafb37acda81378153875f319cbec588571af5eee644ae3980 WatchSource:0}: Error finding container aab8c3687e78acaafb37acda81378153875f319cbec588571af5eee644ae3980: Status 404 returned error can't find the container with id aab8c3687e78acaafb37acda81378153875f319cbec588571af5eee644ae3980 Jul 01 16:10:15.097557 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:15.097475 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8kmq4" event={"ID":"1d61ef3f-9eca-48a4-957a-06523c974be6","Type":"ContainerStarted","Data":"aab8c3687e78acaafb37acda81378153875f319cbec588571af5eee644ae3980"} Jul 01 16:10:15.560327 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:15.560290 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:15.663077 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:15.663020 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:15.778792 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:15.778754 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:17.108700 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:17.108437 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z4n5q" event={"ID":"7cc7e9af-2dad-4fcd-8ac1-70b401e4f840","Type":"ContainerStarted","Data":"05b3ec0c6e6c7990b9b8c0daf638a5ab6da04057698aab710cee599fcd138ee7"} Jul 01 16:10:17.112353 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:17.109262 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:10:17.112353 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:17.110926 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j8fcp" event={"ID":"380e01c0-55b2-48ce-ae9e-b1a515fed1a5","Type":"ContainerStarted","Data":"ef6f1d06b914e3003b26e8b8a018d1135fdb0a3f78bb2123a3fff244789e0fa5"} Jul 01 16:10:17.162834 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:17.162429 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j8fcp" podStartSLOduration=65.283932438 podStartE2EDuration="1m11.162407534s" totalImagesPullingTime="5.878475096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:17.160152176 +0000 UTC m=+71.839777459" watchObservedRunningTime="2026-07-01 16:10:17.162407534 +0000 UTC m=+71.842032813" Jul 01 16:10:17.162834 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:17.162525 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z4n5q" podStartSLOduration=65.649435821 podStartE2EDuration="1m11.162518173s" totalImagesPullingTime="5.513082352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:17.140986127 +0000 UTC m=+71.820611403" watchObservedRunningTime="2026-07-01 16:10:17.162518173 +0000 UTC m=+71.842143452" Jul 01 16:10:18.531688 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:18.531617 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:18.632147 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:18.632102 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:19.192271 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:19.192230 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:19.294953 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:19.294917 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:20.122328 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:20.122287 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8kmq4" event={"ID":"1d61ef3f-9eca-48a4-957a-06523c974be6","Type":"ContainerStarted","Data":"9ac580b4aff85a692eb08987c831e37d422687b2f26f170695f51d237dd6034d"} Jul 01 16:10:20.204918 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:20.204884 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:21.126597 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:21.126551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8kmq4" event={"ID":"1d61ef3f-9eca-48a4-957a-06523c974be6","Type":"ContainerStarted","Data":"4fb366dc466ae0613f7840eb36abfdc6e906a7050ea26131fbcf076caca0b860"} Jul 01 16:10:22.153243 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:22.153201 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:22.260418 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:22.260371 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:22.354963 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:22.354930 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:22.761794 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:22.761756 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:22.992574 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:22.992537 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:23.050698 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.050320 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tmtx2"] Jul 01 16:10:23.062293 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.060930 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.066256 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.066231 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 16:10:23.066567 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.066547 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 16:10:23.069022 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.068999 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 16:10:23.069127 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.069086 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lgms9\"" Jul 01 16:10:23.069333 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.069313 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 16:10:23.069391 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.069364 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 16:10:23.069461 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.069319 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 16:10:23.095937 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.095876 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:23.125124 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.125088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-wtmp\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.125124 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.125127 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/164884a9-7595-4216-87ea-e550ba7fa0ea-root\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.125332 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.125152 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/164884a9-7595-4216-87ea-e550ba7fa0ea-metrics-client-ca\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.125332 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.125184 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.125332 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.125216 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-tls\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.125332 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.125243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/164884a9-7595-4216-87ea-e550ba7fa0ea-sys\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.125332 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.125271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhmq8\" (UniqueName: \"kubernetes.io/projected/164884a9-7595-4216-87ea-e550ba7fa0ea-kube-api-access-zhmq8\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.125332 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.125295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-textfile\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.125332 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.125318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.170087 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.170046 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:23.225821 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.225792 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/164884a9-7595-4216-87ea-e550ba7fa0ea-metrics-client-ca\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226016 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.225831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226016 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.225856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-tls\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226016 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.225880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/164884a9-7595-4216-87ea-e550ba7fa0ea-sys\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226016 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.225907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhmq8\" (UniqueName: \"kubernetes.io/projected/164884a9-7595-4216-87ea-e550ba7fa0ea-kube-api-access-zhmq8\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226016 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.225929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-textfile\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226016 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.225951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226016 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:10:23.226000 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 16:10:23.226339 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.226021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-wtmp\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226339 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:10:23.226060 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-tls podName:164884a9-7595-4216-87ea-e550ba7fa0ea nodeName:}" failed. No retries permitted until 2026-07-01 16:10:23.726043286 +0000 UTC m=+78.405668540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-tls") pod "node-exporter-tmtx2" (UID: "164884a9-7595-4216-87ea-e550ba7fa0ea") : secret "node-exporter-tls" not found Jul 01 16:10:23.226339 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.226077 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/164884a9-7595-4216-87ea-e550ba7fa0ea-root\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226339 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.226143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/164884a9-7595-4216-87ea-e550ba7fa0ea-root\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226339 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.226157 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-wtmp\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226339 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.226192 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/164884a9-7595-4216-87ea-e550ba7fa0ea-sys\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226530 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.226406 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/164884a9-7595-4216-87ea-e550ba7fa0ea-metrics-client-ca\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226530 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.226518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.226700 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.226680 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-textfile\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.229013 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.228984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.245577 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.245516 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhmq8\" (UniqueName: \"kubernetes.io/projected/164884a9-7595-4216-87ea-e550ba7fa0ea-kube-api-access-zhmq8\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.274591 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.274558 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:23.373556 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.373518 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:23.590249 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.590219 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:23.690189 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.690116 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:23.729931 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.729905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-tls\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.732150 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.732122 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/164884a9-7595-4216-87ea-e550ba7fa0ea-node-exporter-tls\") pod \"node-exporter-tmtx2\" (UID: \"164884a9-7595-4216-87ea-e550ba7fa0ea\") " pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.975413 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:23.975341 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tmtx2" Jul 01 16:10:23.984624 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:10:23.984599 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164884a9_7595_4216_87ea_e550ba7fa0ea.slice/crio-0c71b6f496542985c8faef65cfdd54298da4cff74caf1fbd1fbbcf566dee319c WatchSource:0}: Error finding container 0c71b6f496542985c8faef65cfdd54298da4cff74caf1fbd1fbbcf566dee319c: Status 404 returned error can't find the container with id 0c71b6f496542985c8faef65cfdd54298da4cff74caf1fbd1fbbcf566dee319c Jul 01 16:10:24.080775 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:24.080741 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:24.140517 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:24.140481 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8kmq4" event={"ID":"1d61ef3f-9eca-48a4-957a-06523c974be6","Type":"ContainerStarted","Data":"6261be7805e651ab555a0b9f444205c612c19f597f6db2d15ad8ed29297b6325"} Jul 01 16:10:24.141717 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:24.141687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tmtx2" event={"ID":"164884a9-7595-4216-87ea-e550ba7fa0ea","Type":"ContainerStarted","Data":"0c71b6f496542985c8faef65cfdd54298da4cff74caf1fbd1fbbcf566dee319c"} Jul 01 16:10:24.165402 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:24.165355 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8kmq4" podStartSLOduration=34.648837027 podStartE2EDuration="43.165336348s" totalImagesPullingTime="8.516499321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:24.164486044 +0000 UTC m=+78.844111321" watchObservedRunningTime="2026-07-01 16:10:24.165336348 +0000 UTC m=+78.844961626" Jul 01 16:10:24.183540 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:24.183519 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:24.310425 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:24.310367 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:25.033833 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:25.033803 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:25.099947 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:25.099906 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:25.147367 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:25.147335 2577 generic.go:356] "Generic (PLEG): container finished" podID="164884a9-7595-4216-87ea-e550ba7fa0ea" containerID="f4a2a3df43eebacea4833594a695e0db7283d70c5a70e7680770388e8a565980" exitCode=0 Jul 01 16:10:25.147522 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:25.147427 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tmtx2" event={"ID":"164884a9-7595-4216-87ea-e550ba7fa0ea","Type":"ContainerDied","Data":"f4a2a3df43eebacea4833594a695e0db7283d70c5a70e7680770388e8a565980"} Jul 01 16:10:25.689126 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:25.689089 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:26.119432 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:26.119347 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:26.153769 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:26.153731 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tmtx2" event={"ID":"164884a9-7595-4216-87ea-e550ba7fa0ea","Type":"ContainerStarted","Data":"684dd09aa01b8cd26feab798bbcb62079f8a62dad1ace5108e3df97fb6a7bd7e"} Jul 01 16:10:26.153936 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:26.153800 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tmtx2" event={"ID":"164884a9-7595-4216-87ea-e550ba7fa0ea","Type":"ContainerStarted","Data":"9d5d0f0c9c0eafe6bce74fb292d61cd7162f21f62aa51e2bf8fc9c23ca4e6012"} Jul 01 16:10:26.176444 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:26.176391 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tmtx2" podStartSLOduration=2.104567031 podStartE2EDuration="3.176371937s" totalImagesPullingTime="995.671193ms" totalInitContainerRuntime="76.133713ms" isStatefulPod=true podCreationTimestamp="2026-07-01 16:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:26.175077879 +0000 UTC m=+80.854703157" watchObservedRunningTime="2026-07-01 16:10:26.176371937 +0000 UTC m=+80.855997194" Jul 01 16:10:26.180014 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:26.179985 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:26.494096 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:26.494059 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:26.579290 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:26.579239 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:27.641347 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:27.641321 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:27.747342 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:27.747267 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:27.830544 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:27.830516 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:27.959252 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:27.959222 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:28.163289 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:28.163252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" event={"ID":"aab686d6-807a-4abe-b5d4-3d706ebf5610","Type":"ContainerStarted","Data":"9c942d71d780b62cc12815bd8ba8adffabadea7d044abe3375fe31d6d246e2fe"} Jul 01 16:10:28.163430 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:28.163301 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" event={"ID":"aab686d6-807a-4abe-b5d4-3d706ebf5610","Type":"ContainerStarted","Data":"57e276e8628ca69ce4d0f14b573ed1750b81bae03e0434f774917e1b89d87020"} Jul 01 16:10:28.163430 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:28.163322 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" event={"ID":"aab686d6-807a-4abe-b5d4-3d706ebf5610","Type":"ContainerStarted","Data":"5de0fc49f5c3637cd92134e673021827119de6b8a45d7ce0e05c9069ce166c57"} Jul 01 16:10:28.183724 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:28.183680 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c4c5f6df9-nx4vn" podStartSLOduration=2.242468209 podStartE2EDuration="26.183667194s" totalImagesPullingTime="23.941198985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:28.182820111 +0000 UTC m=+82.862445391" watchObservedRunningTime="2026-07-01 16:10:28.183667194 +0000 UTC m=+82.863292471" Jul 01 16:10:29.305236 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:29.305207 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:30.791036 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:30.791005 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:30.891794 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:30.891766 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:32.421234 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:32.421203 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:32.517649 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:32.517607 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:32.580339 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:32.580312 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:32.708094 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:32.708018 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:32.896358 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:32.896326 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:32.948438 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:32.948410 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:33.078566 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:33.078490 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:33.178296 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:33.178264 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:33.484732 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:33.484698 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:33.603712 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:33.603683 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:34.392821 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:34.392789 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:34.498573 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:34.498546 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:34.599798 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:34.599766 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:35.313234 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:35.313203 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:35.368986 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:35.368956 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:39.166238 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:39.166208 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:39.264235 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:39.264202 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:39.818201 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:39.818170 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:39.872445 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:39.872420 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:41.522532 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:41.522502 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:41.963975 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:41.963947 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:42.064115 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:42.064086 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:42.118065 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:42.118039 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:44.120675 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:44.120338 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:44.175791 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:44.175760 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:44.232481 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:44.232448 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:46.924400 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:46.924348 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:46.992864 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:46.992834 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:48.714003 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:48.713961 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:48.767445 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:48.767399 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:49.120687 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:49.120596 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z4n5q" Jul 01 16:10:51.598331 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:51.598302 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tmtx2_164884a9-7595-4216-87ea-e550ba7fa0ea/init-textfile/0.log" Jul 01 16:10:51.800531 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:51.800509 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tmtx2_164884a9-7595-4216-87ea-e550ba7fa0ea/node-exporter/0.log" Jul 01 16:10:51.998719 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:51.998696 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tmtx2_164884a9-7595-4216-87ea-e550ba7fa0ea/kube-rbac-proxy/0.log" Jul 01 16:10:53.329558 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:53.329531 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:53.387052 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:53.387024 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:56.488567 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:56.488534 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:10:56.543381 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:10:56.543356 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:11:05.324259 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:11:05.324225 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:11:11.683669 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:11:11.683609 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:11:11.738027 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:11:11.737998 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:11:23.348261 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:11:23.348228 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:11:23.416747 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:11:23.416706 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:11:42.298766 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:11:42.298732 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:11:42.398994 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:11:42.398963 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:11:51.960580 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:11:51.960547 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:11:52.020908 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:11:52.020880 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:12:03.338053 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:12:03.337968 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:12:03.435954 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:12:03.435927 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:12:03.535561 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:12:03.535534 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:12:18.220741 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:12:18.220707 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:12:18.274020 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:12:18.273988 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:12:57.583575 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:12:57.583539 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:12:58.338894 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:12:58.338849 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:12:58.499005 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:12:58.498971 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:12:58.566947 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:12:58.566913 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:12:58.623188 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:12:58.623157 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:12:59.223564 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:12:59.223534 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:12:59.304360 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:12:59.304331 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:13:02.435586 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:13:02.435550 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:13:02.490679 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:13:02.490650 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:13:09.656886 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:13:09.656839 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:13:09.752979 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:13:09.752950 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:13:10.050290 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:13:10.050214 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:13:26.507082 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:13:26.507039 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:13:26.613006 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:13:26.612976 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:13:26.670065 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:13:26.669996 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:13:39.090695 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:13:39.090662 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:13:50.090319 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:13:50.090283 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:13:50.184996 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:13:50.184970 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:05.738033 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:05.738006 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvpld_21eb759a-7b1e-4ac1-aab1-00429b75021c/ovn-acl-logging/0.log" Jul 01 16:14:05.745182 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:05.745159 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvpld_21eb759a-7b1e-4ac1-aab1-00429b75021c/ovn-acl-logging/0.log" Jul 01 16:14:05.747349 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:05.747325 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 16:14:21.828583 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:21.828551 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:24.437882 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:24.437847 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:25.774523 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:25.774494 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:25.876241 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:25.876201 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:27.337334 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:27.337301 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:27.450794 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:27.450763 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:28.427200 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:28.427158 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:28.528650 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:28.528611 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:31.506210 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:31.506177 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:31.581012 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:31.580979 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:32.779483 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:32.779449 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:32.879028 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:32.878991 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:38.409466 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:38.409435 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:39.718918 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:39.718874 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-rzsh5"] Jul 01 16:14:39.721053 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:39.721031 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-rzsh5" Jul 01 16:14:39.723961 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:39.723941 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 16:14:39.724063 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:39.724039 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 16:14:39.724620 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:39.724602 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nbj5n\"" Jul 01 16:14:39.734060 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:39.734037 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-rzsh5"] Jul 01 16:14:39.841231 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:39.841198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgrjd\" (UniqueName: \"kubernetes.io/projected/40f83952-bf53-482f-a0ed-5f7869c11622-kube-api-access-vgrjd\") pod \"cert-manager-59c77684cc-rzsh5\" (UID: \"40f83952-bf53-482f-a0ed-5f7869c11622\") " pod="cert-manager/cert-manager-59c77684cc-rzsh5" Jul 01 16:14:39.841391 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:39.841242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40f83952-bf53-482f-a0ed-5f7869c11622-bound-sa-token\") pod \"cert-manager-59c77684cc-rzsh5\" (UID: \"40f83952-bf53-482f-a0ed-5f7869c11622\") " pod="cert-manager/cert-manager-59c77684cc-rzsh5" Jul 01 16:14:39.942000 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:39.941972 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgrjd\" (UniqueName: \"kubernetes.io/projected/40f83952-bf53-482f-a0ed-5f7869c11622-kube-api-access-vgrjd\") pod \"cert-manager-59c77684cc-rzsh5\" (UID: \"40f83952-bf53-482f-a0ed-5f7869c11622\") " pod="cert-manager/cert-manager-59c77684cc-rzsh5" Jul 01 16:14:39.942134 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:39.942013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40f83952-bf53-482f-a0ed-5f7869c11622-bound-sa-token\") pod \"cert-manager-59c77684cc-rzsh5\" (UID: \"40f83952-bf53-482f-a0ed-5f7869c11622\") " pod="cert-manager/cert-manager-59c77684cc-rzsh5" Jul 01 16:14:39.951972 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:39.951943 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgrjd\" (UniqueName: \"kubernetes.io/projected/40f83952-bf53-482f-a0ed-5f7869c11622-kube-api-access-vgrjd\") pod \"cert-manager-59c77684cc-rzsh5\" (UID: \"40f83952-bf53-482f-a0ed-5f7869c11622\") " pod="cert-manager/cert-manager-59c77684cc-rzsh5" Jul 01 16:14:39.953439 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:39.953421 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40f83952-bf53-482f-a0ed-5f7869c11622-bound-sa-token\") pod \"cert-manager-59c77684cc-rzsh5\" (UID: \"40f83952-bf53-482f-a0ed-5f7869c11622\") " pod="cert-manager/cert-manager-59c77684cc-rzsh5" Jul 01 16:14:40.029536 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:40.029456 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-rzsh5" Jul 01 16:14:40.149828 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:40.149719 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-rzsh5"] Jul 01 16:14:40.152249 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:14:40.152223 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40f83952_bf53_482f_a0ed_5f7869c11622.slice/crio-505935daacc54fadc4cfac20fc0f304e2d67e638c6194cd0ed9c02383d0c531a WatchSource:0}: Error finding container 505935daacc54fadc4cfac20fc0f304e2d67e638c6194cd0ed9c02383d0c531a: Status 404 returned error can't find the container with id 505935daacc54fadc4cfac20fc0f304e2d67e638c6194cd0ed9c02383d0c531a Jul 01 16:14:40.154151 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:40.154136 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:14:40.962164 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:40.962125 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-rzsh5" event={"ID":"40f83952-bf53-482f-a0ed-5f7869c11622","Type":"ContainerStarted","Data":"505935daacc54fadc4cfac20fc0f304e2d67e638c6194cd0ed9c02383d0c531a"} Jul 01 16:14:43.141844 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:43.141801 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:43.246412 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:43.246369 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:43.973704 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:43.973667 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-rzsh5" event={"ID":"40f83952-bf53-482f-a0ed-5f7869c11622","Type":"ContainerStarted","Data":"30c98ab7be90678f79a6397e0a5a00570a6ecbcb8e0b77c3f602ef16c47c20ea"} Jul 01 16:14:43.997247 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:43.997200 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-rzsh5" podStartSLOduration=1.707068002 podStartE2EDuration="4.997185547s" totalImagesPullingTime="3.290117545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:14:43.996811271 +0000 UTC m=+338.676436545" watchObservedRunningTime="2026-07-01 16:14:43.997185547 +0000 UTC m=+338.676810823" Jul 01 16:14:45.180753 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.180717 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm"] Jul 01 16:14:45.182866 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.182849 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm" Jul 01 16:14:45.184969 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.184948 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:14:45.185535 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.185518 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 16:14:45.185614 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.185531 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9ppq9\"" Jul 01 16:14:45.193113 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.193090 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm"] Jul 01 16:14:45.283596 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.283564 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5wgw\" (UniqueName: \"kubernetes.io/projected/e3e41914-7603-45d6-a2a7-513a0564c9be-kube-api-access-g5wgw\") pod \"openshift-lws-operator-fd8ccff4c-dk7rm\" (UID: \"e3e41914-7603-45d6-a2a7-513a0564c9be\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm" Jul 01 16:14:45.283765 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.283605 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3e41914-7603-45d6-a2a7-513a0564c9be-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dk7rm\" (UID: \"e3e41914-7603-45d6-a2a7-513a0564c9be\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm" Jul 01 16:14:45.384920 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.384882 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5wgw\" (UniqueName: \"kubernetes.io/projected/e3e41914-7603-45d6-a2a7-513a0564c9be-kube-api-access-g5wgw\") pod \"openshift-lws-operator-fd8ccff4c-dk7rm\" (UID: \"e3e41914-7603-45d6-a2a7-513a0564c9be\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm" Jul 01 16:14:45.385052 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.384932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3e41914-7603-45d6-a2a7-513a0564c9be-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dk7rm\" (UID: \"e3e41914-7603-45d6-a2a7-513a0564c9be\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm" Jul 01 16:14:45.385241 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.385225 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3e41914-7603-45d6-a2a7-513a0564c9be-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dk7rm\" (UID: \"e3e41914-7603-45d6-a2a7-513a0564c9be\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm" Jul 01 16:14:45.393576 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.393544 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5wgw\" (UniqueName: \"kubernetes.io/projected/e3e41914-7603-45d6-a2a7-513a0564c9be-kube-api-access-g5wgw\") pod \"openshift-lws-operator-fd8ccff4c-dk7rm\" (UID: \"e3e41914-7603-45d6-a2a7-513a0564c9be\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm" Jul 01 16:14:45.491677 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.491582 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm" Jul 01 16:14:45.610928 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.610900 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm"] Jul 01 16:14:45.613796 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:14:45.613768 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3e41914_7603_45d6_a2a7_513a0564c9be.slice/crio-62be6b3de9529673ff65b8b37c00beeff681468c59a40753c44c32051045385e WatchSource:0}: Error finding container 62be6b3de9529673ff65b8b37c00beeff681468c59a40753c44c32051045385e: Status 404 returned error can't find the container with id 62be6b3de9529673ff65b8b37c00beeff681468c59a40753c44c32051045385e Jul 01 16:14:45.982054 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:45.982023 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm" event={"ID":"e3e41914-7603-45d6-a2a7-513a0564c9be","Type":"ContainerStarted","Data":"62be6b3de9529673ff65b8b37c00beeff681468c59a40753c44c32051045385e"} Jul 01 16:14:48.994492 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:48.994450 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm" event={"ID":"e3e41914-7603-45d6-a2a7-513a0564c9be","Type":"ContainerStarted","Data":"b3bc218871290db5c1c7c7daf66f01c77a23f8a839b81b43ce9e294b402a667a"} Jul 01 16:14:49.014664 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:49.014595 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dk7rm" podStartSLOduration=1.2535731860000001 podStartE2EDuration="4.014574322s" totalImagesPullingTime="2.761001136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:14:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:14:49.012095981 +0000 UTC m=+343.691721258" watchObservedRunningTime="2026-07-01 16:14:49.014574322 +0000 UTC m=+343.694199601" Jul 01 16:14:49.751775 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:49.751741 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:49.852753 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:49.852714 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:51.532563 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:51.532532 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:53.292550 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:53.292518 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:14:53.385364 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:14:53.385337 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:04.385082 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:04.384998 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:04.476443 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:04.476410 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:04.992004 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:04.991973 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:05.232699 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.232669 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:05.327655 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.327557 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:05.421429 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.421392 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645"] Jul 01 16:15:05.424944 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.424927 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.429563 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.429535 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 16:15:05.429802 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.429780 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 16:15:05.429930 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.429831 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4vx4q\"" Jul 01 16:15:05.429930 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.429862 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 16:15:05.430048 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.429780 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 16:15:05.443295 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.443275 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645"] Jul 01 16:15:05.514029 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.514001 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:05.527092 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.527066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/346991bd-db84-401d-a137-67831b2468e1-manifests\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.527205 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.527097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rxq5\" (UniqueName: \"kubernetes.io/projected/346991bd-db84-401d-a137-67831b2468e1-kube-api-access-4rxq5\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.527205 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.527117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/346991bd-db84-401d-a137-67831b2468e1-tmp\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.527205 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.527133 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/346991bd-db84-401d-a137-67831b2468e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.527352 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.527264 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/346991bd-db84-401d-a137-67831b2468e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.617843 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.617766 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:05.627901 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.627876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/346991bd-db84-401d-a137-67831b2468e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.627981 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.627934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/346991bd-db84-401d-a137-67831b2468e1-manifests\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.627981 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.627957 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rxq5\" (UniqueName: \"kubernetes.io/projected/346991bd-db84-401d-a137-67831b2468e1-kube-api-access-4rxq5\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.627981 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.627975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/346991bd-db84-401d-a137-67831b2468e1-tmp\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.628135 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.627990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/346991bd-db84-401d-a137-67831b2468e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.628340 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.628317 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/346991bd-db84-401d-a137-67831b2468e1-manifests\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.630257 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.630232 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/346991bd-db84-401d-a137-67831b2468e1-tmp\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.630589 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.630569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/346991bd-db84-401d-a137-67831b2468e1-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.630660 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.630585 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/346991bd-db84-401d-a137-67831b2468e1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.653433 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.653406 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rxq5\" (UniqueName: \"kubernetes.io/projected/346991bd-db84-401d-a137-67831b2468e1-kube-api-access-4rxq5\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-qr645\" (UID: \"346991bd-db84-401d-a137-67831b2468e1\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.743122 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.743093 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:05.759936 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.759916 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4vx4q\"" Jul 01 16:15:05.765235 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.765218 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:05.837201 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.837170 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:05.940912 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.940880 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645"] Jul 01 16:15:05.945012 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:15:05.944987 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346991bd_db84_401d_a137_67831b2468e1.slice/crio-6c4208d8e5c55a1d6cb7d8b305934b4a550d62c116d21022798a3c391a27ec01 WatchSource:0}: Error finding container 6c4208d8e5c55a1d6cb7d8b305934b4a550d62c116d21022798a3c391a27ec01: Status 404 returned error can't find the container with id 6c4208d8e5c55a1d6cb7d8b305934b4a550d62c116d21022798a3c391a27ec01 Jul 01 16:15:05.952514 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:05.952490 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:06.033957 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:06.033931 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:06.049894 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:06.049863 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" event={"ID":"346991bd-db84-401d-a137-67831b2468e1","Type":"ContainerStarted","Data":"6c4208d8e5c55a1d6cb7d8b305934b4a550d62c116d21022798a3c391a27ec01"} Jul 01 16:15:06.107379 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:06.107345 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:06.232826 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:06.232739 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:06.441892 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:06.441859 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:10.064581 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:10.064552 2577 generic.go:356] "Generic (PLEG): container finished" podID="346991bd-db84-401d-a137-67831b2468e1" containerID="0594edc28af842dae27be575023ee32a4a43f39b69bc4990520f98b34c98ab4e" exitCode=0 Jul 01 16:15:10.064898 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:10.064611 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" event={"ID":"346991bd-db84-401d-a137-67831b2468e1","Type":"ContainerDied","Data":"0594edc28af842dae27be575023ee32a4a43f39b69bc4990520f98b34c98ab4e"} Jul 01 16:15:11.071680 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:11.071559 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" event={"ID":"346991bd-db84-401d-a137-67831b2468e1","Type":"ContainerStarted","Data":"7f20ebc4bae7ed742566bd230133c59bb5f403001a70b6b333416f0c6d8092aa"} Jul 01 16:15:11.072132 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:11.071692 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:11.118193 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:11.118142 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" podStartSLOduration=1.474717311 podStartE2EDuration="6.11812574s" totalImagesPullingTime="3.73091357s" totalInitContainerRuntime="912.494859ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:11.117529162 +0000 UTC m=+365.797154451" watchObservedRunningTime="2026-07-01 16:15:11.11812574 +0000 UTC m=+365.797751086" Jul 01 16:15:16.101831 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:16.101795 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:16.687293 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:16.687248 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:22.076495 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:22.076466 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-qr645" Jul 01 16:15:25.937519 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:25.937472 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:26.071692 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:26.071667 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:32.275995 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.275931 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:32.410233 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.410203 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p"] Jul 01 16:15:32.413480 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.413462 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:32.417318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.417276 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdk5t\" (UniqueName: \"kubernetes.io/projected/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-kube-api-access-wdk5t\") pod \"kube-auth-proxy-5545fb4b4d-bf58p\" (UID: \"e9d9bad5-6bf5-479a-8479-7b5d62e22f3a\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:32.417318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.417315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-tls-certs\") pod \"kube-auth-proxy-5545fb4b4d-bf58p\" (UID: \"e9d9bad5-6bf5-479a-8479-7b5d62e22f3a\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:32.417477 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.417337 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-tmp\") pod \"kube-auth-proxy-5545fb4b4d-bf58p\" (UID: \"e9d9bad5-6bf5-479a-8479-7b5d62e22f3a\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:32.418533 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:32.418505 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" Jul 01 16:15:32.418621 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:32.418540 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-auth-proxy-5545fb4b4d-bf58p\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="e9d9bad5-6bf5-479a-8479-7b5d62e22f3a" pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:32.418621 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:32.418582 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-creds\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" type="*v1.Secret" Jul 01 16:15:32.418729 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:32.418670 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 01 16:15:32.418729 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:32.418673 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 01 16:15:32.418729 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:32.418681 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-pqv8m\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pqv8m\"" type="*v1.Secret" Jul 01 16:15:32.442776 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.442745 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-fr8pd"] Jul 01 16:15:32.445796 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.445777 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" Jul 01 16:15:32.448194 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.448175 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nbc2k\"" Jul 01 16:15:32.448499 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.448487 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 01 16:15:32.456183 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.456160 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p"] Jul 01 16:15:32.496579 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.496546 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-fr8pd"] Jul 01 16:15:32.517763 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.517735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa3a3337-9826-4513-a910-2087a6973cf8-cert\") pod \"odh-model-controller-6dc94f689f-fr8pd\" (UID: \"fa3a3337-9826-4513-a910-2087a6973cf8\") " pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" Jul 01 16:15:32.517929 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.517783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdk5t\" (UniqueName: \"kubernetes.io/projected/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-kube-api-access-wdk5t\") pod \"kube-auth-proxy-5545fb4b4d-bf58p\" (UID: \"e9d9bad5-6bf5-479a-8479-7b5d62e22f3a\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:32.517929 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.517813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-tls-certs\") pod \"kube-auth-proxy-5545fb4b4d-bf58p\" (UID: \"e9d9bad5-6bf5-479a-8479-7b5d62e22f3a\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:32.517929 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.517840 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-tmp\") pod \"kube-auth-proxy-5545fb4b4d-bf58p\" (UID: \"e9d9bad5-6bf5-479a-8479-7b5d62e22f3a\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:32.517929 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.517873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz8q5\" (UniqueName: \"kubernetes.io/projected/fa3a3337-9826-4513-a910-2087a6973cf8-kube-api-access-rz8q5\") pod \"odh-model-controller-6dc94f689f-fr8pd\" (UID: \"fa3a3337-9826-4513-a910-2087a6973cf8\") " pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" Jul 01 16:15:32.518383 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.518341 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:32.520075 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.520055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-tmp\") pod \"kube-auth-proxy-5545fb4b4d-bf58p\" (UID: \"e9d9bad5-6bf5-479a-8479-7b5d62e22f3a\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:32.615369 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.615283 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:32.618388 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.618364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa3a3337-9826-4513-a910-2087a6973cf8-cert\") pod \"odh-model-controller-6dc94f689f-fr8pd\" (UID: \"fa3a3337-9826-4513-a910-2087a6973cf8\") " pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" Jul 01 16:15:32.618501 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.618424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz8q5\" (UniqueName: \"kubernetes.io/projected/fa3a3337-9826-4513-a910-2087a6973cf8-kube-api-access-rz8q5\") pod \"odh-model-controller-6dc94f689f-fr8pd\" (UID: \"fa3a3337-9826-4513-a910-2087a6973cf8\") " pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" Jul 01 16:15:32.618543 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:32.618526 2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 01 16:15:32.618620 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:32.618607 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa3a3337-9826-4513-a910-2087a6973cf8-cert podName:fa3a3337-9826-4513-a910-2087a6973cf8 nodeName:}" failed. No retries permitted until 2026-07-01 16:15:33.118587324 +0000 UTC m=+387.798212603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa3a3337-9826-4513-a910-2087a6973cf8-cert") pod "odh-model-controller-6dc94f689f-fr8pd" (UID: "fa3a3337-9826-4513-a910-2087a6973cf8") : secret "odh-model-controller-webhook-cert" not found Jul 01 16:15:32.643412 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.643376 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz8q5\" (UniqueName: \"kubernetes.io/projected/fa3a3337-9826-4513-a910-2087a6973cf8-kube-api-access-rz8q5\") pod \"odh-model-controller-6dc94f689f-fr8pd\" (UID: \"fa3a3337-9826-4513-a910-2087a6973cf8\") " pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" Jul 01 16:15:32.710813 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.710778 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:32.809875 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:32.809843 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:33.122759 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.122720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa3a3337-9826-4513-a910-2087a6973cf8-cert\") pod \"odh-model-controller-6dc94f689f-fr8pd\" (UID: \"fa3a3337-9826-4513-a910-2087a6973cf8\") " pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" Jul 01 16:15:33.125122 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.125096 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa3a3337-9826-4513-a910-2087a6973cf8-cert\") pod \"odh-model-controller-6dc94f689f-fr8pd\" (UID: \"fa3a3337-9826-4513-a910-2087a6973cf8\") " pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" Jul 01 16:15:33.356011 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.355980 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" Jul 01 16:15:33.393987 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.393923 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 16:15:33.458592 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.458559 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:33.518307 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:33.518278 2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: failed to sync secret cache: timed out waiting for the condition Jul 01 16:15:33.518477 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:33.518359 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-tls-certs podName:e9d9bad5-6bf5-479a-8479-7b5d62e22f3a nodeName:}" failed. No retries permitted until 2026-07-01 16:15:34.018335758 +0000 UTC m=+388.697961019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-tls-certs") pod "kube-auth-proxy-5545fb4b4d-bf58p" (UID: "e9d9bad5-6bf5-479a-8479-7b5d62e22f3a") : failed to sync secret cache: timed out waiting for the condition Jul 01 16:15:33.519029 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.519005 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-fr8pd"] Jul 01 16:15:33.522145 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:15:33.522120 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa3a3337_9826_4513_a910_2087a6973cf8.slice/crio-7e0c8e700735522016177d5f5cec4899405b52fedffaf977d7fd0458ec23fecf WatchSource:0}: Error finding container 7e0c8e700735522016177d5f5cec4899405b52fedffaf977d7fd0458ec23fecf: Status 404 returned error can't find the container with id 7e0c8e700735522016177d5f5cec4899405b52fedffaf977d7fd0458ec23fecf Jul 01 16:15:33.526466 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.526444 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-wxlx7"] Jul 01 16:15:33.529206 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:33.529187 2577 projected.go:291] Couldn't get configMap openshift-ingress/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 01 16:15:33.529293 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:33.529222 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wdk5t for pod openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p: failed to sync configmap cache: timed out waiting for the condition Jul 01 16:15:33.529340 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:33.529295 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-kube-api-access-wdk5t podName:e9d9bad5-6bf5-479a-8479-7b5d62e22f3a nodeName:}" failed. No retries permitted until 2026-07-01 16:15:34.029275148 +0000 UTC m=+388.708900418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wdk5t" (UniqueName: "kubernetes.io/projected/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-kube-api-access-wdk5t") pod "kube-auth-proxy-5545fb4b4d-bf58p" (UID: "e9d9bad5-6bf5-479a-8479-7b5d62e22f3a") : failed to sync configmap cache: timed out waiting for the condition Jul 01 16:15:33.530822 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.530807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-wxlx7" Jul 01 16:15:33.534415 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.534399 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-9cc5f\"" Jul 01 16:15:33.535811 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.535791 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 01 16:15:33.543686 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.543656 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-wxlx7"] Jul 01 16:15:33.607800 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.607775 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 16:15:33.621566 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.621539 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:33.625712 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.625694 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38366358-fab3-4789-af8b-dbe453873de5-tls-certs\") pod \"model-serving-api-5dd488fc48-wxlx7\" (UID: \"38366358-fab3-4789-af8b-dbe453873de5\") " pod="opendatahub/model-serving-api-5dd488fc48-wxlx7" Jul 01 16:15:33.625765 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.625733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jscn8\" (UniqueName: \"kubernetes.io/projected/38366358-fab3-4789-af8b-dbe453873de5-kube-api-access-jscn8\") pod \"model-serving-api-5dd488fc48-wxlx7\" (UID: \"38366358-fab3-4789-af8b-dbe453873de5\") " pod="opendatahub/model-serving-api-5dd488fc48-wxlx7" Jul 01 16:15:33.670771 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.670690 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 16:15:33.706118 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.706095 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pqv8m\"" Jul 01 16:15:33.726497 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.726470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jscn8\" (UniqueName: \"kubernetes.io/projected/38366358-fab3-4789-af8b-dbe453873de5-kube-api-access-jscn8\") pod \"model-serving-api-5dd488fc48-wxlx7\" (UID: \"38366358-fab3-4789-af8b-dbe453873de5\") " pod="opendatahub/model-serving-api-5dd488fc48-wxlx7" Jul 01 16:15:33.726708 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.726562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38366358-fab3-4789-af8b-dbe453873de5-tls-certs\") pod \"model-serving-api-5dd488fc48-wxlx7\" (UID: \"38366358-fab3-4789-af8b-dbe453873de5\") " pod="opendatahub/model-serving-api-5dd488fc48-wxlx7" Jul 01 16:15:33.729449 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.729420 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38366358-fab3-4789-af8b-dbe453873de5-tls-certs\") pod \"model-serving-api-5dd488fc48-wxlx7\" (UID: \"38366358-fab3-4789-af8b-dbe453873de5\") " pod="opendatahub/model-serving-api-5dd488fc48-wxlx7" Jul 01 16:15:33.736991 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.736954 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jscn8\" (UniqueName: \"kubernetes.io/projected/38366358-fab3-4789-af8b-dbe453873de5-kube-api-access-jscn8\") pod \"model-serving-api-5dd488fc48-wxlx7\" (UID: \"38366358-fab3-4789-af8b-dbe453873de5\") " pod="opendatahub/model-serving-api-5dd488fc48-wxlx7" Jul 01 16:15:33.803481 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.803447 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg"] Jul 01 16:15:33.806509 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.806493 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.809782 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.809759 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 01 16:15:33.809893 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.809763 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z59jb\"" Jul 01 16:15:33.810793 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.810768 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 01 16:15:33.810890 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.810841 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 16:15:33.810890 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.810839 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 01 16:15:33.824838 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.824813 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg"] Jul 01 16:15:33.827857 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.827834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.827953 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.827870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43fbece6-dcff-418f-bdb0-3463e79a3545-local-certs\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.827953 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.827887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-token\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.827953 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.827904 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.828094 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.827974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-cacerts\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.828094 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.827997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms5qp\" (UniqueName: \"kubernetes.io/projected/43fbece6-dcff-418f-bdb0-3463e79a3545-kube-api-access-ms5qp\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.828094 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.828079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.839556 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.839528 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:33.843410 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.843388 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-wxlx7" Jul 01 16:15:33.915400 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.915355 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:33.929534 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.929502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.929678 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.929564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43fbece6-dcff-418f-bdb0-3463e79a3545-local-certs\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.929678 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.929594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-token\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.929678 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.929619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.929841 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.929698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-cacerts\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.929841 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.929742 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms5qp\" (UniqueName: \"kubernetes.io/projected/43fbece6-dcff-418f-bdb0-3463e79a3545-kube-api-access-ms5qp\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.929841 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.929817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.930455 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.930424 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.932195 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.932143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.932293 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.932202 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43fbece6-dcff-418f-bdb0-3463e79a3545-local-certs\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.932577 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.932559 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-cacerts\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.932896 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.932877 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.941819 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.941754 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-token\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.942230 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.942205 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms5qp\" (UniqueName: \"kubernetes.io/projected/43fbece6-dcff-418f-bdb0-3463e79a3545-kube-api-access-ms5qp\") pod \"istiod-openshift-gateway-7574459656-xxlwg\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:33.981090 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.981043 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-wxlx7"] Jul 01 16:15:33.983140 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:15:33.983106 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38366358_fab3_4789_af8b_dbe453873de5.slice/crio-5a8047df89832c74467c6ca6d875254751f6281c3182115abda2c75bd9041289 WatchSource:0}: Error finding container 5a8047df89832c74467c6ca6d875254751f6281c3182115abda2c75bd9041289: Status 404 returned error can't find the container with id 5a8047df89832c74467c6ca6d875254751f6281c3182115abda2c75bd9041289 Jul 01 16:15:33.985143 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:33.985126 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 16:15:34.031035 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.031009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdk5t\" (UniqueName: \"kubernetes.io/projected/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-kube-api-access-wdk5t\") pod \"kube-auth-proxy-5545fb4b4d-bf58p\" (UID: \"e9d9bad5-6bf5-479a-8479-7b5d62e22f3a\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:34.031157 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.031040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-tls-certs\") pod \"kube-auth-proxy-5545fb4b4d-bf58p\" (UID: \"e9d9bad5-6bf5-479a-8479-7b5d62e22f3a\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:34.033469 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.033447 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-tls-certs\") pod \"kube-auth-proxy-5545fb4b4d-bf58p\" (UID: \"e9d9bad5-6bf5-479a-8479-7b5d62e22f3a\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:34.033658 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.033619 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdk5t\" (UniqueName: \"kubernetes.io/projected/e9d9bad5-6bf5-479a-8479-7b5d62e22f3a-kube-api-access-wdk5t\") pod \"kube-auth-proxy-5545fb4b4d-bf58p\" (UID: \"e9d9bad5-6bf5-479a-8479-7b5d62e22f3a\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:34.115693 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.115596 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:34.153767 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.153691 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-wxlx7" event={"ID":"38366358-fab3-4789-af8b-dbe453873de5","Type":"ContainerStarted","Data":"5a8047df89832c74467c6ca6d875254751f6281c3182115abda2c75bd9041289"} Jul 01 16:15:34.155169 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.155138 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" event={"ID":"fa3a3337-9826-4513-a910-2087a6973cf8","Type":"ContainerStarted","Data":"7e0c8e700735522016177d5f5cec4899405b52fedffaf977d7fd0458ec23fecf"} Jul 01 16:15:34.172369 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.170968 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5968f65d96-cszlc"] Jul 01 16:15:34.174796 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.174717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5968f65d96-cszlc" Jul 01 16:15:34.178216 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.177670 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-j5czb\"" Jul 01 16:15:34.178216 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.177950 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 16:15:34.206019 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.205890 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5968f65d96-cszlc"] Jul 01 16:15:34.223268 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.223202 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" Jul 01 16:15:34.232513 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.232284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7ppx\" (UniqueName: \"kubernetes.io/projected/98092218-bf7d-4f93-aa57-1161551eed13-kube-api-access-b7ppx\") pod \"dashboard-redirect-5968f65d96-cszlc\" (UID: \"98092218-bf7d-4f93-aa57-1161551eed13\") " pod="opendatahub/dashboard-redirect-5968f65d96-cszlc" Jul 01 16:15:34.232513 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.232334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/98092218-bf7d-4f93-aa57-1161551eed13-redirect-config\") pod \"dashboard-redirect-5968f65d96-cszlc\" (UID: \"98092218-bf7d-4f93-aa57-1161551eed13\") " pod="opendatahub/dashboard-redirect-5968f65d96-cszlc" Jul 01 16:15:34.251056 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.250516 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:34.287571 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.287493 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg"] Jul 01 16:15:34.296077 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:15:34.295994 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43fbece6_dcff_418f_bdb0_3463e79a3545.slice/crio-6e7e575defaa1bd54b97ba11fa0f581b00b81a2ceac1f8711dee64a2c7ff81e7 WatchSource:0}: Error finding container 6e7e575defaa1bd54b97ba11fa0f581b00b81a2ceac1f8711dee64a2c7ff81e7: Status 404 returned error can't find the container with id 6e7e575defaa1bd54b97ba11fa0f581b00b81a2ceac1f8711dee64a2c7ff81e7 Jul 01 16:15:34.333443 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.333028 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7ppx\" (UniqueName: \"kubernetes.io/projected/98092218-bf7d-4f93-aa57-1161551eed13-kube-api-access-b7ppx\") pod \"dashboard-redirect-5968f65d96-cszlc\" (UID: \"98092218-bf7d-4f93-aa57-1161551eed13\") " pod="opendatahub/dashboard-redirect-5968f65d96-cszlc" Jul 01 16:15:34.333443 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.333074 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/98092218-bf7d-4f93-aa57-1161551eed13-redirect-config\") pod \"dashboard-redirect-5968f65d96-cszlc\" (UID: \"98092218-bf7d-4f93-aa57-1161551eed13\") " pod="opendatahub/dashboard-redirect-5968f65d96-cszlc" Jul 01 16:15:34.334308 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.334040 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/98092218-bf7d-4f93-aa57-1161551eed13-redirect-config\") pod \"dashboard-redirect-5968f65d96-cszlc\" (UID: \"98092218-bf7d-4f93-aa57-1161551eed13\") " pod="opendatahub/dashboard-redirect-5968f65d96-cszlc" Jul 01 16:15:34.354907 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.354840 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7ppx\" (UniqueName: \"kubernetes.io/projected/98092218-bf7d-4f93-aa57-1161551eed13-kube-api-access-b7ppx\") pod \"dashboard-redirect-5968f65d96-cszlc\" (UID: \"98092218-bf7d-4f93-aa57-1161551eed13\") " pod="opendatahub/dashboard-redirect-5968f65d96-cszlc" Jul 01 16:15:34.408297 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.408264 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p"] Jul 01 16:15:34.411324 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:15:34.411297 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d9bad5_6bf5_479a_8479_7b5d62e22f3a.slice/crio-4cc21af0b2593da17fdd47afce975a6d8d5018606d9a84f44b33d07726a55901 WatchSource:0}: Error finding container 4cc21af0b2593da17fdd47afce975a6d8d5018606d9a84f44b33d07726a55901: Status 404 returned error can't find the container with id 4cc21af0b2593da17fdd47afce975a6d8d5018606d9a84f44b33d07726a55901 Jul 01 16:15:34.491060 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.490989 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5968f65d96-cszlc" Jul 01 16:15:34.685073 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:34.685010 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5968f65d96-cszlc"] Jul 01 16:15:34.688797 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:15:34.688764 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98092218_bf7d_4f93_aa57_1161551eed13.slice/crio-023826d1564fee35441c01ad74687432772963d192ed45eb86d1a832ac38ba18 WatchSource:0}: Error finding container 023826d1564fee35441c01ad74687432772963d192ed45eb86d1a832ac38ba18: Status 404 returned error can't find the container with id 023826d1564fee35441c01ad74687432772963d192ed45eb86d1a832ac38ba18 Jul 01 16:15:35.163920 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:35.163880 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" event={"ID":"43fbece6-dcff-418f-bdb0-3463e79a3545","Type":"ContainerStarted","Data":"6e7e575defaa1bd54b97ba11fa0f581b00b81a2ceac1f8711dee64a2c7ff81e7"} Jul 01 16:15:35.166696 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:35.166663 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5968f65d96-cszlc" event={"ID":"98092218-bf7d-4f93-aa57-1161551eed13","Type":"ContainerStarted","Data":"023826d1564fee35441c01ad74687432772963d192ed45eb86d1a832ac38ba18"} Jul 01 16:15:35.168989 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:35.168962 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" event={"ID":"e9d9bad5-6bf5-479a-8479-7b5d62e22f3a","Type":"ContainerStarted","Data":"4cc21af0b2593da17fdd47afce975a6d8d5018606d9a84f44b33d07726a55901"} Jul 01 16:15:35.263353 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:35.263301 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:42.640233 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:42.640191 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 16:15:42.640585 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:42.640262 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 16:15:43.215313 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.215272 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-wxlx7" event={"ID":"38366358-fab3-4789-af8b-dbe453873de5","Type":"ContainerStarted","Data":"05279ca63d69700f1cd44562e0646022987324cadd97badd8bbb6547ae0d67b6"} Jul 01 16:15:43.215512 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.215408 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-wxlx7" Jul 01 16:15:43.217217 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.217063 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" event={"ID":"fa3a3337-9826-4513-a910-2087a6973cf8","Type":"ContainerStarted","Data":"4a3aa1ef9d583beb361ec9e68b6749b460ad484179d7c8d40dc308e0bc07097c"} Jul 01 16:15:43.217217 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.217132 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" Jul 01 16:15:43.218715 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.218625 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5968f65d96-cszlc" event={"ID":"98092218-bf7d-4f93-aa57-1161551eed13","Type":"ContainerStarted","Data":"bb40368880ad09bd15a2a7e467c5e3b0def8191c01953fcd075767cb2a317f7c"} Jul 01 16:15:43.220352 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.220326 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" event={"ID":"e9d9bad5-6bf5-479a-8479-7b5d62e22f3a","Type":"ContainerStarted","Data":"675199efa7f2fee5bf6a172119d1de068d56c6d3fad5d91595d3a1b30dac08d3"} Jul 01 16:15:43.222465 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.222440 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" event={"ID":"43fbece6-dcff-418f-bdb0-3463e79a3545","Type":"ContainerStarted","Data":"e36f27b2fdafe4fc2a23ee02a2b7ca1f0d18a5518dad2fa617b60582b2477e1b"} Jul 01 16:15:43.222569 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.222494 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:43.273589 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.273464 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-wxlx7" podStartSLOduration=1.2433104560000001 podStartE2EDuration="10.273443178s" totalImagesPullingTime="9.030132722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:43.269713153 +0000 UTC m=+397.949338431" watchObservedRunningTime="2026-07-01 16:15:43.273443178 +0000 UTC m=+397.953068456" Jul 01 16:15:43.315618 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.315566 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" podStartSLOduration=2.199138208 podStartE2EDuration="11.315550007s" totalImagesPullingTime="9.116411799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:43.311826139 +0000 UTC m=+397.991451415" watchObservedRunningTime="2026-07-01 16:15:43.315550007 +0000 UTC m=+397.995175261" Jul 01 16:15:43.404183 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.404133 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" podStartSLOduration=2.06437564 podStartE2EDuration="10.404116309s" totalImagesPullingTime="8.339740669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:43.400536859 +0000 UTC m=+398.080162138" watchObservedRunningTime="2026-07-01 16:15:43.404116309 +0000 UTC m=+398.083741585" Jul 01 16:15:43.487315 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.487260 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5968f65d96-cszlc" podStartSLOduration=1.102508196 podStartE2EDuration="9.487243331s" totalImagesPullingTime="8.384735135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:43.479245321 +0000 UTC m=+398.158870599" watchObservedRunningTime="2026-07-01 16:15:43.487243331 +0000 UTC m=+398.166868636" Jul 01 16:15:43.541451 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.541350 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-bf58p" podStartSLOduration=2.9393604 podStartE2EDuration="11.541332189s" totalImagesPullingTime="8.601971789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:43.540119793 +0000 UTC m=+398.219745070" watchObservedRunningTime="2026-07-01 16:15:43.541332189 +0000 UTC m=+398.220957467" Jul 01 16:15:43.865209 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:43.865118 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:44.018625 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.018585 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:44.231145 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.231118 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:44.260578 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.260536 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm"] Jul 01 16:15:44.269281 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.269246 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.273206 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.273184 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mxsmm\"" Jul 01 16:15:44.312018 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.311984 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm"] Jul 01 16:15:44.338756 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.338724 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9524b75b-5618-4b7a-b301-20fca5034132-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.338902 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.338835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.338977 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.338954 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.339149 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.339129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9524b75b-5618-4b7a-b301-20fca5034132-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.339259 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.339235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tr5g\" (UniqueName: \"kubernetes.io/projected/9524b75b-5618-4b7a-b301-20fca5034132-kube-api-access-6tr5g\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.339321 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.339294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.339321 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.339311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.339423 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.339395 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.339478 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.339421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9524b75b-5618-4b7a-b301-20fca5034132-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.440869 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.440824 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.441040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.440875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.441040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.440928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.441040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.440961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9524b75b-5618-4b7a-b301-20fca5034132-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.441200 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.441103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9524b75b-5618-4b7a-b301-20fca5034132-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.441200 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.441153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.441200 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.441191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.441345 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.441237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9524b75b-5618-4b7a-b301-20fca5034132-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.441345 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.441256 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.441345 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.441284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tr5g\" (UniqueName: \"kubernetes.io/projected/9524b75b-5618-4b7a-b301-20fca5034132-kube-api-access-6tr5g\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.441469 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.441377 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.441526 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.441506 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.441575 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.441526 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.441968 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.441949 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9524b75b-5618-4b7a-b301-20fca5034132-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.443454 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.443423 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9524b75b-5618-4b7a-b301-20fca5034132-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.443622 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.443602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9524b75b-5618-4b7a-b301-20fca5034132-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.474943 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.474908 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tr5g\" (UniqueName: \"kubernetes.io/projected/9524b75b-5618-4b7a-b301-20fca5034132-kube-api-access-6tr5g\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.482248 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.482130 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9524b75b-5618-4b7a-b301-20fca5034132-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nxdtm\" (UID: \"9524b75b-5618-4b7a-b301-20fca5034132\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.491952 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.491925 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:44.580017 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.579995 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:44.786612 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.786522 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm"] Jul 01 16:15:44.794326 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:15:44.794296 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9524b75b_5618_4b7a_b301_20fca5034132.slice/crio-2b3c896a4ff1cd54921183c7157d573e8403c9be9ee3cf754ab866460ea64755 WatchSource:0}: Error finding container 2b3c896a4ff1cd54921183c7157d573e8403c9be9ee3cf754ab866460ea64755: Status 404 returned error can't find the container with id 2b3c896a4ff1cd54921183c7157d573e8403c9be9ee3cf754ab866460ea64755 Jul 01 16:15:44.864098 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:44.864065 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:45.001652 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:45.001603 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:45.204850 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:45.204820 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:45.234294 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:45.234259 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" event={"ID":"9524b75b-5618-4b7a-b301-20fca5034132","Type":"ContainerStarted","Data":"2b3c896a4ff1cd54921183c7157d573e8403c9be9ee3cf754ab866460ea64755"} Jul 01 16:15:45.366599 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:45.366567 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:47.334496 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.334464 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:47.432266 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.432223 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:47.541289 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.541254 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-8bzzf"] Jul 01 16:15:47.544836 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.544803 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-8bzzf" Jul 01 16:15:47.546053 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.546029 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:47.547438 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.547421 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6rgw4\"" Jul 01 16:15:47.547564 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.547549 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 01 16:15:47.580707 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.580683 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc"] Jul 01 16:15:47.584037 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.584019 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" Jul 01 16:15:47.586891 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.586841 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-778jg\"" Jul 01 16:15:47.587032 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.587016 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 01 16:15:47.589746 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.589725 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-8bzzf"] Jul 01 16:15:47.611311 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.611284 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc"] Jul 01 16:15:47.671948 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.671921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca5d03d2-e036-4b7b-b894-041b2c300160-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zbdxc\" (UID: \"ca5d03d2-e036-4b7b-b894-041b2c300160\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" Jul 01 16:15:47.672088 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.671973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2zx5\" (UniqueName: \"kubernetes.io/projected/deac0dd7-32cf-4cb5-8125-33165ed6f1dc-kube-api-access-v2zx5\") pod \"kserve-controller-manager-69fc866d76-8bzzf\" (UID: \"deac0dd7-32cf-4cb5-8125-33165ed6f1dc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8bzzf" Jul 01 16:15:47.672088 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.672034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csc8r\" (UniqueName: \"kubernetes.io/projected/ca5d03d2-e036-4b7b-b894-041b2c300160-kube-api-access-csc8r\") pod \"llmisvc-controller-manager-864bfd7bc9-zbdxc\" (UID: \"ca5d03d2-e036-4b7b-b894-041b2c300160\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" Jul 01 16:15:47.672192 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.672134 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deac0dd7-32cf-4cb5-8125-33165ed6f1dc-cert\") pod \"kserve-controller-manager-69fc866d76-8bzzf\" (UID: \"deac0dd7-32cf-4cb5-8125-33165ed6f1dc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8bzzf" Jul 01 16:15:47.772951 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.772918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deac0dd7-32cf-4cb5-8125-33165ed6f1dc-cert\") pod \"kserve-controller-manager-69fc866d76-8bzzf\" (UID: \"deac0dd7-32cf-4cb5-8125-33165ed6f1dc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8bzzf" Jul 01 16:15:47.773122 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.772979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca5d03d2-e036-4b7b-b894-041b2c300160-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zbdxc\" (UID: \"ca5d03d2-e036-4b7b-b894-041b2c300160\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" Jul 01 16:15:47.773122 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.773009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2zx5\" (UniqueName: \"kubernetes.io/projected/deac0dd7-32cf-4cb5-8125-33165ed6f1dc-kube-api-access-v2zx5\") pod \"kserve-controller-manager-69fc866d76-8bzzf\" (UID: \"deac0dd7-32cf-4cb5-8125-33165ed6f1dc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8bzzf" Jul 01 16:15:47.773122 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.773027 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csc8r\" (UniqueName: \"kubernetes.io/projected/ca5d03d2-e036-4b7b-b894-041b2c300160-kube-api-access-csc8r\") pod \"llmisvc-controller-manager-864bfd7bc9-zbdxc\" (UID: \"ca5d03d2-e036-4b7b-b894-041b2c300160\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" Jul 01 16:15:47.773279 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:47.773139 2577 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 01 16:15:47.773279 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:47.773202 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5d03d2-e036-4b7b-b894-041b2c300160-cert podName:ca5d03d2-e036-4b7b-b894-041b2c300160 nodeName:}" failed. No retries permitted until 2026-07-01 16:15:48.273183071 +0000 UTC m=+402.952808345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca5d03d2-e036-4b7b-b894-041b2c300160-cert") pod "llmisvc-controller-manager-864bfd7bc9-zbdxc" (UID: "ca5d03d2-e036-4b7b-b894-041b2c300160") : secret "llmisvc-webhook-server-cert" not found Jul 01 16:15:47.775385 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.775358 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/deac0dd7-32cf-4cb5-8125-33165ed6f1dc-cert\") pod \"kserve-controller-manager-69fc866d76-8bzzf\" (UID: \"deac0dd7-32cf-4cb5-8125-33165ed6f1dc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8bzzf" Jul 01 16:15:47.798360 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.798327 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csc8r\" (UniqueName: \"kubernetes.io/projected/ca5d03d2-e036-4b7b-b894-041b2c300160-kube-api-access-csc8r\") pod \"llmisvc-controller-manager-864bfd7bc9-zbdxc\" (UID: \"ca5d03d2-e036-4b7b-b894-041b2c300160\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" Jul 01 16:15:47.803789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.803764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2zx5\" (UniqueName: \"kubernetes.io/projected/deac0dd7-32cf-4cb5-8125-33165ed6f1dc-kube-api-access-v2zx5\") pod \"kserve-controller-manager-69fc866d76-8bzzf\" (UID: \"deac0dd7-32cf-4cb5-8125-33165ed6f1dc\") " pod="opendatahub/kserve-controller-manager-69fc866d76-8bzzf" Jul 01 16:15:47.846454 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.846373 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:47.858942 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:47.858918 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-8bzzf" Jul 01 16:15:48.022102 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:48.022071 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:48.048449 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:48.048425 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-8bzzf"] Jul 01 16:15:48.051373 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:15:48.051344 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeac0dd7_32cf_4cb5_8125_33165ed6f1dc.slice/crio-96d542165cfbc9b82ed74d6fdb252682bc34eb8369a7489fbd2e285141e61ae0 WatchSource:0}: Error finding container 96d542165cfbc9b82ed74d6fdb252682bc34eb8369a7489fbd2e285141e61ae0: Status 404 returned error can't find the container with id 96d542165cfbc9b82ed74d6fdb252682bc34eb8369a7489fbd2e285141e61ae0 Jul 01 16:15:48.124948 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:48.124914 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:15:48.255050 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:48.255002 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-8bzzf" event={"ID":"deac0dd7-32cf-4cb5-8125-33165ed6f1dc","Type":"ContainerStarted","Data":"96d542165cfbc9b82ed74d6fdb252682bc34eb8369a7489fbd2e285141e61ae0"} Jul 01 16:15:48.278312 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:48.278275 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca5d03d2-e036-4b7b-b894-041b2c300160-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zbdxc\" (UID: \"ca5d03d2-e036-4b7b-b894-041b2c300160\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" Jul 01 16:15:48.280985 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:48.280952 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca5d03d2-e036-4b7b-b894-041b2c300160-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-zbdxc\" (UID: \"ca5d03d2-e036-4b7b-b894-041b2c300160\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" Jul 01 16:15:48.496682 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:48.496588 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" Jul 01 16:15:49.089406 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.089364 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 16:15:49.089505 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.089465 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 16:15:49.089548 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.089514 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 16:15:49.173648 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.173607 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc"] Jul 01 16:15:49.174141 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:15:49.174117 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podca5d03d2_e036_4b7b_b894_041b2c300160.slice/crio-b57d8a2da3b0ee5abaca22be24cb294d01af136b4c5dfb5f71486639c43c6a90 WatchSource:0}: Error finding container b57d8a2da3b0ee5abaca22be24cb294d01af136b4c5dfb5f71486639c43c6a90: Status 404 returned error can't find the container with id b57d8a2da3b0ee5abaca22be24cb294d01af136b4c5dfb5f71486639c43c6a90 Jul 01 16:15:49.261730 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.261683 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" event={"ID":"ca5d03d2-e036-4b7b-b894-041b2c300160","Type":"ContainerStarted","Data":"b57d8a2da3b0ee5abaca22be24cb294d01af136b4c5dfb5f71486639c43c6a90"} Jul 01 16:15:49.263446 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.263374 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" event={"ID":"9524b75b-5618-4b7a-b301-20fca5034132","Type":"ContainerStarted","Data":"83da6769bf146461e43a7788b36c5f6298c6ab853eada0ae6b530f4ba753eb1c"} Jul 01 16:15:49.331416 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.331306 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" podStartSLOduration=1.038989125 podStartE2EDuration="5.331284443s" totalImagesPullingTime="4.292295318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:49.323194322 +0000 UTC m=+404.002819602" watchObservedRunningTime="2026-07-01 16:15:49.331284443 +0000 UTC m=+404.010909720" Jul 01 16:15:49.449805 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.449773 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg"] Jul 01 16:15:49.450020 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.449983 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" podUID="43fbece6-dcff-418f-bdb0-3463e79a3545" containerName="discovery" containerID="cri-o://e36f27b2fdafe4fc2a23ee02a2b7ca1f0d18a5518dad2fa617b60582b2477e1b" gracePeriod=30 Jul 01 16:15:49.580721 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.580689 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:49.695321 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.695290 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:49.791746 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.791719 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43fbece6-dcff-418f-bdb0-3463e79a3545-local-certs\") pod \"43fbece6-dcff-418f-bdb0-3463e79a3545\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " Jul 01 16:15:49.791874 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.791775 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-csr-ca-configmap\") pod \"43fbece6-dcff-418f-bdb0-3463e79a3545\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " Jul 01 16:15:49.791874 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.791806 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-kubeconfig\") pod \"43fbece6-dcff-418f-bdb0-3463e79a3545\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " Jul 01 16:15:49.791874 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.791852 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-cacerts\") pod \"43fbece6-dcff-418f-bdb0-3463e79a3545\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " Jul 01 16:15:49.791979 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.791889 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-csr-dns-cert\") pod \"43fbece6-dcff-418f-bdb0-3463e79a3545\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " Jul 01 16:15:49.791979 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.791928 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms5qp\" (UniqueName: \"kubernetes.io/projected/43fbece6-dcff-418f-bdb0-3463e79a3545-kube-api-access-ms5qp\") pod \"43fbece6-dcff-418f-bdb0-3463e79a3545\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " Jul 01 16:15:49.792048 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.791983 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-token\") pod \"43fbece6-dcff-418f-bdb0-3463e79a3545\" (UID: \"43fbece6-dcff-418f-bdb0-3463e79a3545\") " Jul 01 16:15:49.792348 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.792224 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "43fbece6-dcff-418f-bdb0-3463e79a3545" (UID: "43fbece6-dcff-418f-bdb0-3463e79a3545"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:15:49.794434 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.794396 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43fbece6-dcff-418f-bdb0-3463e79a3545-kube-api-access-ms5qp" (OuterVolumeSpecName: "kube-api-access-ms5qp") pod "43fbece6-dcff-418f-bdb0-3463e79a3545" (UID: "43fbece6-dcff-418f-bdb0-3463e79a3545"). InnerVolumeSpecName "kube-api-access-ms5qp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:15:49.794571 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.794552 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-token" (OuterVolumeSpecName: "istio-token") pod "43fbece6-dcff-418f-bdb0-3463e79a3545" (UID: "43fbece6-dcff-418f-bdb0-3463e79a3545"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:15:49.794720 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.794620 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "43fbece6-dcff-418f-bdb0-3463e79a3545" (UID: "43fbece6-dcff-418f-bdb0-3463e79a3545"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:15:49.794720 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.794702 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43fbece6-dcff-418f-bdb0-3463e79a3545-local-certs" (OuterVolumeSpecName: "local-certs") pod "43fbece6-dcff-418f-bdb0-3463e79a3545" (UID: "43fbece6-dcff-418f-bdb0-3463e79a3545"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:15:49.795175 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.795152 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-cacerts" (OuterVolumeSpecName: "cacerts") pod "43fbece6-dcff-418f-bdb0-3463e79a3545" (UID: "43fbece6-dcff-418f-bdb0-3463e79a3545"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:15:49.795370 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.795336 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "43fbece6-dcff-418f-bdb0-3463e79a3545" (UID: "43fbece6-dcff-418f-bdb0-3463e79a3545"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:15:49.893086 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.893047 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms5qp\" (UniqueName: \"kubernetes.io/projected/43fbece6-dcff-418f-bdb0-3463e79a3545-kube-api-access-ms5qp\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:15:49.893086 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.893088 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-token\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:15:49.893308 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.893105 2577 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43fbece6-dcff-418f-bdb0-3463e79a3545-local-certs\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:15:49.893308 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.893118 2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-csr-ca-configmap\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:15:49.893308 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.893140 2577 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-kubeconfig\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:15:49.893308 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.893155 2577 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-cacerts\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:15:49.893308 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:49.893168 2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43fbece6-dcff-418f-bdb0-3463e79a3545-istio-csr-dns-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:15:50.272100 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:50.272010 2577 generic.go:356] "Generic (PLEG): container finished" podID="43fbece6-dcff-418f-bdb0-3463e79a3545" containerID="e36f27b2fdafe4fc2a23ee02a2b7ca1f0d18a5518dad2fa617b60582b2477e1b" exitCode=0 Jul 01 16:15:50.272100 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:50.272092 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" Jul 01 16:15:50.272310 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:50.272157 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" event={"ID":"43fbece6-dcff-418f-bdb0-3463e79a3545","Type":"ContainerDied","Data":"e36f27b2fdafe4fc2a23ee02a2b7ca1f0d18a5518dad2fa617b60582b2477e1b"} Jul 01 16:15:50.272310 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:50.272203 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg" event={"ID":"43fbece6-dcff-418f-bdb0-3463e79a3545","Type":"ContainerDied","Data":"6e7e575defaa1bd54b97ba11fa0f581b00b81a2ceac1f8711dee64a2c7ff81e7"} Jul 01 16:15:50.272310 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:50.272230 2577 scope.go:117] "RemoveContainer" containerID="e36f27b2fdafe4fc2a23ee02a2b7ca1f0d18a5518dad2fa617b60582b2477e1b" Jul 01 16:15:50.327573 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:50.327538 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg"] Jul 01 16:15:50.354738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:50.354707 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xxlwg"] Jul 01 16:15:50.510053 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:50.510027 2577 scope.go:117] "RemoveContainer" containerID="e36f27b2fdafe4fc2a23ee02a2b7ca1f0d18a5518dad2fa617b60582b2477e1b" Jul 01 16:15:50.510523 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:15:50.510469 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e36f27b2fdafe4fc2a23ee02a2b7ca1f0d18a5518dad2fa617b60582b2477e1b\": container with ID starting with e36f27b2fdafe4fc2a23ee02a2b7ca1f0d18a5518dad2fa617b60582b2477e1b not found: ID does not exist" containerID="e36f27b2fdafe4fc2a23ee02a2b7ca1f0d18a5518dad2fa617b60582b2477e1b" Jul 01 16:15:50.510617 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:50.510517 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e36f27b2fdafe4fc2a23ee02a2b7ca1f0d18a5518dad2fa617b60582b2477e1b"} err="failed to get container status \"e36f27b2fdafe4fc2a23ee02a2b7ca1f0d18a5518dad2fa617b60582b2477e1b\": rpc error: code = NotFound desc = could not find container \"e36f27b2fdafe4fc2a23ee02a2b7ca1f0d18a5518dad2fa617b60582b2477e1b\": container with ID starting with e36f27b2fdafe4fc2a23ee02a2b7ca1f0d18a5518dad2fa617b60582b2477e1b not found: ID does not exist" Jul 01 16:15:50.587831 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:50.587755 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:51.278403 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:51.278375 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:51.279318 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:51.279302 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nxdtm" Jul 01 16:15:51.803460 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:51.803384 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43fbece6-dcff-418f-bdb0-3463e79a3545" path="/var/lib/kubelet/pods/43fbece6-dcff-418f-bdb0-3463e79a3545/volumes" Jul 01 16:15:52.286625 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:52.286449 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-8bzzf" event={"ID":"deac0dd7-32cf-4cb5-8125-33165ed6f1dc","Type":"ContainerStarted","Data":"85ce3c42da4fc04489488076f1941f86846db6a5223ddbbbff03b1d957faa59e"} Jul 01 16:15:52.286625 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:52.286581 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-8bzzf" Jul 01 16:15:52.314581 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:52.314519 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-8bzzf" podStartSLOduration=1.870413116 podStartE2EDuration="5.314500732s" totalImagesPullingTime="3.444087616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:52.31415834 +0000 UTC m=+406.993783612" watchObservedRunningTime="2026-07-01 16:15:52.314500732 +0000 UTC m=+406.994126010" Jul 01 16:15:53.290868 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:53.290826 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" event={"ID":"ca5d03d2-e036-4b7b-b894-041b2c300160","Type":"ContainerStarted","Data":"c027c6fa39d194136bc3f72f53269eb5df421f317b6419dabe0604406dc34389"} Jul 01 16:15:53.321491 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:53.321449 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" podStartSLOduration=2.960234549 podStartE2EDuration="6.321435962s" totalImagesPullingTime="3.361201413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:53.319092403 +0000 UTC m=+407.998717679" watchObservedRunningTime="2026-07-01 16:15:53.321435962 +0000 UTC m=+408.001061294" Jul 01 16:15:54.231451 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:54.231420 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-fr8pd" Jul 01 16:15:54.234043 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:54.234019 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-wxlx7" Jul 01 16:15:54.295649 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:15:54.295605 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" Jul 01 16:16:16.917979 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:16.917940 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:16:17.139354 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:17.139316 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:16:18.879828 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:18.879797 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:16:18.957446 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:18.957418 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:16:23.296605 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:23.296573 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-8bzzf" Jul 01 16:16:25.303030 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:25.303003 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-zbdxc" Jul 01 16:16:47.827878 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:47.827831 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:16:47.945040 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:47.945002 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:16:47.978843 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:47.978816 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zhrfz"] Jul 01 16:16:47.979131 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:47.979118 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43fbece6-dcff-418f-bdb0-3463e79a3545" containerName="discovery" Jul 01 16:16:47.979188 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:47.979133 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="43fbece6-dcff-418f-bdb0-3463e79a3545" containerName="discovery" Jul 01 16:16:47.979225 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:47.979200 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="43fbece6-dcff-418f-bdb0-3463e79a3545" containerName="discovery" Jul 01 16:16:47.982027 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:47.982011 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zhrfz" Jul 01 16:16:47.985762 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:47.985738 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jdft7\"" Jul 01 16:16:47.986332 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:47.986318 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 16:16:47.986389 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:47.986346 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 16:16:48.003234 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.003204 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zhrfz"] Jul 01 16:16:48.041919 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.041889 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lds6d\" (UniqueName: \"kubernetes.io/projected/7b9a22f1-b220-43ca-a140-81f419317aac-kube-api-access-lds6d\") pod \"kuadrant-operator-catalog-zhrfz\" (UID: \"7b9a22f1-b220-43ca-a140-81f419317aac\") " pod="kuadrant-system/kuadrant-operator-catalog-zhrfz" Jul 01 16:16:48.063059 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.063019 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:16:48.142429 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.142400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lds6d\" (UniqueName: \"kubernetes.io/projected/7b9a22f1-b220-43ca-a140-81f419317aac-kube-api-access-lds6d\") pod \"kuadrant-operator-catalog-zhrfz\" (UID: \"7b9a22f1-b220-43ca-a140-81f419317aac\") " pod="kuadrant-system/kuadrant-operator-catalog-zhrfz" Jul 01 16:16:48.154513 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.154488 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lds6d\" (UniqueName: \"kubernetes.io/projected/7b9a22f1-b220-43ca-a140-81f419317aac-kube-api-access-lds6d\") pod \"kuadrant-operator-catalog-zhrfz\" (UID: \"7b9a22f1-b220-43ca-a140-81f419317aac\") " pod="kuadrant-system/kuadrant-operator-catalog-zhrfz" Jul 01 16:16:48.270690 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.270662 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zhrfz"] Jul 01 16:16:48.270890 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.270879 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zhrfz" Jul 01 16:16:48.401182 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.401160 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zhrfz"] Jul 01 16:16:48.402963 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:16:48.402930 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b9a22f1_b220_43ca_a140_81f419317aac.slice/crio-50f697767171851f163f1f1cd31b2ea1b1b3ccd734cd054395d74c4531bb8331 WatchSource:0}: Error finding container 50f697767171851f163f1f1cd31b2ea1b1b3ccd734cd054395d74c4531bb8331: Status 404 returned error can't find the container with id 50f697767171851f163f1f1cd31b2ea1b1b3ccd734cd054395d74c4531bb8331 Jul 01 16:16:48.485520 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.485487 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nsmhf"] Jul 01 16:16:48.488288 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.488273 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nsmhf" Jul 01 16:16:48.500906 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.500881 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nsmhf"] Jul 01 16:16:48.527227 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.527179 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zhrfz" event={"ID":"7b9a22f1-b220-43ca-a140-81f419317aac","Type":"ContainerStarted","Data":"50f697767171851f163f1f1cd31b2ea1b1b3ccd734cd054395d74c4531bb8331"} Jul 01 16:16:48.546624 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.546598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctn27\" (UniqueName: \"kubernetes.io/projected/9bf1e4f9-6690-4c05-b499-9546b4f59861-kube-api-access-ctn27\") pod \"kuadrant-operator-catalog-nsmhf\" (UID: \"9bf1e4f9-6690-4c05-b499-9546b4f59861\") " pod="kuadrant-system/kuadrant-operator-catalog-nsmhf" Jul 01 16:16:48.647811 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.647786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctn27\" (UniqueName: \"kubernetes.io/projected/9bf1e4f9-6690-4c05-b499-9546b4f59861-kube-api-access-ctn27\") pod \"kuadrant-operator-catalog-nsmhf\" (UID: \"9bf1e4f9-6690-4c05-b499-9546b4f59861\") " pod="kuadrant-system/kuadrant-operator-catalog-nsmhf" Jul 01 16:16:48.680990 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.680916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctn27\" (UniqueName: \"kubernetes.io/projected/9bf1e4f9-6690-4c05-b499-9546b4f59861-kube-api-access-ctn27\") pod \"kuadrant-operator-catalog-nsmhf\" (UID: \"9bf1e4f9-6690-4c05-b499-9546b4f59861\") " pod="kuadrant-system/kuadrant-operator-catalog-nsmhf" Jul 01 16:16:48.745016 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.744982 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:16:48.797741 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.797710 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nsmhf" Jul 01 16:16:48.930356 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.930312 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:16:48.936413 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:48.936331 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nsmhf"] Jul 01 16:16:48.940000 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:16:48.939977 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf1e4f9_6690_4c05_b499_9546b4f59861.slice/crio-0be56e13a1a5140eec1b3adf124b3640cf832eb6aac9f93269efa9c13e836ff3 WatchSource:0}: Error finding container 0be56e13a1a5140eec1b3adf124b3640cf832eb6aac9f93269efa9c13e836ff3: Status 404 returned error can't find the container with id 0be56e13a1a5140eec1b3adf124b3640cf832eb6aac9f93269efa9c13e836ff3 Jul 01 16:16:49.532208 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:49.532177 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nsmhf" event={"ID":"9bf1e4f9-6690-4c05-b499-9546b4f59861","Type":"ContainerStarted","Data":"0be56e13a1a5140eec1b3adf124b3640cf832eb6aac9f93269efa9c13e836ff3"} Jul 01 16:16:51.544487 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:51.544387 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zhrfz" event={"ID":"7b9a22f1-b220-43ca-a140-81f419317aac","Type":"ContainerStarted","Data":"4772a470b38e931e2f4ac02a40c04970ad3b929c56d81998a0ca9cd4f7655425"} Jul 01 16:16:51.544487 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:51.544425 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zhrfz" podUID="7b9a22f1-b220-43ca-a140-81f419317aac" containerName="registry-server" containerID="cri-o://4772a470b38e931e2f4ac02a40c04970ad3b929c56d81998a0ca9cd4f7655425" gracePeriod=2 Jul 01 16:16:51.545849 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:51.545823 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nsmhf" event={"ID":"9bf1e4f9-6690-4c05-b499-9546b4f59861","Type":"ContainerStarted","Data":"acadebfe939846cd0704d6b075ee4165f5195f440f0c7292910899f72d1934ba"} Jul 01 16:16:51.569019 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:51.568976 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zhrfz" podStartSLOduration=1.70589061 podStartE2EDuration="4.568961465s" totalImagesPullingTime="2.863070855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:16:51.568312707 +0000 UTC m=+466.247937997" watchObservedRunningTime="2026-07-01 16:16:51.568961465 +0000 UTC m=+466.248586759" Jul 01 16:16:51.591733 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:51.591695 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nsmhf" podStartSLOduration=1.269860343 podStartE2EDuration="3.591682975s" totalImagesPullingTime="2.321822632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:16:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:16:51.590931189 +0000 UTC m=+466.270556488" watchObservedRunningTime="2026-07-01 16:16:51.591682975 +0000 UTC m=+466.271308252" Jul 01 16:16:51.797922 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:51.797869 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zhrfz" Jul 01 16:16:51.872894 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:51.872871 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lds6d\" (UniqueName: \"kubernetes.io/projected/7b9a22f1-b220-43ca-a140-81f419317aac-kube-api-access-lds6d\") pod \"7b9a22f1-b220-43ca-a140-81f419317aac\" (UID: \"7b9a22f1-b220-43ca-a140-81f419317aac\") " Jul 01 16:16:51.875016 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:51.874982 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b9a22f1-b220-43ca-a140-81f419317aac-kube-api-access-lds6d" (OuterVolumeSpecName: "kube-api-access-lds6d") pod "7b9a22f1-b220-43ca-a140-81f419317aac" (UID: "7b9a22f1-b220-43ca-a140-81f419317aac"). InnerVolumeSpecName "kube-api-access-lds6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:16:51.974335 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:51.974310 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lds6d\" (UniqueName: \"kubernetes.io/projected/7b9a22f1-b220-43ca-a140-81f419317aac-kube-api-access-lds6d\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:16:52.552874 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:52.551942 2577 generic.go:356] "Generic (PLEG): container finished" podID="7b9a22f1-b220-43ca-a140-81f419317aac" containerID="4772a470b38e931e2f4ac02a40c04970ad3b929c56d81998a0ca9cd4f7655425" exitCode=0 Jul 01 16:16:52.552874 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:52.552009 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zhrfz" Jul 01 16:16:52.552874 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:52.552056 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zhrfz" event={"ID":"7b9a22f1-b220-43ca-a140-81f419317aac","Type":"ContainerDied","Data":"4772a470b38e931e2f4ac02a40c04970ad3b929c56d81998a0ca9cd4f7655425"} Jul 01 16:16:52.552874 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:52.552099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zhrfz" event={"ID":"7b9a22f1-b220-43ca-a140-81f419317aac","Type":"ContainerDied","Data":"50f697767171851f163f1f1cd31b2ea1b1b3ccd734cd054395d74c4531bb8331"} Jul 01 16:16:52.552874 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:52.552124 2577 scope.go:117] "RemoveContainer" containerID="4772a470b38e931e2f4ac02a40c04970ad3b929c56d81998a0ca9cd4f7655425" Jul 01 16:16:52.566019 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:52.566000 2577 scope.go:117] "RemoveContainer" containerID="4772a470b38e931e2f4ac02a40c04970ad3b929c56d81998a0ca9cd4f7655425" Jul 01 16:16:52.566249 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:16:52.566229 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4772a470b38e931e2f4ac02a40c04970ad3b929c56d81998a0ca9cd4f7655425\": container with ID starting with 4772a470b38e931e2f4ac02a40c04970ad3b929c56d81998a0ca9cd4f7655425 not found: ID does not exist" containerID="4772a470b38e931e2f4ac02a40c04970ad3b929c56d81998a0ca9cd4f7655425" Jul 01 16:16:52.566315 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:52.566257 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4772a470b38e931e2f4ac02a40c04970ad3b929c56d81998a0ca9cd4f7655425"} err="failed to get container status \"4772a470b38e931e2f4ac02a40c04970ad3b929c56d81998a0ca9cd4f7655425\": rpc error: code = NotFound desc = could not find container \"4772a470b38e931e2f4ac02a40c04970ad3b929c56d81998a0ca9cd4f7655425\": container with ID starting with 4772a470b38e931e2f4ac02a40c04970ad3b929c56d81998a0ca9cd4f7655425 not found: ID does not exist" Jul 01 16:16:52.580296 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:52.580263 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zhrfz"] Jul 01 16:16:52.592343 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:52.592324 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zhrfz"] Jul 01 16:16:53.393353 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:53.393320 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:16:53.802169 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:53.802090 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b9a22f1-b220-43ca-a140-81f419317aac" path="/var/lib/kubelet/pods/7b9a22f1-b220-43ca-a140-81f419317aac/volumes" Jul 01 16:16:58.798871 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:58.798833 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-nsmhf" Jul 01 16:16:58.799308 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:58.798906 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-nsmhf" Jul 01 16:16:58.821157 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:58.821132 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-nsmhf" Jul 01 16:16:59.602679 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:16:59.602650 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-nsmhf" Jul 01 16:17:04.815753 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:04.815718 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:04.916934 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:04.916905 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:04.978004 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:04.977962 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:17.475752 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:17.475713 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:20.127455 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.127420 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p"] Jul 01 16:17:20.127920 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.127753 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9a22f1-b220-43ca-a140-81f419317aac" containerName="registry-server" Jul 01 16:17:20.127920 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.127765 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9a22f1-b220-43ca-a140-81f419317aac" containerName="registry-server" Jul 01 16:17:20.127920 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.127825 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b9a22f1-b220-43ca-a140-81f419317aac" containerName="registry-server" Jul 01 16:17:20.130820 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.130800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" Jul 01 16:17:20.140909 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.140889 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-46xzf\"" Jul 01 16:17:20.157851 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.157824 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p"] Jul 01 16:17:20.287943 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.287909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ddrc\" (UniqueName: \"kubernetes.io/projected/c2531403-c520-4989-a9e6-c0c573d5cbe1-kube-api-access-4ddrc\") pod \"limitador-operator-controller-manager-859d7b78bd-67r6p\" (UID: \"c2531403-c520-4989-a9e6-c0c573d5cbe1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" Jul 01 16:17:20.388483 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.388402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ddrc\" (UniqueName: \"kubernetes.io/projected/c2531403-c520-4989-a9e6-c0c573d5cbe1-kube-api-access-4ddrc\") pod \"limitador-operator-controller-manager-859d7b78bd-67r6p\" (UID: \"c2531403-c520-4989-a9e6-c0c573d5cbe1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" Jul 01 16:17:20.401142 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.401114 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ddrc\" (UniqueName: \"kubernetes.io/projected/c2531403-c520-4989-a9e6-c0c573d5cbe1-kube-api-access-4ddrc\") pod \"limitador-operator-controller-manager-859d7b78bd-67r6p\" (UID: \"c2531403-c520-4989-a9e6-c0c573d5cbe1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" Jul 01 16:17:20.440688 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.440659 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" Jul 01 16:17:20.569513 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.569489 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p"] Jul 01 16:17:20.572029 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:17:20.571999 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2531403_c520_4989_a9e6_c0c573d5cbe1.slice/crio-32a2c3a3c67e0347749a7944eb60defd7d0d38a47b8d659e1783a618ba46f943 WatchSource:0}: Error finding container 32a2c3a3c67e0347749a7944eb60defd7d0d38a47b8d659e1783a618ba46f943: Status 404 returned error can't find the container with id 32a2c3a3c67e0347749a7944eb60defd7d0d38a47b8d659e1783a618ba46f943 Jul 01 16:17:20.666773 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.666690 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" event={"ID":"c2531403-c520-4989-a9e6-c0c573d5cbe1","Type":"ContainerStarted","Data":"32a2c3a3c67e0347749a7944eb60defd7d0d38a47b8d659e1783a618ba46f943"} Jul 01 16:17:20.883034 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:20.883005 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:21.673454 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:21.673411 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:22.675800 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:22.675769 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" event={"ID":"c2531403-c520-4989-a9e6-c0c573d5cbe1","Type":"ContainerStarted","Data":"90651124b5d1c0d61e113def5fae35cc20d2cebee86544c424fdcf89acb0cb76"} Jul 01 16:17:22.676165 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:22.675907 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" Jul 01 16:17:22.701485 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:22.701435 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" podStartSLOduration=1.011192023 podStartE2EDuration="2.701419601s" totalImagesPullingTime="1.690227578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:17:22.699472335 +0000 UTC m=+497.379097611" watchObservedRunningTime="2026-07-01 16:17:22.701419601 +0000 UTC m=+497.381044877" Jul 01 16:17:24.250571 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:24.250541 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-f42xb"] Jul 01 16:17:24.258455 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:24.258425 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f42xb" Jul 01 16:17:24.260940 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:24.260917 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jp6hk\"" Jul 01 16:17:24.282384 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:24.282363 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-f42xb"] Jul 01 16:17:24.414490 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:24.414462 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:24.421667 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:24.421622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v25r\" (UniqueName: \"kubernetes.io/projected/0cde2c7f-7c4e-47e5-ab5e-3619dadd0e03-kube-api-access-4v25r\") pod \"authorino-operator-75cc8d5cb7-f42xb\" (UID: \"0cde2c7f-7c4e-47e5-ab5e-3619dadd0e03\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-f42xb" Jul 01 16:17:24.522956 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:24.522896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v25r\" (UniqueName: \"kubernetes.io/projected/0cde2c7f-7c4e-47e5-ab5e-3619dadd0e03-kube-api-access-4v25r\") pod \"authorino-operator-75cc8d5cb7-f42xb\" (UID: \"0cde2c7f-7c4e-47e5-ab5e-3619dadd0e03\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-f42xb" Jul 01 16:17:24.572903 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:24.572879 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v25r\" (UniqueName: \"kubernetes.io/projected/0cde2c7f-7c4e-47e5-ab5e-3619dadd0e03-kube-api-access-4v25r\") pod \"authorino-operator-75cc8d5cb7-f42xb\" (UID: \"0cde2c7f-7c4e-47e5-ab5e-3619dadd0e03\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-f42xb" Jul 01 16:17:24.758575 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:24.758543 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:24.868531 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:24.868459 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f42xb" Jul 01 16:17:24.873526 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:24.873493 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:24.966456 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:24.966424 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:25.014555 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:17:25.014524 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cde2c7f_7c4e_47e5_ab5e_3619dadd0e03.slice/crio-9c15643cfaf1e9dc3eb6fd721042c9515f4d28e27b2e4c667770d4dd44bad87a WatchSource:0}: Error finding container 9c15643cfaf1e9dc3eb6fd721042c9515f4d28e27b2e4c667770d4dd44bad87a: Status 404 returned error can't find the container with id 9c15643cfaf1e9dc3eb6fd721042c9515f4d28e27b2e4c667770d4dd44bad87a Jul 01 16:17:25.016439 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:25.016411 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-f42xb"] Jul 01 16:17:25.690648 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:25.690598 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f42xb" event={"ID":"0cde2c7f-7c4e-47e5-ab5e-3619dadd0e03","Type":"ContainerStarted","Data":"9c15643cfaf1e9dc3eb6fd721042c9515f4d28e27b2e4c667770d4dd44bad87a"} Jul 01 16:17:27.171533 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:27.171502 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:27.701230 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:27.701192 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f42xb" event={"ID":"0cde2c7f-7c4e-47e5-ab5e-3619dadd0e03","Type":"ContainerStarted","Data":"1c11034000cffa532fd75e9e69cd15404d1ecee72d59edca4b05d9e68256daad"} Jul 01 16:17:27.701393 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:27.701323 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f42xb" Jul 01 16:17:27.749402 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:27.749358 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f42xb" podStartSLOduration=1.444372509 podStartE2EDuration="3.749346471s" totalImagesPullingTime="2.304973962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:17:27.749196167 +0000 UTC m=+502.428821469" watchObservedRunningTime="2026-07-01 16:17:27.749346471 +0000 UTC m=+502.428971747" Jul 01 16:17:28.959308 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:28.959280 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:29.436037 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:29.435997 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd"] Jul 01 16:17:29.439218 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:29.439195 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:29.442553 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:29.442537 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n64w4\"" Jul 01 16:17:29.456069 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:29.456044 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd"] Jul 01 16:17:29.562987 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:29.562958 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm5b2\" (UniqueName: \"kubernetes.io/projected/e715d40c-9e0b-4db8-9b41-8dddb444917f-kube-api-access-hm5b2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qq6jd\" (UID: \"e715d40c-9e0b-4db8-9b41-8dddb444917f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:29.563151 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:29.563004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e715d40c-9e0b-4db8-9b41-8dddb444917f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qq6jd\" (UID: \"e715d40c-9e0b-4db8-9b41-8dddb444917f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:29.664220 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:29.664187 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm5b2\" (UniqueName: \"kubernetes.io/projected/e715d40c-9e0b-4db8-9b41-8dddb444917f-kube-api-access-hm5b2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qq6jd\" (UID: \"e715d40c-9e0b-4db8-9b41-8dddb444917f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:29.664380 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:29.664240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e715d40c-9e0b-4db8-9b41-8dddb444917f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qq6jd\" (UID: \"e715d40c-9e0b-4db8-9b41-8dddb444917f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:29.664618 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:29.664597 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e715d40c-9e0b-4db8-9b41-8dddb444917f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qq6jd\" (UID: \"e715d40c-9e0b-4db8-9b41-8dddb444917f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:29.684140 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:29.684115 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm5b2\" (UniqueName: \"kubernetes.io/projected/e715d40c-9e0b-4db8-9b41-8dddb444917f-kube-api-access-hm5b2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qq6jd\" (UID: \"e715d40c-9e0b-4db8-9b41-8dddb444917f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:29.748808 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:29.748734 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:29.890113 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:29.890083 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd"] Jul 01 16:17:29.893981 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:17:29.893958 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode715d40c_9e0b_4db8_9b41_8dddb444917f.slice/crio-f81ba554545035d5d498ddb12c7d211fe2f8095ea328265d270fa877cfe05a2d WatchSource:0}: Error finding container f81ba554545035d5d498ddb12c7d211fe2f8095ea328265d270fa877cfe05a2d: Status 404 returned error can't find the container with id f81ba554545035d5d498ddb12c7d211fe2f8095ea328265d270fa877cfe05a2d Jul 01 16:17:30.487891 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:30.487863 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:30.714482 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:30.714450 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" event={"ID":"e715d40c-9e0b-4db8-9b41-8dddb444917f","Type":"ContainerStarted","Data":"f81ba554545035d5d498ddb12c7d211fe2f8095ea328265d270fa877cfe05a2d"} Jul 01 16:17:32.101378 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:32.101344 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:33.355824 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:33.355794 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:33.467545 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:33.467508 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:33.681964 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:33.681928 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" Jul 01 16:17:34.132442 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:34.132405 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:34.257511 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:34.257477 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:36.744097 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:36.744060 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" event={"ID":"e715d40c-9e0b-4db8-9b41-8dddb444917f","Type":"ContainerStarted","Data":"1c1bbd1f64fac7efdd5568e3cf71ccc42fd5edbc05041443c86e75e823325aca"} Jul 01 16:17:36.744506 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:36.744248 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:36.778804 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:36.778751 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" podStartSLOduration=1.5546005219999999 podStartE2EDuration="7.778737085s" totalImagesPullingTime="6.224136563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:17:36.776438581 +0000 UTC m=+511.456063857" watchObservedRunningTime="2026-07-01 16:17:36.778737085 +0000 UTC m=+511.458362361" Jul 01 16:17:38.061806 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:38.061774 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:38.115992 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:38.115965 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:38.473950 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:38.473917 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:38.573136 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:38.573104 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:38.707454 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:38.707424 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f42xb" Jul 01 16:17:38.814780 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:38.814704 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:39.153865 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:39.153830 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:41.137931 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:41.137895 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:42.418086 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:42.418057 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:42.479574 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:42.479545 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:47.750721 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:47.750692 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:48.775330 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:48.775296 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z"] Jul 01 16:17:48.778675 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:48.778658 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" Jul 01 16:17:48.793757 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:48.793733 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z"] Jul 01 16:17:48.905852 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:48.905817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw7ps\" (UniqueName: \"kubernetes.io/projected/cf257c76-031f-4161-b13b-5180a221a4d7-kube-api-access-sw7ps\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-twj5z\" (UID: \"cf257c76-031f-4161-b13b-5180a221a4d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" Jul 01 16:17:48.906013 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:48.905880 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf257c76-031f-4161-b13b-5180a221a4d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-twj5z\" (UID: \"cf257c76-031f-4161-b13b-5180a221a4d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" Jul 01 16:17:49.006747 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.006715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf257c76-031f-4161-b13b-5180a221a4d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-twj5z\" (UID: \"cf257c76-031f-4161-b13b-5180a221a4d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" Jul 01 16:17:49.006902 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.006789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw7ps\" (UniqueName: \"kubernetes.io/projected/cf257c76-031f-4161-b13b-5180a221a4d7-kube-api-access-sw7ps\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-twj5z\" (UID: \"cf257c76-031f-4161-b13b-5180a221a4d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" Jul 01 16:17:49.007183 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.007164 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf257c76-031f-4161-b13b-5180a221a4d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-twj5z\" (UID: \"cf257c76-031f-4161-b13b-5180a221a4d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" Jul 01 16:17:49.022923 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.022896 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw7ps\" (UniqueName: \"kubernetes.io/projected/cf257c76-031f-4161-b13b-5180a221a4d7-kube-api-access-sw7ps\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-twj5z\" (UID: \"cf257c76-031f-4161-b13b-5180a221a4d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" Jul 01 16:17:49.088535 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.088456 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" Jul 01 16:17:49.257235 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.257207 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z"] Jul 01 16:17:49.258517 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:17:49.258494 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf257c76_031f_4161_b13b_5180a221a4d7.slice/crio-e74990c7b492d41355ce53108087ec9ba2a679b8b9dc1dc7636d2e9494679785 WatchSource:0}: Error finding container e74990c7b492d41355ce53108087ec9ba2a679b8b9dc1dc7636d2e9494679785: Status 404 returned error can't find the container with id e74990c7b492d41355ce53108087ec9ba2a679b8b9dc1dc7636d2e9494679785 Jul 01 16:17:49.540458 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.540409 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z"] Jul 01 16:17:49.542725 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.542698 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z"] Jul 01 16:17:49.555685 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.555663 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd"] Jul 01 16:17:49.555849 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.555830 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" podUID="e715d40c-9e0b-4db8-9b41-8dddb444917f" containerName="manager" containerID="cri-o://1c1bbd1f64fac7efdd5568e3cf71ccc42fd5edbc05041443c86e75e823325aca" gracePeriod=2 Jul 01 16:17:49.570284 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.570258 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd"] Jul 01 16:17:49.578860 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.578836 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k"] Jul 01 16:17:49.579146 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.579133 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e715d40c-9e0b-4db8-9b41-8dddb444917f" containerName="manager" Jul 01 16:17:49.579146 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.579147 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e715d40c-9e0b-4db8-9b41-8dddb444917f" containerName="manager" Jul 01 16:17:49.579285 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.579167 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf257c76-031f-4161-b13b-5180a221a4d7" containerName="manager" Jul 01 16:17:49.579285 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.579175 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf257c76-031f-4161-b13b-5180a221a4d7" containerName="manager" Jul 01 16:17:49.579285 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.579240 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf257c76-031f-4161-b13b-5180a221a4d7" containerName="manager" Jul 01 16:17:49.579285 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.579251 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e715d40c-9e0b-4db8-9b41-8dddb444917f" containerName="manager" Jul 01 16:17:49.582260 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.582239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" Jul 01 16:17:49.586641 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.586606 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p"] Jul 01 16:17:49.586853 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.586827 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" podUID="c2531403-c520-4989-a9e6-c0c573d5cbe1" containerName="manager" containerID="cri-o://90651124b5d1c0d61e113def5fae35cc20d2cebee86544c424fdcf89acb0cb76" gracePeriod=2 Jul 01 16:17:49.592708 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.592334 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p"] Jul 01 16:17:49.594530 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.594508 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9"] Jul 01 16:17:49.594979 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.594962 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2531403-c520-4989-a9e6-c0c573d5cbe1" containerName="manager" Jul 01 16:17:49.595045 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.594992 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2531403-c520-4989-a9e6-c0c573d5cbe1" containerName="manager" Jul 01 16:17:49.595088 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.595077 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2531403-c520-4989-a9e6-c0c573d5cbe1" containerName="manager" Jul 01 16:17:49.598119 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.598100 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" Jul 01 16:17:49.605262 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.605239 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k"] Jul 01 16:17:49.630080 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:17:49.630044 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qq6jd\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="e715d40c-9e0b-4db8-9b41-8dddb444917f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:49.633050 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.633021 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9"] Jul 01 16:17:49.659197 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:17:49.659166 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qq6jd\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="e715d40c-9e0b-4db8-9b41-8dddb444917f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:49.660760 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:17:49.660733 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-67r6p\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="c2531403-c520-4989-a9e6-c0c573d5cbe1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" Jul 01 16:17:49.712880 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.712848 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26vjw\" (UniqueName: \"kubernetes.io/projected/d22a71cb-7b83-4402-9c90-d0c6790cb748-kube-api-access-26vjw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5j4p9\" (UID: \"d22a71cb-7b83-4402-9c90-d0c6790cb748\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" Jul 01 16:17:49.713023 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.712953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d22a71cb-7b83-4402-9c90-d0c6790cb748-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5j4p9\" (UID: \"d22a71cb-7b83-4402-9c90-d0c6790cb748\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" Jul 01 16:17:49.713023 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.712976 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca7cab3-edca-4ef9-8a00-8482b10fcac7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k282k\" (UID: \"cca7cab3-edca-4ef9-8a00-8482b10fcac7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" Jul 01 16:17:49.713023 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.713003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7hfd\" (UniqueName: \"kubernetes.io/projected/cca7cab3-edca-4ef9-8a00-8482b10fcac7-kube-api-access-z7hfd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k282k\" (UID: \"cca7cab3-edca-4ef9-8a00-8482b10fcac7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" Jul 01 16:17:49.801692 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.801606 2577 generic.go:356] "Generic (PLEG): container finished" podID="e715d40c-9e0b-4db8-9b41-8dddb444917f" containerID="1c1bbd1f64fac7efdd5568e3cf71ccc42fd5edbc05041443c86e75e823325aca" exitCode=0 Jul 01 16:17:49.803716 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:17:49.803693 2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" container="manager" Jul 01 16:17:49.805294 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.805269 2577 generic.go:356] "Generic (PLEG): container finished" podID="c2531403-c520-4989-a9e6-c0c573d5cbe1" containerID="90651124b5d1c0d61e113def5fae35cc20d2cebee86544c424fdcf89acb0cb76" exitCode=0 Jul 01 16:17:49.809205 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.809140 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:49.813977 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.813951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26vjw\" (UniqueName: \"kubernetes.io/projected/d22a71cb-7b83-4402-9c90-d0c6790cb748-kube-api-access-26vjw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5j4p9\" (UID: \"d22a71cb-7b83-4402-9c90-d0c6790cb748\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" Jul 01 16:17:49.814095 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.814077 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d22a71cb-7b83-4402-9c90-d0c6790cb748-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5j4p9\" (UID: \"d22a71cb-7b83-4402-9c90-d0c6790cb748\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" Jul 01 16:17:49.814157 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.814114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca7cab3-edca-4ef9-8a00-8482b10fcac7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k282k\" (UID: \"cca7cab3-edca-4ef9-8a00-8482b10fcac7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" Jul 01 16:17:49.814157 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.814142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7hfd\" (UniqueName: \"kubernetes.io/projected/cca7cab3-edca-4ef9-8a00-8482b10fcac7-kube-api-access-z7hfd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k282k\" (UID: \"cca7cab3-edca-4ef9-8a00-8482b10fcac7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" Jul 01 16:17:49.814489 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.814472 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d22a71cb-7b83-4402-9c90-d0c6790cb748-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5j4p9\" (UID: \"d22a71cb-7b83-4402-9c90-d0c6790cb748\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" Jul 01 16:17:49.814582 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.814508 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca7cab3-edca-4ef9-8a00-8482b10fcac7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k282k\" (UID: \"cca7cab3-edca-4ef9-8a00-8482b10fcac7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" Jul 01 16:17:49.819606 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.819585 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" Jul 01 16:17:49.845125 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.845102 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26vjw\" (UniqueName: \"kubernetes.io/projected/d22a71cb-7b83-4402-9c90-d0c6790cb748-kube-api-access-26vjw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5j4p9\" (UID: \"d22a71cb-7b83-4402-9c90-d0c6790cb748\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" Jul 01 16:17:49.847390 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.847368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7hfd\" (UniqueName: \"kubernetes.io/projected/cca7cab3-edca-4ef9-8a00-8482b10fcac7-kube-api-access-z7hfd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k282k\" (UID: \"cca7cab3-edca-4ef9-8a00-8482b10fcac7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" Jul 01 16:17:49.915422 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.915396 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm5b2\" (UniqueName: \"kubernetes.io/projected/e715d40c-9e0b-4db8-9b41-8dddb444917f-kube-api-access-hm5b2\") pod \"e715d40c-9e0b-4db8-9b41-8dddb444917f\" (UID: \"e715d40c-9e0b-4db8-9b41-8dddb444917f\") " Jul 01 16:17:49.915539 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.915438 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e715d40c-9e0b-4db8-9b41-8dddb444917f-extensions-socket-volume\") pod \"e715d40c-9e0b-4db8-9b41-8dddb444917f\" (UID: \"e715d40c-9e0b-4db8-9b41-8dddb444917f\") " Jul 01 16:17:49.915988 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.915960 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e715d40c-9e0b-4db8-9b41-8dddb444917f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e715d40c-9e0b-4db8-9b41-8dddb444917f" (UID: "e715d40c-9e0b-4db8-9b41-8dddb444917f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:17:49.917304 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.917278 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e715d40c-9e0b-4db8-9b41-8dddb444917f-kube-api-access-hm5b2" (OuterVolumeSpecName: "kube-api-access-hm5b2") pod "e715d40c-9e0b-4db8-9b41-8dddb444917f" (UID: "e715d40c-9e0b-4db8-9b41-8dddb444917f"). InnerVolumeSpecName "kube-api-access-hm5b2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:17:49.965472 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.965445 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" Jul 01 16:17:49.971484 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:49.971461 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" Jul 01 16:17:50.016671 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.016554 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ddrc\" (UniqueName: \"kubernetes.io/projected/c2531403-c520-4989-a9e6-c0c573d5cbe1-kube-api-access-4ddrc\") pod \"c2531403-c520-4989-a9e6-c0c573d5cbe1\" (UID: \"c2531403-c520-4989-a9e6-c0c573d5cbe1\") " Jul 01 16:17:50.016866 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.016834 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm5b2\" (UniqueName: \"kubernetes.io/projected/e715d40c-9e0b-4db8-9b41-8dddb444917f-kube-api-access-hm5b2\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:17:50.016866 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.016854 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e715d40c-9e0b-4db8-9b41-8dddb444917f-extensions-socket-volume\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:17:50.018785 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.018758 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2531403-c520-4989-a9e6-c0c573d5cbe1-kube-api-access-4ddrc" (OuterVolumeSpecName: "kube-api-access-4ddrc") pod "c2531403-c520-4989-a9e6-c0c573d5cbe1" (UID: "c2531403-c520-4989-a9e6-c0c573d5cbe1"). InnerVolumeSpecName "kube-api-access-4ddrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:17:50.059244 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.059150 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:50.118332 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.118261 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ddrc\" (UniqueName: \"kubernetes.io/projected/c2531403-c520-4989-a9e6-c0c573d5cbe1-kube-api-access-4ddrc\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:17:50.120301 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.120235 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k"] Jul 01 16:17:50.122742 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:17:50.122708 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca7cab3_edca_4ef9_8a00_8482b10fcac7.slice/crio-665d95826ee8535cf9d0749ac3fc900e88429a7282868e4d694bdcd5f601e4da WatchSource:0}: Error finding container 665d95826ee8535cf9d0749ac3fc900e88429a7282868e4d694bdcd5f601e4da: Status 404 returned error can't find the container with id 665d95826ee8535cf9d0749ac3fc900e88429a7282868e4d694bdcd5f601e4da Jul 01 16:17:50.127684 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.127663 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:50.134699 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.134679 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9"] Jul 01 16:17:50.137590 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:17:50.137565 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22a71cb_7b83_4402_9c90_d0c6790cb748.slice/crio-7e5300f7b518a8dce3f9301cbc7b00f22e4b4e26676c900e0455e6db48c3d1f2 WatchSource:0}: Error finding container 7e5300f7b518a8dce3f9301cbc7b00f22e4b4e26676c900e0455e6db48c3d1f2: Status 404 returned error can't find the container with id 7e5300f7b518a8dce3f9301cbc7b00f22e4b4e26676c900e0455e6db48c3d1f2 Jul 01 16:17:50.811806 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.811773 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" event={"ID":"d22a71cb-7b83-4402-9c90-d0c6790cb748","Type":"ContainerStarted","Data":"3508e281c9e159ad27511d32dca3f47bcac773d0333b899fb8af883906f28ef5"} Jul 01 16:17:50.812233 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.811825 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" event={"ID":"d22a71cb-7b83-4402-9c90-d0c6790cb748","Type":"ContainerStarted","Data":"7e5300f7b518a8dce3f9301cbc7b00f22e4b4e26676c900e0455e6db48c3d1f2"} Jul 01 16:17:50.812233 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.811870 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" Jul 01 16:17:50.813103 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.813087 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq6jd" Jul 01 16:17:50.813230 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.813110 2577 scope.go:117] "RemoveContainer" containerID="1c1bbd1f64fac7efdd5568e3cf71ccc42fd5edbc05041443c86e75e823325aca" Jul 01 16:17:50.814893 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.814865 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" podUID="cf257c76-031f-4161-b13b-5180a221a4d7" containerName="manager" containerID="cri-o://02888f1a0f4f7da34841b7f7397e3799f3f58c948cc159d37af604f192837567" gracePeriod=2 Jul 01 16:17:50.817005 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.816978 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" event={"ID":"cca7cab3-edca-4ef9-8a00-8482b10fcac7","Type":"ContainerStarted","Data":"a5b888575867ed52392f19ab4b51df84bbc462dd31b88b13724c838e054b3278"} Jul 01 16:17:50.817119 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.817025 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" event={"ID":"cca7cab3-edca-4ef9-8a00-8482b10fcac7","Type":"ContainerStarted","Data":"665d95826ee8535cf9d0749ac3fc900e88429a7282868e4d694bdcd5f601e4da"} Jul 01 16:17:50.817119 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.817075 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" Jul 01 16:17:50.818531 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.818511 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-67r6p" Jul 01 16:17:50.823355 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.823339 2577 scope.go:117] "RemoveContainer" containerID="90651124b5d1c0d61e113def5fae35cc20d2cebee86544c424fdcf89acb0cb76" Jul 01 16:17:50.837017 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.836235 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" podStartSLOduration=1.83620435 podStartE2EDuration="1.83620435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:17:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:17:50.831680648 +0000 UTC m=+525.511305928" watchObservedRunningTime="2026-07-01 16:17:50.83620435 +0000 UTC m=+525.515829628" Jul 01 16:17:50.859647 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:50.859583 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" podStartSLOduration=1.859568167 podStartE2EDuration="1.859568167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:17:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:17:50.858563726 +0000 UTC m=+525.538189005" watchObservedRunningTime="2026-07-01 16:17:50.859568167 +0000 UTC m=+525.539193443" Jul 01 16:17:50.860122 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:17:50.860097 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-twj5z\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="cf257c76-031f-4161-b13b-5180a221a4d7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" Jul 01 16:17:51.068189 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.068131 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" Jul 01 16:17:51.070584 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:17:51.070555 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-twj5z\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="cf257c76-031f-4161-b13b-5180a221a4d7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" Jul 01 16:17:51.123993 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.123963 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf257c76-031f-4161-b13b-5180a221a4d7-extensions-socket-volume\") pod \"cf257c76-031f-4161-b13b-5180a221a4d7\" (UID: \"cf257c76-031f-4161-b13b-5180a221a4d7\") " Jul 01 16:17:51.124136 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.124028 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw7ps\" (UniqueName: \"kubernetes.io/projected/cf257c76-031f-4161-b13b-5180a221a4d7-kube-api-access-sw7ps\") pod \"cf257c76-031f-4161-b13b-5180a221a4d7\" (UID: \"cf257c76-031f-4161-b13b-5180a221a4d7\") " Jul 01 16:17:51.124431 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.124406 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf257c76-031f-4161-b13b-5180a221a4d7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cf257c76-031f-4161-b13b-5180a221a4d7" (UID: "cf257c76-031f-4161-b13b-5180a221a4d7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:17:51.126050 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.126029 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf257c76-031f-4161-b13b-5180a221a4d7-kube-api-access-sw7ps" (OuterVolumeSpecName: "kube-api-access-sw7ps") pod "cf257c76-031f-4161-b13b-5180a221a4d7" (UID: "cf257c76-031f-4161-b13b-5180a221a4d7"). InnerVolumeSpecName "kube-api-access-sw7ps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:17:51.225206 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.225178 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf257c76-031f-4161-b13b-5180a221a4d7-extensions-socket-volume\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:17:51.225206 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.225203 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw7ps\" (UniqueName: \"kubernetes.io/projected/cf257c76-031f-4161-b13b-5180a221a4d7-kube-api-access-sw7ps\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:17:51.804928 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.804894 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2531403-c520-4989-a9e6-c0c573d5cbe1" path="/var/lib/kubelet/pods/c2531403-c520-4989-a9e6-c0c573d5cbe1/volumes" Jul 01 16:17:51.805241 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.805228 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf257c76-031f-4161-b13b-5180a221a4d7" path="/var/lib/kubelet/pods/cf257c76-031f-4161-b13b-5180a221a4d7/volumes" Jul 01 16:17:51.805554 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.805542 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e715d40c-9e0b-4db8-9b41-8dddb444917f" path="/var/lib/kubelet/pods/e715d40c-9e0b-4db8-9b41-8dddb444917f/volumes" Jul 01 16:17:51.826626 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.826600 2577 generic.go:356] "Generic (PLEG): container finished" podID="cf257c76-031f-4161-b13b-5180a221a4d7" containerID="02888f1a0f4f7da34841b7f7397e3799f3f58c948cc159d37af604f192837567" exitCode=0 Jul 01 16:17:51.827004 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.826655 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" Jul 01 16:17:51.827004 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.826701 2577 scope.go:117] "RemoveContainer" containerID="02888f1a0f4f7da34841b7f7397e3799f3f58c948cc159d37af604f192837567" Jul 01 16:17:51.831314 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:17:51.831292 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-twj5z\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="cf257c76-031f-4161-b13b-5180a221a4d7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-twj5z" Jul 01 16:17:51.835241 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.835226 2577 scope.go:117] "RemoveContainer" containerID="02888f1a0f4f7da34841b7f7397e3799f3f58c948cc159d37af604f192837567" Jul 01 16:17:51.835491 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:17:51.835472 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02888f1a0f4f7da34841b7f7397e3799f3f58c948cc159d37af604f192837567\": container with ID starting with 02888f1a0f4f7da34841b7f7397e3799f3f58c948cc159d37af604f192837567 not found: ID does not exist" containerID="02888f1a0f4f7da34841b7f7397e3799f3f58c948cc159d37af604f192837567" Jul 01 16:17:51.835553 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:51.835502 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02888f1a0f4f7da34841b7f7397e3799f3f58c948cc159d37af604f192837567"} err="failed to get container status \"02888f1a0f4f7da34841b7f7397e3799f3f58c948cc159d37af604f192837567\": rpc error: code = NotFound desc = could not find container \"02888f1a0f4f7da34841b7f7397e3799f3f58c948cc159d37af604f192837567\": container with ID starting with 02888f1a0f4f7da34841b7f7397e3799f3f58c948cc159d37af604f192837567 not found: ID does not exist" Jul 01 16:17:55.607979 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:55.607944 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:17:55.712300 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:17:55.712266 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:00.200549 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:00.200460 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:00.256830 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:00.256800 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:00.792624 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:00.792591 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:00.893606 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:00.893576 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:01.831430 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:01.831404 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" Jul 01 16:18:01.831816 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:01.831467 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" Jul 01 16:18:01.903475 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:01.903444 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9"] Jul 01 16:18:01.903714 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:01.903691 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" podUID="d22a71cb-7b83-4402-9c90-d0c6790cb748" containerName="manager" containerID="cri-o://3508e281c9e159ad27511d32dca3f47bcac773d0333b899fb8af883906f28ef5" gracePeriod=10 Jul 01 16:18:02.150452 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.150429 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" Jul 01 16:18:02.194291 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.194262 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26vjw\" (UniqueName: \"kubernetes.io/projected/d22a71cb-7b83-4402-9c90-d0c6790cb748-kube-api-access-26vjw\") pod \"d22a71cb-7b83-4402-9c90-d0c6790cb748\" (UID: \"d22a71cb-7b83-4402-9c90-d0c6790cb748\") " Jul 01 16:18:02.194441 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.194314 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d22a71cb-7b83-4402-9c90-d0c6790cb748-extensions-socket-volume\") pod \"d22a71cb-7b83-4402-9c90-d0c6790cb748\" (UID: \"d22a71cb-7b83-4402-9c90-d0c6790cb748\") " Jul 01 16:18:02.194783 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.194754 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d22a71cb-7b83-4402-9c90-d0c6790cb748-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d22a71cb-7b83-4402-9c90-d0c6790cb748" (UID: "d22a71cb-7b83-4402-9c90-d0c6790cb748"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:18:02.196927 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.196884 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d22a71cb-7b83-4402-9c90-d0c6790cb748-kube-api-access-26vjw" (OuterVolumeSpecName: "kube-api-access-26vjw") pod "d22a71cb-7b83-4402-9c90-d0c6790cb748" (UID: "d22a71cb-7b83-4402-9c90-d0c6790cb748"). InnerVolumeSpecName "kube-api-access-26vjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:18:02.212870 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.212846 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76"] Jul 01 16:18:02.213183 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.213171 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d22a71cb-7b83-4402-9c90-d0c6790cb748" containerName="manager" Jul 01 16:18:02.213224 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.213185 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d22a71cb-7b83-4402-9c90-d0c6790cb748" containerName="manager" Jul 01 16:18:02.213260 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.213241 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d22a71cb-7b83-4402-9c90-d0c6790cb748" containerName="manager" Jul 01 16:18:02.215097 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.215083 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76" Jul 01 16:18:02.251866 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.251841 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76"] Jul 01 16:18:02.294996 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.294971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv2qv\" (UniqueName: \"kubernetes.io/projected/75634504-b52d-4daa-a4bd-e155f847d8b8-kube-api-access-wv2qv\") pod \"kuadrant-operator-controller-manager-86878c769f-9gp76\" (UID: \"75634504-b52d-4daa-a4bd-e155f847d8b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76" Jul 01 16:18:02.295139 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.295004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75634504-b52d-4daa-a4bd-e155f847d8b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9gp76\" (UID: \"75634504-b52d-4daa-a4bd-e155f847d8b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76" Jul 01 16:18:02.295139 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.295072 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d22a71cb-7b83-4402-9c90-d0c6790cb748-extensions-socket-volume\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:18:02.295139 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.295093 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26vjw\" (UniqueName: \"kubernetes.io/projected/d22a71cb-7b83-4402-9c90-d0c6790cb748-kube-api-access-26vjw\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:18:02.395626 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.395595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv2qv\" (UniqueName: \"kubernetes.io/projected/75634504-b52d-4daa-a4bd-e155f847d8b8-kube-api-access-wv2qv\") pod \"kuadrant-operator-controller-manager-86878c769f-9gp76\" (UID: \"75634504-b52d-4daa-a4bd-e155f847d8b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76" Jul 01 16:18:02.395777 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.395662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75634504-b52d-4daa-a4bd-e155f847d8b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9gp76\" (UID: \"75634504-b52d-4daa-a4bd-e155f847d8b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76" Jul 01 16:18:02.395987 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.395971 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75634504-b52d-4daa-a4bd-e155f847d8b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9gp76\" (UID: \"75634504-b52d-4daa-a4bd-e155f847d8b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76" Jul 01 16:18:02.409947 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.409922 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv2qv\" (UniqueName: \"kubernetes.io/projected/75634504-b52d-4daa-a4bd-e155f847d8b8-kube-api-access-wv2qv\") pod \"kuadrant-operator-controller-manager-86878c769f-9gp76\" (UID: \"75634504-b52d-4daa-a4bd-e155f847d8b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76" Jul 01 16:18:02.524474 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.524444 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76" Jul 01 16:18:02.653479 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.653449 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76"] Jul 01 16:18:02.655621 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:18:02.655593 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75634504_b52d_4daa_a4bd_e155f847d8b8.slice/crio-c290d26bcc3bb386dfc9263447263cf95370464065b7baf865a8623ece0f8737 WatchSource:0}: Error finding container c290d26bcc3bb386dfc9263447263cf95370464065b7baf865a8623ece0f8737: Status 404 returned error can't find the container with id c290d26bcc3bb386dfc9263447263cf95370464065b7baf865a8623ece0f8737 Jul 01 16:18:02.880334 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.880298 2577 generic.go:356] "Generic (PLEG): container finished" podID="d22a71cb-7b83-4402-9c90-d0c6790cb748" containerID="3508e281c9e159ad27511d32dca3f47bcac773d0333b899fb8af883906f28ef5" exitCode=0 Jul 01 16:18:02.880817 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.880342 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" Jul 01 16:18:02.880817 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.880397 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" event={"ID":"d22a71cb-7b83-4402-9c90-d0c6790cb748","Type":"ContainerDied","Data":"3508e281c9e159ad27511d32dca3f47bcac773d0333b899fb8af883906f28ef5"} Jul 01 16:18:02.880817 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.880449 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9" event={"ID":"d22a71cb-7b83-4402-9c90-d0c6790cb748","Type":"ContainerDied","Data":"7e5300f7b518a8dce3f9301cbc7b00f22e4b4e26676c900e0455e6db48c3d1f2"} Jul 01 16:18:02.880817 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.880475 2577 scope.go:117] "RemoveContainer" containerID="3508e281c9e159ad27511d32dca3f47bcac773d0333b899fb8af883906f28ef5" Jul 01 16:18:02.882296 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.882269 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76" event={"ID":"75634504-b52d-4daa-a4bd-e155f847d8b8","Type":"ContainerStarted","Data":"3123ee397d72cb6f1e5931137eb6d9a64a69b8154e3aa89ac241fc65c2899e34"} Jul 01 16:18:02.882407 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.882320 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76" event={"ID":"75634504-b52d-4daa-a4bd-e155f847d8b8","Type":"ContainerStarted","Data":"c290d26bcc3bb386dfc9263447263cf95370464065b7baf865a8623ece0f8737"} Jul 01 16:18:02.882407 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.882354 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76" Jul 01 16:18:02.889505 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.889487 2577 scope.go:117] "RemoveContainer" containerID="3508e281c9e159ad27511d32dca3f47bcac773d0333b899fb8af883906f28ef5" Jul 01 16:18:02.889774 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:18:02.889755 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3508e281c9e159ad27511d32dca3f47bcac773d0333b899fb8af883906f28ef5\": container with ID starting with 3508e281c9e159ad27511d32dca3f47bcac773d0333b899fb8af883906f28ef5 not found: ID does not exist" containerID="3508e281c9e159ad27511d32dca3f47bcac773d0333b899fb8af883906f28ef5" Jul 01 16:18:02.889833 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.889781 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3508e281c9e159ad27511d32dca3f47bcac773d0333b899fb8af883906f28ef5"} err="failed to get container status \"3508e281c9e159ad27511d32dca3f47bcac773d0333b899fb8af883906f28ef5\": rpc error: code = NotFound desc = could not find container \"3508e281c9e159ad27511d32dca3f47bcac773d0333b899fb8af883906f28ef5\": container with ID starting with 3508e281c9e159ad27511d32dca3f47bcac773d0333b899fb8af883906f28ef5 not found: ID does not exist" Jul 01 16:18:02.901037 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.900994 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76" podStartSLOduration=0.900982582 podStartE2EDuration="900.982582ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:18:02.899952818 +0000 UTC m=+537.579578095" watchObservedRunningTime="2026-07-01 16:18:02.900982582 +0000 UTC m=+537.580607859" Jul 01 16:18:02.912405 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.912349 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9"] Jul 01 16:18:02.918472 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:02.918452 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5j4p9"] Jul 01 16:18:03.802281 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:03.802243 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d22a71cb-7b83-4402-9c90-d0c6790cb748" path="/var/lib/kubelet/pods/d22a71cb-7b83-4402-9c90-d0c6790cb748/volumes" Jul 01 16:18:05.034259 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:05.034224 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:05.126719 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:05.126682 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:11.268039 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:11.268006 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:11.418746 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:11.418715 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:13.889507 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:13.889478 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9gp76" Jul 01 16:18:13.966045 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:13.966016 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k"] Jul 01 16:18:13.966245 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:13.966219 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" podUID="cca7cab3-edca-4ef9-8a00-8482b10fcac7" containerName="manager" containerID="cri-o://a5b888575867ed52392f19ab4b51df84bbc462dd31b88b13724c838e054b3278" gracePeriod=10 Jul 01 16:18:14.220743 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.220718 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" Jul 01 16:18:14.285233 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.285207 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca7cab3-edca-4ef9-8a00-8482b10fcac7-extensions-socket-volume\") pod \"cca7cab3-edca-4ef9-8a00-8482b10fcac7\" (UID: \"cca7cab3-edca-4ef9-8a00-8482b10fcac7\") " Jul 01 16:18:14.285378 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.285245 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7hfd\" (UniqueName: \"kubernetes.io/projected/cca7cab3-edca-4ef9-8a00-8482b10fcac7-kube-api-access-z7hfd\") pod \"cca7cab3-edca-4ef9-8a00-8482b10fcac7\" (UID: \"cca7cab3-edca-4ef9-8a00-8482b10fcac7\") " Jul 01 16:18:14.285697 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.285673 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cca7cab3-edca-4ef9-8a00-8482b10fcac7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cca7cab3-edca-4ef9-8a00-8482b10fcac7" (UID: "cca7cab3-edca-4ef9-8a00-8482b10fcac7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:18:14.287361 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.287339 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cca7cab3-edca-4ef9-8a00-8482b10fcac7-kube-api-access-z7hfd" (OuterVolumeSpecName: "kube-api-access-z7hfd") pod "cca7cab3-edca-4ef9-8a00-8482b10fcac7" (UID: "cca7cab3-edca-4ef9-8a00-8482b10fcac7"). InnerVolumeSpecName "kube-api-access-z7hfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:18:14.385893 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.385864 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7hfd\" (UniqueName: \"kubernetes.io/projected/cca7cab3-edca-4ef9-8a00-8482b10fcac7-kube-api-access-z7hfd\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:18:14.385893 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.385890 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca7cab3-edca-4ef9-8a00-8482b10fcac7-extensions-socket-volume\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:18:14.932589 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.932555 2577 generic.go:356] "Generic (PLEG): container finished" podID="cca7cab3-edca-4ef9-8a00-8482b10fcac7" containerID="a5b888575867ed52392f19ab4b51df84bbc462dd31b88b13724c838e054b3278" exitCode=0 Jul 01 16:18:14.933021 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.932597 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" Jul 01 16:18:14.933021 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.932609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" event={"ID":"cca7cab3-edca-4ef9-8a00-8482b10fcac7","Type":"ContainerDied","Data":"a5b888575867ed52392f19ab4b51df84bbc462dd31b88b13724c838e054b3278"} Jul 01 16:18:14.933021 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.932678 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k" event={"ID":"cca7cab3-edca-4ef9-8a00-8482b10fcac7","Type":"ContainerDied","Data":"665d95826ee8535cf9d0749ac3fc900e88429a7282868e4d694bdcd5f601e4da"} Jul 01 16:18:14.933021 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.932702 2577 scope.go:117] "RemoveContainer" containerID="a5b888575867ed52392f19ab4b51df84bbc462dd31b88b13724c838e054b3278" Jul 01 16:18:14.941684 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.941669 2577 scope.go:117] "RemoveContainer" containerID="a5b888575867ed52392f19ab4b51df84bbc462dd31b88b13724c838e054b3278" Jul 01 16:18:14.941933 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:18:14.941916 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5b888575867ed52392f19ab4b51df84bbc462dd31b88b13724c838e054b3278\": container with ID starting with a5b888575867ed52392f19ab4b51df84bbc462dd31b88b13724c838e054b3278 not found: ID does not exist" containerID="a5b888575867ed52392f19ab4b51df84bbc462dd31b88b13724c838e054b3278" Jul 01 16:18:14.941977 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.941942 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b888575867ed52392f19ab4b51df84bbc462dd31b88b13724c838e054b3278"} err="failed to get container status \"a5b888575867ed52392f19ab4b51df84bbc462dd31b88b13724c838e054b3278\": rpc error: code = NotFound desc = could not find container \"a5b888575867ed52392f19ab4b51df84bbc462dd31b88b13724c838e054b3278\": container with ID starting with a5b888575867ed52392f19ab4b51df84bbc462dd31b88b13724c838e054b3278 not found: ID does not exist" Jul 01 16:18:14.952888 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.952865 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k"] Jul 01 16:18:14.961405 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:14.961384 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k282k"] Jul 01 16:18:15.803243 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:15.803208 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cca7cab3-edca-4ef9-8a00-8482b10fcac7" path="/var/lib/kubelet/pods/cca7cab3-edca-4ef9-8a00-8482b10fcac7/volumes" Jul 01 16:18:18.231288 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.231250 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9"] Jul 01 16:18:18.231793 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.231771 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca7cab3-edca-4ef9-8a00-8482b10fcac7" containerName="manager" Jul 01 16:18:18.231951 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.231937 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca7cab3-edca-4ef9-8a00-8482b10fcac7" containerName="manager" Jul 01 16:18:18.232160 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.232142 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cca7cab3-edca-4ef9-8a00-8482b10fcac7" containerName="manager" Jul 01 16:18:18.235227 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.235208 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.237472 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.237453 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vqffr\"" Jul 01 16:18:18.246364 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.246339 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:18.246448 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.246412 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9"] Jul 01 16:18:18.316307 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.316271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.316471 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.316310 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.316471 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.316335 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.316471 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.316397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.316600 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.316494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6thwm\" (UniqueName: \"kubernetes.io/projected/27f33efb-55f1-4440-b577-1639fd054ea5-kube-api-access-6thwm\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.316600 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.316516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27f33efb-55f1-4440-b577-1639fd054ea5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.316600 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.316575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27f33efb-55f1-4440-b577-1639fd054ea5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.316739 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.316599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27f33efb-55f1-4440-b577-1639fd054ea5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.316739 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.316616 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.417791 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.417764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.417951 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.417802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.417951 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.417833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.418085 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.417975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.418085 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.418050 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6thwm\" (UniqueName: \"kubernetes.io/projected/27f33efb-55f1-4440-b577-1639fd054ea5-kube-api-access-6thwm\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.418248 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.418090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27f33efb-55f1-4440-b577-1639fd054ea5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.418248 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.418123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27f33efb-55f1-4440-b577-1639fd054ea5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.418248 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.418144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27f33efb-55f1-4440-b577-1639fd054ea5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.418248 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.418169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.418443 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.418257 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.418443 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.418290 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.418565 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.418460 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.418565 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.418548 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.419569 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.419544 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27f33efb-55f1-4440-b577-1639fd054ea5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.420679 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.420624 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27f33efb-55f1-4440-b577-1639fd054ea5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.420899 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.420882 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27f33efb-55f1-4440-b577-1639fd054ea5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.429238 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.429218 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27f33efb-55f1-4440-b577-1639fd054ea5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.429774 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.429757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6thwm\" (UniqueName: \"kubernetes.io/projected/27f33efb-55f1-4440-b577-1639fd054ea5-kube-api-access-6thwm\") pod \"maas-default-gateway-openshift-default-56654dcf7-krgt9\" (UID: \"27f33efb-55f1-4440-b577-1639fd054ea5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.455422 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.455396 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:18.545295 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.545219 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:18.676266 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.676204 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9"] Jul 01 16:18:18.678511 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:18:18.678484 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f33efb_55f1_4440_b577_1639fd054ea5.slice/crio-9fe38aa352039c8af817d1a5ad2286c3a63cd987a7c9635a7f9fb2602ee90a93 WatchSource:0}: Error finding container 9fe38aa352039c8af817d1a5ad2286c3a63cd987a7c9635a7f9fb2602ee90a93: Status 404 returned error can't find the container with id 9fe38aa352039c8af817d1a5ad2286c3a63cd987a7c9635a7f9fb2602ee90a93 Jul 01 16:18:18.680454 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.680429 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 16:18:18.680528 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.680492 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 16:18:18.680528 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.680518 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 16:18:18.953017 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.952986 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" event={"ID":"27f33efb-55f1-4440-b577-1639fd054ea5","Type":"ContainerStarted","Data":"18337841253cf8a4db340eba71b70adb8be1edbc2584370386aeb8c7a3bddb67"} Jul 01 16:18:18.953180 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.953040 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" event={"ID":"27f33efb-55f1-4440-b577-1639fd054ea5","Type":"ContainerStarted","Data":"9fe38aa352039c8af817d1a5ad2286c3a63cd987a7c9635a7f9fb2602ee90a93"} Jul 01 16:18:18.974683 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:18.974613 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" podStartSLOduration=0.974596759 podStartE2EDuration="974.596759ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:18:18.97344119 +0000 UTC m=+553.653066477" watchObservedRunningTime="2026-07-01 16:18:18.974596759 +0000 UTC m=+553.654222036" Jul 01 16:18:19.546160 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:19.546125 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:19.550820 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:19.550791 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:19.957541 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:19.957514 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:19.958599 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:19.958580 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:18:20.016312 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:20.016269 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:32.407677 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:32.407616 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:32.465206 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:32.465177 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:33.406270 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.406237 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bvvmx"] Jul 01 16:18:33.409059 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.409038 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" Jul 01 16:18:33.411706 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.411673 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cp5ln\"" Jul 01 16:18:33.411706 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.411673 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 16:18:33.420477 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.420456 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bvvmx"] Jul 01 16:18:33.441560 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.441522 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:33.494464 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.494436 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bvvmx"] Jul 01 16:18:33.501795 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.501770 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:33.542050 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.542022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75m4w\" (UniqueName: \"kubernetes.io/projected/59c33402-d2cf-4ab7-9260-535c26b77897-kube-api-access-75m4w\") pod \"limitador-limitador-64c94fd64f-bvvmx\" (UID: \"59c33402-d2cf-4ab7-9260-535c26b77897\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" Jul 01 16:18:33.542166 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.542128 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59c33402-d2cf-4ab7-9260-535c26b77897-config-file\") pod \"limitador-limitador-64c94fd64f-bvvmx\" (UID: \"59c33402-d2cf-4ab7-9260-535c26b77897\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" Jul 01 16:18:33.611287 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.611255 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:33.643440 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.643411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75m4w\" (UniqueName: \"kubernetes.io/projected/59c33402-d2cf-4ab7-9260-535c26b77897-kube-api-access-75m4w\") pod \"limitador-limitador-64c94fd64f-bvvmx\" (UID: \"59c33402-d2cf-4ab7-9260-535c26b77897\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" Jul 01 16:18:33.643566 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.643493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59c33402-d2cf-4ab7-9260-535c26b77897-config-file\") pod \"limitador-limitador-64c94fd64f-bvvmx\" (UID: \"59c33402-d2cf-4ab7-9260-535c26b77897\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" Jul 01 16:18:33.644122 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.644105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59c33402-d2cf-4ab7-9260-535c26b77897-config-file\") pod \"limitador-limitador-64c94fd64f-bvvmx\" (UID: \"59c33402-d2cf-4ab7-9260-535c26b77897\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" Jul 01 16:18:33.652052 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.652033 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75m4w\" (UniqueName: \"kubernetes.io/projected/59c33402-d2cf-4ab7-9260-535c26b77897-kube-api-access-75m4w\") pod \"limitador-limitador-64c94fd64f-bvvmx\" (UID: \"59c33402-d2cf-4ab7-9260-535c26b77897\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" Jul 01 16:18:33.719219 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.719155 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" Jul 01 16:18:33.852609 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:33.852588 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bvvmx"] Jul 01 16:18:33.855100 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:18:33.855073 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c33402_d2cf_4ab7_9260_535c26b77897.slice/crio-f5eec4a0cae54257e690eb1defdd578c450e5c34efedbc30760672a20083023f WatchSource:0}: Error finding container f5eec4a0cae54257e690eb1defdd578c450e5c34efedbc30760672a20083023f: Status 404 returned error can't find the container with id f5eec4a0cae54257e690eb1defdd578c450e5c34efedbc30760672a20083023f Jul 01 16:18:34.015158 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.015080 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" event={"ID":"59c33402-d2cf-4ab7-9260-535c26b77897","Type":"ContainerStarted","Data":"f5eec4a0cae54257e690eb1defdd578c450e5c34efedbc30760672a20083023f"} Jul 01 16:18:34.241713 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.241674 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-85hss"] Jul 01 16:18:34.245294 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.245267 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-85hss" Jul 01 16:18:34.245538 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.245516 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-85hss"] Jul 01 16:18:34.247727 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.247705 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-446g2\"" Jul 01 16:18:34.256084 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.256062 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:34.314738 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.314624 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:34.347805 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.347782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gpdr\" (UniqueName: \"kubernetes.io/projected/e18407f2-2ea1-4f57-8f8c-9450be2138b0-kube-api-access-5gpdr\") pod \"authorino-58cd955675-85hss\" (UID: \"e18407f2-2ea1-4f57-8f8c-9450be2138b0\") " pod="kuadrant-system/authorino-58cd955675-85hss" Jul 01 16:18:34.448873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.448846 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gpdr\" (UniqueName: \"kubernetes.io/projected/e18407f2-2ea1-4f57-8f8c-9450be2138b0-kube-api-access-5gpdr\") pod \"authorino-58cd955675-85hss\" (UID: \"e18407f2-2ea1-4f57-8f8c-9450be2138b0\") " pod="kuadrant-system/authorino-58cd955675-85hss" Jul 01 16:18:34.457226 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.457194 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gpdr\" (UniqueName: \"kubernetes.io/projected/e18407f2-2ea1-4f57-8f8c-9450be2138b0-kube-api-access-5gpdr\") pod \"authorino-58cd955675-85hss\" (UID: \"e18407f2-2ea1-4f57-8f8c-9450be2138b0\") " pod="kuadrant-system/authorino-58cd955675-85hss" Jul 01 16:18:34.552418 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.552386 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-ncxw7"] Jul 01 16:18:34.554830 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.554813 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ncxw7" Jul 01 16:18:34.555244 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.555223 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-85hss" Jul 01 16:18:34.563571 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.563551 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ncxw7"] Jul 01 16:18:34.650348 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.650311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft58g\" (UniqueName: \"kubernetes.io/projected/65361b0c-8002-409b-8132-91270f9299dd-kube-api-access-ft58g\") pod \"authorino-75d556bd77-ncxw7\" (UID: \"65361b0c-8002-409b-8132-91270f9299dd\") " pod="kuadrant-system/authorino-75d556bd77-ncxw7" Jul 01 16:18:34.689013 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.688990 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-85hss"] Jul 01 16:18:34.690888 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:18:34.690862 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode18407f2_2ea1_4f57_8f8c_9450be2138b0.slice/crio-30522921df645efe2994b1d6ee5970aea64e7e4af94ab3aa1dc2f005fa535ae6 WatchSource:0}: Error finding container 30522921df645efe2994b1d6ee5970aea64e7e4af94ab3aa1dc2f005fa535ae6: Status 404 returned error can't find the container with id 30522921df645efe2994b1d6ee5970aea64e7e4af94ab3aa1dc2f005fa535ae6 Jul 01 16:18:34.750870 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.750842 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft58g\" (UniqueName: \"kubernetes.io/projected/65361b0c-8002-409b-8132-91270f9299dd-kube-api-access-ft58g\") pod \"authorino-75d556bd77-ncxw7\" (UID: \"65361b0c-8002-409b-8132-91270f9299dd\") " pod="kuadrant-system/authorino-75d556bd77-ncxw7" Jul 01 16:18:34.758389 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.758362 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft58g\" (UniqueName: \"kubernetes.io/projected/65361b0c-8002-409b-8132-91270f9299dd-kube-api-access-ft58g\") pod \"authorino-75d556bd77-ncxw7\" (UID: \"65361b0c-8002-409b-8132-91270f9299dd\") " pod="kuadrant-system/authorino-75d556bd77-ncxw7" Jul 01 16:18:34.865718 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:34.865617 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ncxw7" Jul 01 16:18:35.027944 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:35.027880 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-85hss" event={"ID":"e18407f2-2ea1-4f57-8f8c-9450be2138b0","Type":"ContainerStarted","Data":"30522921df645efe2994b1d6ee5970aea64e7e4af94ab3aa1dc2f005fa535ae6"} Jul 01 16:18:35.040577 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:35.040545 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ncxw7"] Jul 01 16:18:36.034245 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:36.034211 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ncxw7" event={"ID":"65361b0c-8002-409b-8132-91270f9299dd","Type":"ContainerStarted","Data":"327e433497b21db5240bcafcbfa94eb769045f5c769f650db2ee1bcf345fc184"} Jul 01 16:18:38.053844 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:38.053809 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" event={"ID":"59c33402-d2cf-4ab7-9260-535c26b77897","Type":"ContainerStarted","Data":"5c1a5fe9660d17b98f2bc32c5f973158aac20d11f661308df29665132d64fc7c"} Jul 01 16:18:38.054275 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:38.053925 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" Jul 01 16:18:38.075382 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:38.075322 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" podStartSLOduration=1.930804025 podStartE2EDuration="5.075301027s" totalImagesPullingTime="3.144497002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:18:38.073232184 +0000 UTC m=+572.752857462" watchObservedRunningTime="2026-07-01 16:18:38.075301027 +0000 UTC m=+572.754926305" Jul 01 16:18:40.068866 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:40.068820 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-85hss" event={"ID":"e18407f2-2ea1-4f57-8f8c-9450be2138b0","Type":"ContainerStarted","Data":"202f3dc78cfe139df1a3b905f107f2683a59f00a6f26803f5b48a2dbba5b5373"} Jul 01 16:18:40.070411 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:40.070385 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ncxw7" event={"ID":"65361b0c-8002-409b-8132-91270f9299dd","Type":"ContainerStarted","Data":"97e258297570100636b866d9db22c432bc211a04f6250d4aff046c1ce32481be"} Jul 01 16:18:40.084378 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:40.084330 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-85hss" podStartSLOduration=1.2342370950000001 podStartE2EDuration="6.084318678s" totalImagesPullingTime="4.850081583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:18:40.082602703 +0000 UTC m=+574.762228007" watchObservedRunningTime="2026-07-01 16:18:40.084318678 +0000 UTC m=+574.763943954" Jul 01 16:18:40.097099 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:40.097062 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-ncxw7" podStartSLOduration=1.596042401 podStartE2EDuration="6.097050135s" totalImagesPullingTime="4.501007734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:18:40.096350072 +0000 UTC m=+574.775975349" watchObservedRunningTime="2026-07-01 16:18:40.097050135 +0000 UTC m=+574.776675410" Jul 01 16:18:40.132416 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:40.132389 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-85hss"] Jul 01 16:18:42.079438 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:42.079372 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-85hss" podUID="e18407f2-2ea1-4f57-8f8c-9450be2138b0" containerName="authorino" containerID="cri-o://202f3dc78cfe139df1a3b905f107f2683a59f00a6f26803f5b48a2dbba5b5373" gracePeriod=30 Jul 01 16:18:42.329485 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:42.329433 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-85hss" Jul 01 16:18:42.425338 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:42.425309 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gpdr\" (UniqueName: \"kubernetes.io/projected/e18407f2-2ea1-4f57-8f8c-9450be2138b0-kube-api-access-5gpdr\") pod \"e18407f2-2ea1-4f57-8f8c-9450be2138b0\" (UID: \"e18407f2-2ea1-4f57-8f8c-9450be2138b0\") " Jul 01 16:18:42.427303 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:42.427269 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e18407f2-2ea1-4f57-8f8c-9450be2138b0-kube-api-access-5gpdr" (OuterVolumeSpecName: "kube-api-access-5gpdr") pod "e18407f2-2ea1-4f57-8f8c-9450be2138b0" (UID: "e18407f2-2ea1-4f57-8f8c-9450be2138b0"). InnerVolumeSpecName "kube-api-access-5gpdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:18:42.525931 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:42.525907 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gpdr\" (UniqueName: \"kubernetes.io/projected/e18407f2-2ea1-4f57-8f8c-9450be2138b0-kube-api-access-5gpdr\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:18:43.085132 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:43.085102 2577 generic.go:356] "Generic (PLEG): container finished" podID="e18407f2-2ea1-4f57-8f8c-9450be2138b0" containerID="202f3dc78cfe139df1a3b905f107f2683a59f00a6f26803f5b48a2dbba5b5373" exitCode=0 Jul 01 16:18:43.085525 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:43.085143 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-85hss" Jul 01 16:18:43.085525 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:43.085176 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-85hss" event={"ID":"e18407f2-2ea1-4f57-8f8c-9450be2138b0","Type":"ContainerDied","Data":"202f3dc78cfe139df1a3b905f107f2683a59f00a6f26803f5b48a2dbba5b5373"} Jul 01 16:18:43.085525 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:43.085206 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-85hss" event={"ID":"e18407f2-2ea1-4f57-8f8c-9450be2138b0","Type":"ContainerDied","Data":"30522921df645efe2994b1d6ee5970aea64e7e4af94ab3aa1dc2f005fa535ae6"} Jul 01 16:18:43.085525 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:43.085224 2577 scope.go:117] "RemoveContainer" containerID="202f3dc78cfe139df1a3b905f107f2683a59f00a6f26803f5b48a2dbba5b5373" Jul 01 16:18:43.093930 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:43.093913 2577 scope.go:117] "RemoveContainer" containerID="202f3dc78cfe139df1a3b905f107f2683a59f00a6f26803f5b48a2dbba5b5373" Jul 01 16:18:43.094163 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:18:43.094146 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"202f3dc78cfe139df1a3b905f107f2683a59f00a6f26803f5b48a2dbba5b5373\": container with ID starting with 202f3dc78cfe139df1a3b905f107f2683a59f00a6f26803f5b48a2dbba5b5373 not found: ID does not exist" containerID="202f3dc78cfe139df1a3b905f107f2683a59f00a6f26803f5b48a2dbba5b5373" Jul 01 16:18:43.094204 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:43.094172 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"202f3dc78cfe139df1a3b905f107f2683a59f00a6f26803f5b48a2dbba5b5373"} err="failed to get container status \"202f3dc78cfe139df1a3b905f107f2683a59f00a6f26803f5b48a2dbba5b5373\": rpc error: code = NotFound desc = could not find container \"202f3dc78cfe139df1a3b905f107f2683a59f00a6f26803f5b48a2dbba5b5373\": container with ID starting with 202f3dc78cfe139df1a3b905f107f2683a59f00a6f26803f5b48a2dbba5b5373 not found: ID does not exist" Jul 01 16:18:43.105355 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:43.105333 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-85hss"] Jul 01 16:18:43.109199 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:43.109179 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-85hss"] Jul 01 16:18:43.802618 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:43.802584 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e18407f2-2ea1-4f57-8f8c-9450be2138b0" path="/var/lib/kubelet/pods/e18407f2-2ea1-4f57-8f8c-9450be2138b0/volumes" Jul 01 16:18:49.048558 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:49.048520 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bvvmx"] Jul 01 16:18:49.049105 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:49.048874 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" podUID="59c33402-d2cf-4ab7-9260-535c26b77897" containerName="limitador" containerID="cri-o://5c1a5fe9660d17b98f2bc32c5f973158aac20d11f661308df29665132d64fc7c" gracePeriod=30 Jul 01 16:18:49.049733 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:49.049714 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" Jul 01 16:18:49.596050 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:49.596025 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" Jul 01 16:18:49.683421 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:49.683400 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75m4w\" (UniqueName: \"kubernetes.io/projected/59c33402-d2cf-4ab7-9260-535c26b77897-kube-api-access-75m4w\") pod \"59c33402-d2cf-4ab7-9260-535c26b77897\" (UID: \"59c33402-d2cf-4ab7-9260-535c26b77897\") " Jul 01 16:18:49.683580 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:49.683433 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59c33402-d2cf-4ab7-9260-535c26b77897-config-file\") pod \"59c33402-d2cf-4ab7-9260-535c26b77897\" (UID: \"59c33402-d2cf-4ab7-9260-535c26b77897\") " Jul 01 16:18:49.683869 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:49.683842 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59c33402-d2cf-4ab7-9260-535c26b77897-config-file" (OuterVolumeSpecName: "config-file") pod "59c33402-d2cf-4ab7-9260-535c26b77897" (UID: "59c33402-d2cf-4ab7-9260-535c26b77897"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:18:49.685347 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:49.685325 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59c33402-d2cf-4ab7-9260-535c26b77897-kube-api-access-75m4w" (OuterVolumeSpecName: "kube-api-access-75m4w") pod "59c33402-d2cf-4ab7-9260-535c26b77897" (UID: "59c33402-d2cf-4ab7-9260-535c26b77897"). InnerVolumeSpecName "kube-api-access-75m4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:18:49.784258 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:49.784217 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75m4w\" (UniqueName: \"kubernetes.io/projected/59c33402-d2cf-4ab7-9260-535c26b77897-kube-api-access-75m4w\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:18:49.784258 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:49.784254 2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59c33402-d2cf-4ab7-9260-535c26b77897-config-file\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:18:50.125647 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:50.125606 2577 generic.go:356] "Generic (PLEG): container finished" podID="59c33402-d2cf-4ab7-9260-535c26b77897" containerID="5c1a5fe9660d17b98f2bc32c5f973158aac20d11f661308df29665132d64fc7c" exitCode=0 Jul 01 16:18:50.126038 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:50.125683 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" event={"ID":"59c33402-d2cf-4ab7-9260-535c26b77897","Type":"ContainerDied","Data":"5c1a5fe9660d17b98f2bc32c5f973158aac20d11f661308df29665132d64fc7c"} Jul 01 16:18:50.126038 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:50.125705 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" Jul 01 16:18:50.126038 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:50.125731 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bvvmx" event={"ID":"59c33402-d2cf-4ab7-9260-535c26b77897","Type":"ContainerDied","Data":"f5eec4a0cae54257e690eb1defdd578c450e5c34efedbc30760672a20083023f"} Jul 01 16:18:50.126038 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:50.125751 2577 scope.go:117] "RemoveContainer" containerID="5c1a5fe9660d17b98f2bc32c5f973158aac20d11f661308df29665132d64fc7c" Jul 01 16:18:50.134252 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:50.134233 2577 scope.go:117] "RemoveContainer" containerID="5c1a5fe9660d17b98f2bc32c5f973158aac20d11f661308df29665132d64fc7c" Jul 01 16:18:50.134494 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:18:50.134475 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c1a5fe9660d17b98f2bc32c5f973158aac20d11f661308df29665132d64fc7c\": container with ID starting with 5c1a5fe9660d17b98f2bc32c5f973158aac20d11f661308df29665132d64fc7c not found: ID does not exist" containerID="5c1a5fe9660d17b98f2bc32c5f973158aac20d11f661308df29665132d64fc7c" Jul 01 16:18:50.134559 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:50.134508 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1a5fe9660d17b98f2bc32c5f973158aac20d11f661308df29665132d64fc7c"} err="failed to get container status \"5c1a5fe9660d17b98f2bc32c5f973158aac20d11f661308df29665132d64fc7c\": rpc error: code = NotFound desc = could not find container \"5c1a5fe9660d17b98f2bc32c5f973158aac20d11f661308df29665132d64fc7c\": container with ID starting with 5c1a5fe9660d17b98f2bc32c5f973158aac20d11f661308df29665132d64fc7c not found: ID does not exist" Jul 01 16:18:50.140174 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:50.140152 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bvvmx"] Jul 01 16:18:50.144323 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:50.144303 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bvvmx"] Jul 01 16:18:51.406733 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.406703 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:51.508831 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.508797 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:51.804118 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.804042 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59c33402-d2cf-4ab7-9260-535c26b77897" path="/var/lib/kubelet/pods/59c33402-d2cf-4ab7-9260-535c26b77897/volumes" Jul 01 16:18:51.817852 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.817823 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz"] Jul 01 16:18:51.818219 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.818201 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59c33402-d2cf-4ab7-9260-535c26b77897" containerName="limitador" Jul 01 16:18:51.818288 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.818222 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="59c33402-d2cf-4ab7-9260-535c26b77897" containerName="limitador" Jul 01 16:18:51.818288 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.818253 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18407f2-2ea1-4f57-8f8c-9450be2138b0" containerName="authorino" Jul 01 16:18:51.818288 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.818262 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18407f2-2ea1-4f57-8f8c-9450be2138b0" containerName="authorino" Jul 01 16:18:51.818379 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.818354 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e18407f2-2ea1-4f57-8f8c-9450be2138b0" containerName="authorino" Jul 01 16:18:51.818379 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.818366 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="59c33402-d2cf-4ab7-9260-535c26b77897" containerName="limitador" Jul 01 16:18:51.821794 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.821775 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz" Jul 01 16:18:51.824162 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.824141 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7ls7s\"" Jul 01 16:18:51.824276 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.824214 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 01 16:18:51.824822 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.824804 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 01 16:18:51.825365 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.825349 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 01 16:18:51.831556 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.831537 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz"] Jul 01 16:18:51.848513 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.848483 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:18:51.902323 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.902296 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2frx\" (UniqueName: \"kubernetes.io/projected/7c3886e9-d421-4c07-8913-e0c05a6843dd-kube-api-access-c2frx\") pod \"postgres-69fb4594cf-fk2xz\" (UID: \"7c3886e9-d421-4c07-8913-e0c05a6843dd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz" Jul 01 16:18:51.902438 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:51.902349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c3886e9-d421-4c07-8913-e0c05a6843dd-data\") pod \"postgres-69fb4594cf-fk2xz\" (UID: \"7c3886e9-d421-4c07-8913-e0c05a6843dd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz" Jul 01 16:18:52.003683 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:52.003654 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c3886e9-d421-4c07-8913-e0c05a6843dd-data\") pod \"postgres-69fb4594cf-fk2xz\" (UID: \"7c3886e9-d421-4c07-8913-e0c05a6843dd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz" Jul 01 16:18:52.003832 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:52.003741 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2frx\" (UniqueName: \"kubernetes.io/projected/7c3886e9-d421-4c07-8913-e0c05a6843dd-kube-api-access-c2frx\") pod \"postgres-69fb4594cf-fk2xz\" (UID: \"7c3886e9-d421-4c07-8913-e0c05a6843dd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz" Jul 01 16:18:52.004071 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:52.004049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c3886e9-d421-4c07-8913-e0c05a6843dd-data\") pod \"postgres-69fb4594cf-fk2xz\" (UID: \"7c3886e9-d421-4c07-8913-e0c05a6843dd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz" Jul 01 16:18:52.013037 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:52.013011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2frx\" (UniqueName: \"kubernetes.io/projected/7c3886e9-d421-4c07-8913-e0c05a6843dd-kube-api-access-c2frx\") pod \"postgres-69fb4594cf-fk2xz\" (UID: \"7c3886e9-d421-4c07-8913-e0c05a6843dd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz" Jul 01 16:18:52.131889 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:52.131863 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz" Jul 01 16:18:52.261756 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:52.261691 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz"] Jul 01 16:18:53.143070 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:53.143038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz" event={"ID":"7c3886e9-d421-4c07-8913-e0c05a6843dd","Type":"ContainerStarted","Data":"00cabd9351244bb1ff3f80034d812c77348ba79850ab46e0687391d5f4d7e119"} Jul 01 16:18:55.155350 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:55.155317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz" event={"ID":"7c3886e9-d421-4c07-8913-e0c05a6843dd","Type":"ContainerStarted","Data":"aa29f7fa77017b8b40e59be097499d27320cebf68526955999984d38d72ccddc"} Jul 01 16:18:55.155746 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:55.155402 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz" Jul 01 16:18:55.174739 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:18:55.174686 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz" podStartSLOduration=1.9071996709999999 podStartE2EDuration="4.174669022s" totalImagesPullingTime="2.267469351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:18:55.1735312 +0000 UTC m=+589.853156479" watchObservedRunningTime="2026-07-01 16:18:55.174669022 +0000 UTC m=+589.854294293" Jul 01 16:19:01.188230 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:01.188205 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fk2xz" Jul 01 16:19:01.480396 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:01.480310 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:19:01.580893 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:01.580860 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:19:01.789152 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:01.789071 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:19:05.770484 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:05.770456 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvpld_21eb759a-7b1e-4ac1-aab1-00429b75021c/ovn-acl-logging/0.log" Jul 01 16:19:05.771848 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:05.771828 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvpld_21eb759a-7b1e-4ac1-aab1-00429b75021c/ovn-acl-logging/0.log" Jul 01 16:19:10.086729 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:10.086695 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-rwl7s"] Jul 01 16:19:10.097121 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:10.097095 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-rwl7s" Jul 01 16:19:10.099648 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:10.099612 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 16:19:10.099790 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:10.099668 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-2wwhs\"" Jul 01 16:19:10.099790 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:10.099710 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 16:19:10.101120 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:10.101100 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-rwl7s"] Jul 01 16:19:10.151734 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:10.151710 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sd6w\" (UniqueName: \"kubernetes.io/projected/a8b47375-1477-4917-a144-6040dcc8a02d-kube-api-access-5sd6w\") pod \"keycloak-operator-d8b9d7b4d-rwl7s\" (UID: \"a8b47375-1477-4917-a144-6040dcc8a02d\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-rwl7s" Jul 01 16:19:10.252215 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:10.252184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sd6w\" (UniqueName: \"kubernetes.io/projected/a8b47375-1477-4917-a144-6040dcc8a02d-kube-api-access-5sd6w\") pod \"keycloak-operator-d8b9d7b4d-rwl7s\" (UID: \"a8b47375-1477-4917-a144-6040dcc8a02d\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-rwl7s" Jul 01 16:19:10.264034 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:10.264003 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sd6w\" (UniqueName: \"kubernetes.io/projected/a8b47375-1477-4917-a144-6040dcc8a02d-kube-api-access-5sd6w\") pod \"keycloak-operator-d8b9d7b4d-rwl7s\" (UID: \"a8b47375-1477-4917-a144-6040dcc8a02d\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-rwl7s" Jul 01 16:19:10.409789 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:10.409758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-rwl7s" Jul 01 16:19:10.537440 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:10.537384 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-rwl7s"] Jul 01 16:19:10.543047 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:19:10.543023 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b47375_1477_4917_a144_6040dcc8a02d.slice/crio-67a7d43c2efff0dbbda0cbbd5c066dea4b8f21fdb670dc6d6372de4faa78f3eb WatchSource:0}: Error finding container 67a7d43c2efff0dbbda0cbbd5c066dea4b8f21fdb670dc6d6372de4faa78f3eb: Status 404 returned error can't find the container with id 67a7d43c2efff0dbbda0cbbd5c066dea4b8f21fdb670dc6d6372de4faa78f3eb Jul 01 16:19:11.224593 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:11.224561 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-rwl7s" event={"ID":"a8b47375-1477-4917-a144-6040dcc8a02d","Type":"ContainerStarted","Data":"67a7d43c2efff0dbbda0cbbd5c066dea4b8f21fdb670dc6d6372de4faa78f3eb"} Jul 01 16:19:17.258580 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:17.258538 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-rwl7s" event={"ID":"a8b47375-1477-4917-a144-6040dcc8a02d","Type":"ContainerStarted","Data":"d6d57ccac48b9133389cbb9da5c2ed0589629089919f2655a12b82e8fc56e656"} Jul 01 16:19:17.288764 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:17.288713 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-rwl7s" podStartSLOduration=1.322202285 podStartE2EDuration="7.288698601s" totalImagesPullingTime="5.966496316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:19:17.287370213 +0000 UTC m=+611.966995490" watchObservedRunningTime="2026-07-01 16:19:17.288698601 +0000 UTC m=+611.968323878" Jul 01 16:19:25.320189 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:25.320137 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:19:27.170511 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:27.170421 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:19:36.126032 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:36.126003 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:19:36.181298 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:36.181273 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:19:55.830066 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:55.830024 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:19:55.934076 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:55.934040 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:19:56.045720 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.045675 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xhnpm"] Jul 01 16:19:56.053997 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.053971 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xhnpm" Jul 01 16:19:56.061060 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.060725 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xhnpm"] Jul 01 16:19:56.131145 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.131110 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hssqg\" (UniqueName: \"kubernetes.io/projected/4f07bea6-968f-419b-8304-300e69265f2d-kube-api-access-hssqg\") pod \"authorino-5d4b67c446-xhnpm\" (UID: \"4f07bea6-968f-419b-8304-300e69265f2d\") " pod="kuadrant-system/authorino-5d4b67c446-xhnpm" Jul 01 16:19:56.231863 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.231831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hssqg\" (UniqueName: \"kubernetes.io/projected/4f07bea6-968f-419b-8304-300e69265f2d-kube-api-access-hssqg\") pod \"authorino-5d4b67c446-xhnpm\" (UID: \"4f07bea6-968f-419b-8304-300e69265f2d\") " pod="kuadrant-system/authorino-5d4b67c446-xhnpm" Jul 01 16:19:56.250417 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.250384 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hssqg\" (UniqueName: \"kubernetes.io/projected/4f07bea6-968f-419b-8304-300e69265f2d-kube-api-access-hssqg\") pod \"authorino-5d4b67c446-xhnpm\" (UID: \"4f07bea6-968f-419b-8304-300e69265f2d\") " pod="kuadrant-system/authorino-5d4b67c446-xhnpm" Jul 01 16:19:56.294601 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.294571 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xhnpm"] Jul 01 16:19:56.294824 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.294811 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xhnpm" Jul 01 16:19:56.332622 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.332590 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b44cfd77f-22tdb"] Jul 01 16:19:56.335752 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.335729 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b44cfd77f-22tdb" Jul 01 16:19:56.350467 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.350412 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b44cfd77f-22tdb"] Jul 01 16:19:56.433446 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.433342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wkch\" (UniqueName: \"kubernetes.io/projected/0ceb8014-82e7-45dd-a5e0-050fa7bbc776-kube-api-access-2wkch\") pod \"authorino-6b44cfd77f-22tdb\" (UID: \"0ceb8014-82e7-45dd-a5e0-050fa7bbc776\") " pod="kuadrant-system/authorino-6b44cfd77f-22tdb" Jul 01 16:19:56.434009 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.433990 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xhnpm"] Jul 01 16:19:56.436129 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:19:56.436103 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f07bea6_968f_419b_8304_300e69265f2d.slice/crio-02e9357285e24b80b62ff0ed045b0d2f0921f8eb1e087c9c71d3c44e89bfc208 WatchSource:0}: Error finding container 02e9357285e24b80b62ff0ed045b0d2f0921f8eb1e087c9c71d3c44e89bfc208: Status 404 returned error can't find the container with id 02e9357285e24b80b62ff0ed045b0d2f0921f8eb1e087c9c71d3c44e89bfc208 Jul 01 16:19:56.437269 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.437246 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:19:56.534332 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.534298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wkch\" (UniqueName: \"kubernetes.io/projected/0ceb8014-82e7-45dd-a5e0-050fa7bbc776-kube-api-access-2wkch\") pod \"authorino-6b44cfd77f-22tdb\" (UID: \"0ceb8014-82e7-45dd-a5e0-050fa7bbc776\") " pod="kuadrant-system/authorino-6b44cfd77f-22tdb" Jul 01 16:19:56.539523 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.539497 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b44cfd77f-22tdb"] Jul 01 16:19:56.539751 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:19:56.539732 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2wkch], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6b44cfd77f-22tdb" podUID="0ceb8014-82e7-45dd-a5e0-050fa7bbc776" Jul 01 16:19:56.544060 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.544033 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wkch\" (UniqueName: \"kubernetes.io/projected/0ceb8014-82e7-45dd-a5e0-050fa7bbc776-kube-api-access-2wkch\") pod \"authorino-6b44cfd77f-22tdb\" (UID: \"0ceb8014-82e7-45dd-a5e0-050fa7bbc776\") " pod="kuadrant-system/authorino-6b44cfd77f-22tdb" Jul 01 16:19:56.581001 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.580977 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f57bc7d79-x4zqb"] Jul 01 16:19:56.584357 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.584342 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f57bc7d79-x4zqb" Jul 01 16:19:56.586558 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.586541 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 01 16:19:56.593246 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.593224 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f57bc7d79-x4zqb"] Jul 01 16:19:56.736142 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.736070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ec34032-4e50-4e53-a6c2-eb9ea19e25b4-tls-cert\") pod \"authorino-f57bc7d79-x4zqb\" (UID: \"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4\") " pod="kuadrant-system/authorino-f57bc7d79-x4zqb" Jul 01 16:19:56.736142 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.736106 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvvjk\" (UniqueName: \"kubernetes.io/projected/6ec34032-4e50-4e53-a6c2-eb9ea19e25b4-kube-api-access-hvvjk\") pod \"authorino-f57bc7d79-x4zqb\" (UID: \"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4\") " pod="kuadrant-system/authorino-f57bc7d79-x4zqb" Jul 01 16:19:56.837252 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.837227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ec34032-4e50-4e53-a6c2-eb9ea19e25b4-tls-cert\") pod \"authorino-f57bc7d79-x4zqb\" (UID: \"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4\") " pod="kuadrant-system/authorino-f57bc7d79-x4zqb" Jul 01 16:19:56.837612 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.837257 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvvjk\" (UniqueName: \"kubernetes.io/projected/6ec34032-4e50-4e53-a6c2-eb9ea19e25b4-kube-api-access-hvvjk\") pod \"authorino-f57bc7d79-x4zqb\" (UID: \"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4\") " pod="kuadrant-system/authorino-f57bc7d79-x4zqb" Jul 01 16:19:56.839614 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.839593 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ec34032-4e50-4e53-a6c2-eb9ea19e25b4-tls-cert\") pod \"authorino-f57bc7d79-x4zqb\" (UID: \"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4\") " pod="kuadrant-system/authorino-f57bc7d79-x4zqb" Jul 01 16:19:56.845483 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.845462 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvvjk\" (UniqueName: \"kubernetes.io/projected/6ec34032-4e50-4e53-a6c2-eb9ea19e25b4-kube-api-access-hvvjk\") pod \"authorino-f57bc7d79-x4zqb\" (UID: \"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4\") " pod="kuadrant-system/authorino-f57bc7d79-x4zqb" Jul 01 16:19:56.894464 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:56.894438 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f57bc7d79-x4zqb" Jul 01 16:19:57.042143 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.042120 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f57bc7d79-x4zqb"] Jul 01 16:19:57.044548 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:19:57.044527 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ec34032_4e50_4e53_a6c2_eb9ea19e25b4.slice/crio-d8668cb0e45cd58d85137ee8ddeadb7ea2cecd4b317ae7c42bf205567fcdec54 WatchSource:0}: Error finding container d8668cb0e45cd58d85137ee8ddeadb7ea2cecd4b317ae7c42bf205567fcdec54: Status 404 returned error can't find the container with id d8668cb0e45cd58d85137ee8ddeadb7ea2cecd4b317ae7c42bf205567fcdec54 Jul 01 16:19:57.434560 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.434523 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xhnpm" event={"ID":"4f07bea6-968f-419b-8304-300e69265f2d","Type":"ContainerStarted","Data":"ff136881e1390d18bf0be14565ded71399d31a273c77e7f48dba0c9463b1ec97"} Jul 01 16:19:57.434767 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.434551 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-xhnpm" podUID="4f07bea6-968f-419b-8304-300e69265f2d" containerName="authorino" containerID="cri-o://ff136881e1390d18bf0be14565ded71399d31a273c77e7f48dba0c9463b1ec97" gracePeriod=30 Jul 01 16:19:57.434767 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.434569 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xhnpm" event={"ID":"4f07bea6-968f-419b-8304-300e69265f2d","Type":"ContainerStarted","Data":"02e9357285e24b80b62ff0ed045b0d2f0921f8eb1e087c9c71d3c44e89bfc208"} Jul 01 16:19:57.435866 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.435846 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b44cfd77f-22tdb" Jul 01 16:19:57.435966 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.435860 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f57bc7d79-x4zqb" event={"ID":"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4","Type":"ContainerStarted","Data":"d8668cb0e45cd58d85137ee8ddeadb7ea2cecd4b317ae7c42bf205567fcdec54"} Jul 01 16:19:57.442804 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.442785 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b44cfd77f-22tdb" Jul 01 16:19:57.452614 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.452519 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-xhnpm" podStartSLOduration=0.745964547 podStartE2EDuration="1.452502569s" totalImagesPullingTime="706.538022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:19:57.452168158 +0000 UTC m=+652.131793435" watchObservedRunningTime="2026-07-01 16:19:57.452502569 +0000 UTC m=+652.132127848" Jul 01 16:19:57.542379 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.542347 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wkch\" (UniqueName: \"kubernetes.io/projected/0ceb8014-82e7-45dd-a5e0-050fa7bbc776-kube-api-access-2wkch\") pod \"0ceb8014-82e7-45dd-a5e0-050fa7bbc776\" (UID: \"0ceb8014-82e7-45dd-a5e0-050fa7bbc776\") " Jul 01 16:19:57.544291 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.544266 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ceb8014-82e7-45dd-a5e0-050fa7bbc776-kube-api-access-2wkch" (OuterVolumeSpecName: "kube-api-access-2wkch") pod "0ceb8014-82e7-45dd-a5e0-050fa7bbc776" (UID: "0ceb8014-82e7-45dd-a5e0-050fa7bbc776"). InnerVolumeSpecName "kube-api-access-2wkch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:19:57.643779 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.643752 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wkch\" (UniqueName: \"kubernetes.io/projected/0ceb8014-82e7-45dd-a5e0-050fa7bbc776-kube-api-access-2wkch\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:19:57.668373 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.668346 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xhnpm" Jul 01 16:19:57.845855 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.845830 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hssqg\" (UniqueName: \"kubernetes.io/projected/4f07bea6-968f-419b-8304-300e69265f2d-kube-api-access-hssqg\") pod \"4f07bea6-968f-419b-8304-300e69265f2d\" (UID: \"4f07bea6-968f-419b-8304-300e69265f2d\") " Jul 01 16:19:57.847865 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.847841 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f07bea6-968f-419b-8304-300e69265f2d-kube-api-access-hssqg" (OuterVolumeSpecName: "kube-api-access-hssqg") pod "4f07bea6-968f-419b-8304-300e69265f2d" (UID: "4f07bea6-968f-419b-8304-300e69265f2d"). InnerVolumeSpecName "kube-api-access-hssqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:19:57.946625 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:57.946597 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hssqg\" (UniqueName: \"kubernetes.io/projected/4f07bea6-968f-419b-8304-300e69265f2d-kube-api-access-hssqg\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:19:58.441932 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.441903 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f57bc7d79-x4zqb" event={"ID":"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4","Type":"ContainerStarted","Data":"3548825e06e8eb3aa8cbc8b68932b104105b3810d4f0c7d5fe8d2fdc3c686bd1"} Jul 01 16:19:58.443134 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.443112 2577 generic.go:356] "Generic (PLEG): container finished" podID="4f07bea6-968f-419b-8304-300e69265f2d" containerID="ff136881e1390d18bf0be14565ded71399d31a273c77e7f48dba0c9463b1ec97" exitCode=0 Jul 01 16:19:58.443240 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.443145 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xhnpm" Jul 01 16:19:58.443240 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.443163 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b44cfd77f-22tdb" Jul 01 16:19:58.443240 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.443192 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xhnpm" event={"ID":"4f07bea6-968f-419b-8304-300e69265f2d","Type":"ContainerDied","Data":"ff136881e1390d18bf0be14565ded71399d31a273c77e7f48dba0c9463b1ec97"} Jul 01 16:19:58.443240 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.443223 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xhnpm" event={"ID":"4f07bea6-968f-419b-8304-300e69265f2d","Type":"ContainerDied","Data":"02e9357285e24b80b62ff0ed045b0d2f0921f8eb1e087c9c71d3c44e89bfc208"} Jul 01 16:19:58.443240 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.443239 2577 scope.go:117] "RemoveContainer" containerID="ff136881e1390d18bf0be14565ded71399d31a273c77e7f48dba0c9463b1ec97" Jul 01 16:19:58.452063 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.452045 2577 scope.go:117] "RemoveContainer" containerID="ff136881e1390d18bf0be14565ded71399d31a273c77e7f48dba0c9463b1ec97" Jul 01 16:19:58.452309 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:19:58.452292 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff136881e1390d18bf0be14565ded71399d31a273c77e7f48dba0c9463b1ec97\": container with ID starting with ff136881e1390d18bf0be14565ded71399d31a273c77e7f48dba0c9463b1ec97 not found: ID does not exist" containerID="ff136881e1390d18bf0be14565ded71399d31a273c77e7f48dba0c9463b1ec97" Jul 01 16:19:58.452362 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.452317 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff136881e1390d18bf0be14565ded71399d31a273c77e7f48dba0c9463b1ec97"} err="failed to get container status \"ff136881e1390d18bf0be14565ded71399d31a273c77e7f48dba0c9463b1ec97\": rpc error: code = NotFound desc = could not find container \"ff136881e1390d18bf0be14565ded71399d31a273c77e7f48dba0c9463b1ec97\": container with ID starting with ff136881e1390d18bf0be14565ded71399d31a273c77e7f48dba0c9463b1ec97 not found: ID does not exist" Jul 01 16:19:58.458333 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.458295 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f57bc7d79-x4zqb" podStartSLOduration=1.954996275 podStartE2EDuration="2.458281469s" totalImagesPullingTime="503.285194ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:19:58.456547316 +0000 UTC m=+653.136172592" watchObservedRunningTime="2026-07-01 16:19:58.458281469 +0000 UTC m=+653.137906746" Jul 01 16:19:58.473570 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.473547 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xhnpm"] Jul 01 16:19:58.476269 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.476247 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xhnpm"] Jul 01 16:19:58.486466 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.486443 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ncxw7"] Jul 01 16:19:58.486655 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.486616 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-ncxw7" podUID="65361b0c-8002-409b-8132-91270f9299dd" containerName="authorino" containerID="cri-o://97e258297570100636b866d9db22c432bc211a04f6250d4aff046c1ce32481be" gracePeriod=30 Jul 01 16:19:58.507706 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.506519 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b44cfd77f-22tdb"] Jul 01 16:19:58.527651 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.524846 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6b44cfd77f-22tdb"] Jul 01 16:19:58.732529 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.732505 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ncxw7" Jul 01 16:19:58.851622 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.851551 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft58g\" (UniqueName: \"kubernetes.io/projected/65361b0c-8002-409b-8132-91270f9299dd-kube-api-access-ft58g\") pod \"65361b0c-8002-409b-8132-91270f9299dd\" (UID: \"65361b0c-8002-409b-8132-91270f9299dd\") " Jul 01 16:19:58.853516 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.853486 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65361b0c-8002-409b-8132-91270f9299dd-kube-api-access-ft58g" (OuterVolumeSpecName: "kube-api-access-ft58g") pod "65361b0c-8002-409b-8132-91270f9299dd" (UID: "65361b0c-8002-409b-8132-91270f9299dd"). InnerVolumeSpecName "kube-api-access-ft58g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:19:58.953073 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:58.953044 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft58g\" (UniqueName: \"kubernetes.io/projected/65361b0c-8002-409b-8132-91270f9299dd-kube-api-access-ft58g\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:19:59.449958 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:59.449926 2577 generic.go:356] "Generic (PLEG): container finished" podID="65361b0c-8002-409b-8132-91270f9299dd" containerID="97e258297570100636b866d9db22c432bc211a04f6250d4aff046c1ce32481be" exitCode=0 Jul 01 16:19:59.450142 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:59.449966 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ncxw7" Jul 01 16:19:59.450142 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:59.450008 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ncxw7" event={"ID":"65361b0c-8002-409b-8132-91270f9299dd","Type":"ContainerDied","Data":"97e258297570100636b866d9db22c432bc211a04f6250d4aff046c1ce32481be"} Jul 01 16:19:59.450142 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:59.450044 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ncxw7" event={"ID":"65361b0c-8002-409b-8132-91270f9299dd","Type":"ContainerDied","Data":"327e433497b21db5240bcafcbfa94eb769045f5c769f650db2ee1bcf345fc184"} Jul 01 16:19:59.450142 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:59.450060 2577 scope.go:117] "RemoveContainer" containerID="97e258297570100636b866d9db22c432bc211a04f6250d4aff046c1ce32481be" Jul 01 16:19:59.465001 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:59.464983 2577 scope.go:117] "RemoveContainer" containerID="97e258297570100636b866d9db22c432bc211a04f6250d4aff046c1ce32481be" Jul 01 16:19:59.465296 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:19:59.465275 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97e258297570100636b866d9db22c432bc211a04f6250d4aff046c1ce32481be\": container with ID starting with 97e258297570100636b866d9db22c432bc211a04f6250d4aff046c1ce32481be not found: ID does not exist" containerID="97e258297570100636b866d9db22c432bc211a04f6250d4aff046c1ce32481be" Jul 01 16:19:59.465383 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:59.465305 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97e258297570100636b866d9db22c432bc211a04f6250d4aff046c1ce32481be"} err="failed to get container status \"97e258297570100636b866d9db22c432bc211a04f6250d4aff046c1ce32481be\": rpc error: code = NotFound desc = could not find container \"97e258297570100636b866d9db22c432bc211a04f6250d4aff046c1ce32481be\": container with ID starting with 97e258297570100636b866d9db22c432bc211a04f6250d4aff046c1ce32481be not found: ID does not exist" Jul 01 16:19:59.482775 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:59.482751 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ncxw7"] Jul 01 16:19:59.495608 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:59.495585 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ncxw7"] Jul 01 16:19:59.802907 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:59.802819 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ceb8014-82e7-45dd-a5e0-050fa7bbc776" path="/var/lib/kubelet/pods/0ceb8014-82e7-45dd-a5e0-050fa7bbc776/volumes" Jul 01 16:19:59.803061 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:59.803049 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f07bea6-968f-419b-8304-300e69265f2d" path="/var/lib/kubelet/pods/4f07bea6-968f-419b-8304-300e69265f2d/volumes" Jul 01 16:19:59.803340 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:19:59.803328 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65361b0c-8002-409b-8132-91270f9299dd" path="/var/lib/kubelet/pods/65361b0c-8002-409b-8132-91270f9299dd/volumes" Jul 01 16:20:02.756122 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:02.756084 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:20:02.825011 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:02.824982 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:20:02.925797 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:02.925764 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:20:03.187435 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:03.187404 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:20:06.662933 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:06.662900 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:20:06.777312 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:06.777270 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:20:38.144980 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:38.144945 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:20:38.692259 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:38.692226 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:20:39.198434 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:39.198397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:20:39.298978 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:39.298949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:20:39.397257 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:39.397230 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:20:47.665963 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:47.665927 2577 generic.go:356] "Generic (PLEG): container finished" podID="27f33efb-55f1-4440-b577-1639fd054ea5" containerID="18337841253cf8a4db340eba71b70adb8be1edbc2584370386aeb8c7a3bddb67" exitCode=0 Jul 01 16:20:47.665963 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:47.665964 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" event={"ID":"27f33efb-55f1-4440-b577-1639fd054ea5","Type":"ContainerDied","Data":"18337841253cf8a4db340eba71b70adb8be1edbc2584370386aeb8c7a3bddb67"} Jul 01 16:20:47.666409 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:47.666313 2577 scope.go:117] "RemoveContainer" containerID="18337841253cf8a4db340eba71b70adb8be1edbc2584370386aeb8c7a3bddb67" Jul 01 16:20:47.667375 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:47.667343 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 16:20:47.667656 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:47.667427 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 16:20:47.667656 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:47.667474 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 01 16:20:48.672739 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:48.672704 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" event={"ID":"27f33efb-55f1-4440-b577-1639fd054ea5","Type":"ContainerStarted","Data":"343013be357302ecb5a9d8046f6ceb66a5bc70dca0210585163df54b54017d80"} Jul 01 16:20:49.545799 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:49.545766 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:20:49.547307 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:49.547275 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-krgt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 01 16:20:49.547896 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:49.547522 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" podUID="27f33efb-55f1-4440-b577-1639fd054ea5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 01 16:20:49.957956 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:49.957918 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:20:50.546192 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:50.546144 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-krgt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 01 16:20:50.546400 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:50.546217 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" podUID="27f33efb-55f1-4440-b577-1639fd054ea5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 01 16:20:51.546149 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:51.546099 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-krgt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 01 16:20:51.546660 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:51.546171 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" podUID="27f33efb-55f1-4440-b577-1639fd054ea5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 01 16:20:52.551860 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:52.551826 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:20:52.553321 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:20:52.553287 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-krgt9" Jul 01 16:21:15.775372 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:15.775300 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:21:15.876316 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:15.876283 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:21:29.135723 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.135686 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f58566ddc-rdp8s"] Jul 01 16:21:29.136198 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.136167 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65361b0c-8002-409b-8132-91270f9299dd" containerName="authorino" Jul 01 16:21:29.136198 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.136186 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="65361b0c-8002-409b-8132-91270f9299dd" containerName="authorino" Jul 01 16:21:29.136317 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.136217 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f07bea6-968f-419b-8304-300e69265f2d" containerName="authorino" Jul 01 16:21:29.136317 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.136226 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f07bea6-968f-419b-8304-300e69265f2d" containerName="authorino" Jul 01 16:21:29.136412 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.136324 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="65361b0c-8002-409b-8132-91270f9299dd" containerName="authorino" Jul 01 16:21:29.136412 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.136339 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f07bea6-968f-419b-8304-300e69265f2d" containerName="authorino" Jul 01 16:21:29.138387 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.138366 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58566ddc-rdp8s" Jul 01 16:21:29.141762 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.141744 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 01 16:21:29.148164 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.148143 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f58566ddc-rdp8s"] Jul 01 16:21:29.178998 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.178971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkc2k\" (UniqueName: \"kubernetes.io/projected/4b9981f9-b3be-4205-807d-5bf6ae88efb2-kube-api-access-hkc2k\") pod \"authorino-5f58566ddc-rdp8s\" (UID: \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\") " pod="kuadrant-system/authorino-5f58566ddc-rdp8s" Jul 01 16:21:29.179098 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.179011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9981f9-b3be-4205-807d-5bf6ae88efb2-tls-cert\") pod \"authorino-5f58566ddc-rdp8s\" (UID: \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\") " pod="kuadrant-system/authorino-5f58566ddc-rdp8s" Jul 01 16:21:29.179098 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.179049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4b9981f9-b3be-4205-807d-5bf6ae88efb2-oidc-ca\") pod \"authorino-5f58566ddc-rdp8s\" (UID: \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\") " pod="kuadrant-system/authorino-5f58566ddc-rdp8s" Jul 01 16:21:29.279701 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.279672 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4b9981f9-b3be-4205-807d-5bf6ae88efb2-oidc-ca\") pod \"authorino-5f58566ddc-rdp8s\" (UID: \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\") " pod="kuadrant-system/authorino-5f58566ddc-rdp8s" Jul 01 16:21:29.279815 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.279727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkc2k\" (UniqueName: \"kubernetes.io/projected/4b9981f9-b3be-4205-807d-5bf6ae88efb2-kube-api-access-hkc2k\") pod \"authorino-5f58566ddc-rdp8s\" (UID: \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\") " pod="kuadrant-system/authorino-5f58566ddc-rdp8s" Jul 01 16:21:29.279815 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.279760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9981f9-b3be-4205-807d-5bf6ae88efb2-tls-cert\") pod \"authorino-5f58566ddc-rdp8s\" (UID: \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\") " pod="kuadrant-system/authorino-5f58566ddc-rdp8s" Jul 01 16:21:29.280288 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.280265 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4b9981f9-b3be-4205-807d-5bf6ae88efb2-oidc-ca\") pod \"authorino-5f58566ddc-rdp8s\" (UID: \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\") " pod="kuadrant-system/authorino-5f58566ddc-rdp8s" Jul 01 16:21:29.282056 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.282025 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9981f9-b3be-4205-807d-5bf6ae88efb2-tls-cert\") pod \"authorino-5f58566ddc-rdp8s\" (UID: \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\") " pod="kuadrant-system/authorino-5f58566ddc-rdp8s" Jul 01 16:21:29.287718 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.287696 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkc2k\" (UniqueName: \"kubernetes.io/projected/4b9981f9-b3be-4205-807d-5bf6ae88efb2-kube-api-access-hkc2k\") pod \"authorino-5f58566ddc-rdp8s\" (UID: \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\") " pod="kuadrant-system/authorino-5f58566ddc-rdp8s" Jul 01 16:21:29.447595 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.447517 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58566ddc-rdp8s" Jul 01 16:21:29.583780 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.583742 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f58566ddc-rdp8s"] Jul 01 16:21:29.587373 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:21:29.587349 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b9981f9_b3be_4205_807d_5bf6ae88efb2.slice/crio-800a899512a09f185bf23e4a83e4c72943669c9c12705fd0b99e475370337ecc WatchSource:0}: Error finding container 800a899512a09f185bf23e4a83e4c72943669c9c12705fd0b99e475370337ecc: Status 404 returned error can't find the container with id 800a899512a09f185bf23e4a83e4c72943669c9c12705fd0b99e475370337ecc Jul 01 16:21:29.855227 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:29.855146 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f58566ddc-rdp8s" event={"ID":"4b9981f9-b3be-4205-807d-5bf6ae88efb2","Type":"ContainerStarted","Data":"800a899512a09f185bf23e4a83e4c72943669c9c12705fd0b99e475370337ecc"} Jul 01 16:21:30.867175 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:30.867133 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f58566ddc-rdp8s" event={"ID":"4b9981f9-b3be-4205-807d-5bf6ae88efb2","Type":"ContainerStarted","Data":"c9c26f81b333634fe7d0e60cca1050392baf04ecf898c05bc7ca284075731ef1"} Jul 01 16:21:30.884975 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:30.884933 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f58566ddc-rdp8s" podStartSLOduration=1.326091894 podStartE2EDuration="1.884917998s" totalImagesPullingTime="558.826104ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:21:30.883782664 +0000 UTC m=+745.563407941" watchObservedRunningTime="2026-07-01 16:21:30.884917998 +0000 UTC m=+745.564543274" Jul 01 16:21:30.927985 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:30.927956 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f57bc7d79-x4zqb"] Jul 01 16:21:30.928182 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:30.928151 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-f57bc7d79-x4zqb" podUID="6ec34032-4e50-4e53-a6c2-eb9ea19e25b4" containerName="authorino" containerID="cri-o://3548825e06e8eb3aa8cbc8b68932b104105b3810d4f0c7d5fe8d2fdc3c686bd1" gracePeriod=30 Jul 01 16:21:31.184567 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.184535 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f57bc7d79-x4zqb" Jul 01 16:21:31.296227 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.296180 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ec34032-4e50-4e53-a6c2-eb9ea19e25b4-tls-cert\") pod \"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4\" (UID: \"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4\") " Jul 01 16:21:31.296418 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.296275 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvvjk\" (UniqueName: \"kubernetes.io/projected/6ec34032-4e50-4e53-a6c2-eb9ea19e25b4-kube-api-access-hvvjk\") pod \"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4\" (UID: \"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4\") " Jul 01 16:21:31.298258 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.298229 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ec34032-4e50-4e53-a6c2-eb9ea19e25b4-kube-api-access-hvvjk" (OuterVolumeSpecName: "kube-api-access-hvvjk") pod "6ec34032-4e50-4e53-a6c2-eb9ea19e25b4" (UID: "6ec34032-4e50-4e53-a6c2-eb9ea19e25b4"). InnerVolumeSpecName "kube-api-access-hvvjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:21:31.307912 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.307877 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ec34032-4e50-4e53-a6c2-eb9ea19e25b4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6ec34032-4e50-4e53-a6c2-eb9ea19e25b4" (UID: "6ec34032-4e50-4e53-a6c2-eb9ea19e25b4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:21:31.397727 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.397695 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvvjk\" (UniqueName: \"kubernetes.io/projected/6ec34032-4e50-4e53-a6c2-eb9ea19e25b4-kube-api-access-hvvjk\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:21:31.397727 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.397720 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6ec34032-4e50-4e53-a6c2-eb9ea19e25b4-tls-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:21:31.635817 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.635784 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:21:31.795275 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.795242 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:21:31.873329 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.873288 2577 generic.go:356] "Generic (PLEG): container finished" podID="6ec34032-4e50-4e53-a6c2-eb9ea19e25b4" containerID="3548825e06e8eb3aa8cbc8b68932b104105b3810d4f0c7d5fe8d2fdc3c686bd1" exitCode=0 Jul 01 16:21:31.873742 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.873347 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f57bc7d79-x4zqb" Jul 01 16:21:31.873742 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.873351 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f57bc7d79-x4zqb" event={"ID":"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4","Type":"ContainerDied","Data":"3548825e06e8eb3aa8cbc8b68932b104105b3810d4f0c7d5fe8d2fdc3c686bd1"} Jul 01 16:21:31.873742 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.873399 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f57bc7d79-x4zqb" event={"ID":"6ec34032-4e50-4e53-a6c2-eb9ea19e25b4","Type":"ContainerDied","Data":"d8668cb0e45cd58d85137ee8ddeadb7ea2cecd4b317ae7c42bf205567fcdec54"} Jul 01 16:21:31.873742 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.873418 2577 scope.go:117] "RemoveContainer" containerID="3548825e06e8eb3aa8cbc8b68932b104105b3810d4f0c7d5fe8d2fdc3c686bd1" Jul 01 16:21:31.881661 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.881622 2577 scope.go:117] "RemoveContainer" containerID="3548825e06e8eb3aa8cbc8b68932b104105b3810d4f0c7d5fe8d2fdc3c686bd1" Jul 01 16:21:31.881915 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:21:31.881899 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3548825e06e8eb3aa8cbc8b68932b104105b3810d4f0c7d5fe8d2fdc3c686bd1\": container with ID starting with 3548825e06e8eb3aa8cbc8b68932b104105b3810d4f0c7d5fe8d2fdc3c686bd1 not found: ID does not exist" containerID="3548825e06e8eb3aa8cbc8b68932b104105b3810d4f0c7d5fe8d2fdc3c686bd1" Jul 01 16:21:31.881967 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.881925 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3548825e06e8eb3aa8cbc8b68932b104105b3810d4f0c7d5fe8d2fdc3c686bd1"} err="failed to get container status \"3548825e06e8eb3aa8cbc8b68932b104105b3810d4f0c7d5fe8d2fdc3c686bd1\": rpc error: code = NotFound desc = could not find container \"3548825e06e8eb3aa8cbc8b68932b104105b3810d4f0c7d5fe8d2fdc3c686bd1\": container with ID starting with 3548825e06e8eb3aa8cbc8b68932b104105b3810d4f0c7d5fe8d2fdc3c686bd1 not found: ID does not exist" Jul 01 16:21:31.911445 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.911388 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f57bc7d79-x4zqb"] Jul 01 16:21:31.932928 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:31.932901 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f57bc7d79-x4zqb"] Jul 01 16:21:33.803485 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:33.803452 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ec34032-4e50-4e53-a6c2-eb9ea19e25b4" path="/var/lib/kubelet/pods/6ec34032-4e50-4e53-a6c2-eb9ea19e25b4/volumes" Jul 01 16:21:40.487994 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:40.487960 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:21:50.030741 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:50.030709 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:21:51.824025 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:51.823984 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:21:51.925900 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:51.925855 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:21:53.241190 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:53.241147 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:21:58.702453 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.702425 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp"] Jul 01 16:21:58.702822 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.702810 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec34032-4e50-4e53-a6c2-eb9ea19e25b4" containerName="authorino" Jul 01 16:21:58.702866 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.702823 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec34032-4e50-4e53-a6c2-eb9ea19e25b4" containerName="authorino" Jul 01 16:21:58.702899 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.702894 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec34032-4e50-4e53-a6c2-eb9ea19e25b4" containerName="authorino" Jul 01 16:21:58.706114 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.706094 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.709774 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.709749 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 16:21:58.710582 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.710562 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 16:21:58.710704 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.710564 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 01 16:21:58.710704 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.710593 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jwztp\"" Jul 01 16:21:58.720175 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.720151 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp"] Jul 01 16:21:58.748752 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.748718 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:21:58.828344 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.828312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.828506 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.828401 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.828506 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.828419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.828506 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.828440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.828679 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.828499 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-479fk\" (UniqueName: \"kubernetes.io/projected/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-kube-api-access-479fk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.929491 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.929453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.929689 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.929500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.929689 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.929533 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.929689 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.929560 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-479fk\" (UniqueName: \"kubernetes.io/projected/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-kube-api-access-479fk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.929689 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.929663 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.930039 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.930008 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.930151 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.930013 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.931841 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.931811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.932127 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.932111 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:58.939697 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:58.939674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-479fk\" (UniqueName: \"kubernetes.io/projected/55e2b993-e058-4747-b9ac-e4b5e81dd9ed-kube-api-access-479fk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp\" (UID: \"55e2b993-e058-4747-b9ac-e4b5e81dd9ed\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:59.015804 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:59.015725 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:21:59.148038 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:21:59.148008 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp"] Jul 01 16:21:59.151335 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:21:59.151207 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e2b993_e058_4747_b9ac_e4b5e81dd9ed.slice/crio-9607e63fa64dc167ca6341c48f02fabaf03e420d52e4d1b0f2c5fc8d44c12a7a WatchSource:0}: Error finding container 9607e63fa64dc167ca6341c48f02fabaf03e420d52e4d1b0f2c5fc8d44c12a7a: Status 404 returned error can't find the container with id 9607e63fa64dc167ca6341c48f02fabaf03e420d52e4d1b0f2c5fc8d44c12a7a Jul 01 16:22:00.010942 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:00.010903 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" event={"ID":"55e2b993-e058-4747-b9ac-e4b5e81dd9ed","Type":"ContainerStarted","Data":"9607e63fa64dc167ca6341c48f02fabaf03e420d52e4d1b0f2c5fc8d44c12a7a"} Jul 01 16:22:01.017519 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:01.017488 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" event={"ID":"55e2b993-e058-4747-b9ac-e4b5e81dd9ed","Type":"ContainerStarted","Data":"df3ce5e4bcf79c4f5ea9b66e530e1bf814a2550db903ce64c5f443ddf8a1bb26"} Jul 01 16:22:01.036265 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:01.036211 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" podStartSLOduration=1.931978738 podStartE2EDuration="3.036196212s" totalImagesPullingTime="1.104217474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:22:01.034683528 +0000 UTC m=+775.714308804" watchObservedRunningTime="2026-07-01 16:22:01.036196212 +0000 UTC m=+775.715821489" Jul 01 16:22:09.016843 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:09.016806 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:22:09.017292 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:09.016881 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:22:09.029874 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:09.029848 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:22:09.065281 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:09.065257 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp" Jul 01 16:22:10.957865 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:10.957815 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:22:19.499612 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.499580 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5"] Jul 01 16:22:19.502825 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.502804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.505151 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.505129 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 01 16:22:19.517647 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.517606 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5"] Jul 01 16:22:19.598491 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.598462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds8hl\" (UniqueName: \"kubernetes.io/projected/704a94f7-3001-4fc6-9838-4a2cb03a928b-kube-api-access-ds8hl\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.598681 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.598513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/704a94f7-3001-4fc6-9838-4a2cb03a928b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.598681 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.598533 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/704a94f7-3001-4fc6-9838-4a2cb03a928b-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.598681 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.598592 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/704a94f7-3001-4fc6-9838-4a2cb03a928b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.598681 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.598653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/704a94f7-3001-4fc6-9838-4a2cb03a928b-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.699292 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.699255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds8hl\" (UniqueName: \"kubernetes.io/projected/704a94f7-3001-4fc6-9838-4a2cb03a928b-kube-api-access-ds8hl\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.699487 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.699310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/704a94f7-3001-4fc6-9838-4a2cb03a928b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.699487 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.699329 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/704a94f7-3001-4fc6-9838-4a2cb03a928b-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.699487 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.699359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/704a94f7-3001-4fc6-9838-4a2cb03a928b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.699487 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.699388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/704a94f7-3001-4fc6-9838-4a2cb03a928b-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.699812 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.699785 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/704a94f7-3001-4fc6-9838-4a2cb03a928b-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.699929 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.699820 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/704a94f7-3001-4fc6-9838-4a2cb03a928b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.701792 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.701761 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/704a94f7-3001-4fc6-9838-4a2cb03a928b-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.701888 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.701822 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/704a94f7-3001-4fc6-9838-4a2cb03a928b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.710078 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.710051 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds8hl\" (UniqueName: \"kubernetes.io/projected/704a94f7-3001-4fc6-9838-4a2cb03a928b-kube-api-access-ds8hl\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5\" (UID: \"704a94f7-3001-4fc6-9838-4a2cb03a928b\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.812589 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.812514 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:19.948668 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.948625 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5"] Jul 01 16:22:19.951203 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:22:19.951168 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod704a94f7_3001_4fc6_9838_4a2cb03a928b.slice/crio-a50f548f17dab054c07fbf748c72eeeaa636125d16ba505f1a995eb1bfcf3bee WatchSource:0}: Error finding container a50f548f17dab054c07fbf748c72eeeaa636125d16ba505f1a995eb1bfcf3bee: Status 404 returned error can't find the container with id a50f548f17dab054c07fbf748c72eeeaa636125d16ba505f1a995eb1bfcf3bee Jul 01 16:22:19.960712 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:19.960689 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:22:20.102521 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:20.102437 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" event={"ID":"704a94f7-3001-4fc6-9838-4a2cb03a928b","Type":"ContainerStarted","Data":"a50f548f17dab054c07fbf748c72eeeaa636125d16ba505f1a995eb1bfcf3bee"} Jul 01 16:22:21.108498 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:21.108458 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" event={"ID":"704a94f7-3001-4fc6-9838-4a2cb03a928b","Type":"ContainerStarted","Data":"b67c4f3ffb2df17aabfe3f8d3c80ad2490ba28cb55e6b91917f20afc7993ed4c"} Jul 01 16:22:21.128000 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:21.127941 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" podStartSLOduration=1.931117386 podStartE2EDuration="2.12792005s" totalImagesPullingTime="196.802664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:22:21.126590573 +0000 UTC m=+795.806215851" watchObservedRunningTime="2026-07-01 16:22:21.12792005 +0000 UTC m=+795.807545328" Jul 01 16:22:29.813314 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:29.813236 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:29.813314 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:29.813290 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:29.825503 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:29.825476 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:22:30.160527 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:22:30.160498 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5" Jul 01 16:23:17.357228 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.357191 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dfcd7bcd6-tkwdn"] Jul 01 16:23:17.359702 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.359682 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" Jul 01 16:23:17.377161 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.377135 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dfcd7bcd6-tkwdn"] Jul 01 16:23:17.383134 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.383104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa0ac713-a2f4-467b-bec8-e1a583d7de96-tls-cert\") pod \"authorino-5dfcd7bcd6-tkwdn\" (UID: \"fa0ac713-a2f4-467b-bec8-e1a583d7de96\") " pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" Jul 01 16:23:17.383286 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.383180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fa0ac713-a2f4-467b-bec8-e1a583d7de96-oidc-ca\") pod \"authorino-5dfcd7bcd6-tkwdn\" (UID: \"fa0ac713-a2f4-467b-bec8-e1a583d7de96\") " pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" Jul 01 16:23:17.383333 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.383287 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7fss\" (UniqueName: \"kubernetes.io/projected/fa0ac713-a2f4-467b-bec8-e1a583d7de96-kube-api-access-p7fss\") pod \"authorino-5dfcd7bcd6-tkwdn\" (UID: \"fa0ac713-a2f4-467b-bec8-e1a583d7de96\") " pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" Jul 01 16:23:17.484546 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.484513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fa0ac713-a2f4-467b-bec8-e1a583d7de96-oidc-ca\") pod \"authorino-5dfcd7bcd6-tkwdn\" (UID: \"fa0ac713-a2f4-467b-bec8-e1a583d7de96\") " pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" Jul 01 16:23:17.484724 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.484671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7fss\" (UniqueName: \"kubernetes.io/projected/fa0ac713-a2f4-467b-bec8-e1a583d7de96-kube-api-access-p7fss\") pod \"authorino-5dfcd7bcd6-tkwdn\" (UID: \"fa0ac713-a2f4-467b-bec8-e1a583d7de96\") " pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" Jul 01 16:23:17.484724 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.484713 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa0ac713-a2f4-467b-bec8-e1a583d7de96-tls-cert\") pod \"authorino-5dfcd7bcd6-tkwdn\" (UID: \"fa0ac713-a2f4-467b-bec8-e1a583d7de96\") " pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" Jul 01 16:23:17.485137 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.485120 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fa0ac713-a2f4-467b-bec8-e1a583d7de96-oidc-ca\") pod \"authorino-5dfcd7bcd6-tkwdn\" (UID: \"fa0ac713-a2f4-467b-bec8-e1a583d7de96\") " pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" Jul 01 16:23:17.487006 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.486984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa0ac713-a2f4-467b-bec8-e1a583d7de96-tls-cert\") pod \"authorino-5dfcd7bcd6-tkwdn\" (UID: \"fa0ac713-a2f4-467b-bec8-e1a583d7de96\") " pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" Jul 01 16:23:17.492168 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.492147 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7fss\" (UniqueName: \"kubernetes.io/projected/fa0ac713-a2f4-467b-bec8-e1a583d7de96-kube-api-access-p7fss\") pod \"authorino-5dfcd7bcd6-tkwdn\" (UID: \"fa0ac713-a2f4-467b-bec8-e1a583d7de96\") " pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" Jul 01 16:23:17.668798 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.668765 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" Jul 01 16:23:17.816276 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.816247 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dfcd7bcd6-tkwdn"] Jul 01 16:23:17.818878 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:23:17.818849 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa0ac713_a2f4_467b_bec8_e1a583d7de96.slice/crio-7ebbe5545c65cb1630c1a3c5bcd0c24a23efdbf9e1c77d736d6b1ad48cebf56a WatchSource:0}: Error finding container 7ebbe5545c65cb1630c1a3c5bcd0c24a23efdbf9e1c77d736d6b1ad48cebf56a: Status 404 returned error can't find the container with id 7ebbe5545c65cb1630c1a3c5bcd0c24a23efdbf9e1c77d736d6b1ad48cebf56a Jul 01 16:23:17.856807 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.856773 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:23:17.984477 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:17.984361 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:23:18.381839 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.381792 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" event={"ID":"fa0ac713-a2f4-467b-bec8-e1a583d7de96","Type":"ContainerStarted","Data":"3ffb0302d7d3a7505cec3cdafaed2403999a72f6950386bf51685353a1cfdb4a"} Jul 01 16:23:18.382238 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.381853 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" event={"ID":"fa0ac713-a2f4-467b-bec8-e1a583d7de96","Type":"ContainerStarted","Data":"7ebbe5545c65cb1630c1a3c5bcd0c24a23efdbf9e1c77d736d6b1ad48cebf56a"} Jul 01 16:23:18.522209 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.522104 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dfcd7bcd6-tkwdn" podStartSLOduration=1.072225665 podStartE2EDuration="1.522086587s" totalImagesPullingTime="449.860922ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:23:18.437757736 +0000 UTC m=+853.117382994" watchObservedRunningTime="2026-07-01 16:23:18.522086587 +0000 UTC m=+853.201711891" Jul 01 16:23:18.522376 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.522324 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f58566ddc-rdp8s"] Jul 01 16:23:18.522546 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.522524 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5f58566ddc-rdp8s" podUID="4b9981f9-b3be-4205-807d-5bf6ae88efb2" containerName="authorino" containerID="cri-o://c9c26f81b333634fe7d0e60cca1050392baf04ecf898c05bc7ca284075731ef1" gracePeriod=30 Jul 01 16:23:18.797161 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.797135 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58566ddc-rdp8s" Jul 01 16:23:18.896209 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.896178 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkc2k\" (UniqueName: \"kubernetes.io/projected/4b9981f9-b3be-4205-807d-5bf6ae88efb2-kube-api-access-hkc2k\") pod \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\" (UID: \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\") " Jul 01 16:23:18.896394 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.896216 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9981f9-b3be-4205-807d-5bf6ae88efb2-tls-cert\") pod \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\" (UID: \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\") " Jul 01 16:23:18.896394 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.896276 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4b9981f9-b3be-4205-807d-5bf6ae88efb2-oidc-ca\") pod \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\" (UID: \"4b9981f9-b3be-4205-807d-5bf6ae88efb2\") " Jul 01 16:23:18.898401 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.898367 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9981f9-b3be-4205-807d-5bf6ae88efb2-kube-api-access-hkc2k" (OuterVolumeSpecName: "kube-api-access-hkc2k") pod "4b9981f9-b3be-4205-807d-5bf6ae88efb2" (UID: "4b9981f9-b3be-4205-807d-5bf6ae88efb2"). InnerVolumeSpecName "kube-api-access-hkc2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:23:18.901189 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.901166 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b9981f9-b3be-4205-807d-5bf6ae88efb2-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "4b9981f9-b3be-4205-807d-5bf6ae88efb2" (UID: "4b9981f9-b3be-4205-807d-5bf6ae88efb2"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:23:18.906242 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.906216 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b9981f9-b3be-4205-807d-5bf6ae88efb2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4b9981f9-b3be-4205-807d-5bf6ae88efb2" (UID: "4b9981f9-b3be-4205-807d-5bf6ae88efb2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:23:18.966775 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.966732 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:23:18.998118 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.998077 2577 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4b9981f9-b3be-4205-807d-5bf6ae88efb2-oidc-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:23:18.998118 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.998119 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkc2k\" (UniqueName: \"kubernetes.io/projected/4b9981f9-b3be-4205-807d-5bf6ae88efb2-kube-api-access-hkc2k\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:23:18.998367 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:18.998145 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9981f9-b3be-4205-807d-5bf6ae88efb2-tls-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\"" Jul 01 16:23:19.059898 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:19.059809 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:23:19.388036 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:19.388008 2577 generic.go:356] "Generic (PLEG): container finished" podID="4b9981f9-b3be-4205-807d-5bf6ae88efb2" containerID="c9c26f81b333634fe7d0e60cca1050392baf04ecf898c05bc7ca284075731ef1" exitCode=0 Jul 01 16:23:19.388459 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:19.388050 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58566ddc-rdp8s" Jul 01 16:23:19.388459 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:19.388087 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f58566ddc-rdp8s" event={"ID":"4b9981f9-b3be-4205-807d-5bf6ae88efb2","Type":"ContainerDied","Data":"c9c26f81b333634fe7d0e60cca1050392baf04ecf898c05bc7ca284075731ef1"} Jul 01 16:23:19.388459 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:19.388121 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f58566ddc-rdp8s" event={"ID":"4b9981f9-b3be-4205-807d-5bf6ae88efb2","Type":"ContainerDied","Data":"800a899512a09f185bf23e4a83e4c72943669c9c12705fd0b99e475370337ecc"} Jul 01 16:23:19.388459 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:19.388140 2577 scope.go:117] "RemoveContainer" containerID="c9c26f81b333634fe7d0e60cca1050392baf04ecf898c05bc7ca284075731ef1" Jul 01 16:23:19.397272 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:19.397247 2577 scope.go:117] "RemoveContainer" containerID="c9c26f81b333634fe7d0e60cca1050392baf04ecf898c05bc7ca284075731ef1" Jul 01 16:23:19.397658 ip-10-0-130-217 kubenswrapper[2577]: E0701 16:23:19.397617 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9c26f81b333634fe7d0e60cca1050392baf04ecf898c05bc7ca284075731ef1\": container with ID starting with c9c26f81b333634fe7d0e60cca1050392baf04ecf898c05bc7ca284075731ef1 not found: ID does not exist" containerID="c9c26f81b333634fe7d0e60cca1050392baf04ecf898c05bc7ca284075731ef1" Jul 01 16:23:19.397769 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:19.397668 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c26f81b333634fe7d0e60cca1050392baf04ecf898c05bc7ca284075731ef1"} err="failed to get container status \"c9c26f81b333634fe7d0e60cca1050392baf04ecf898c05bc7ca284075731ef1\": rpc error: code = NotFound desc = could not find container \"c9c26f81b333634fe7d0e60cca1050392baf04ecf898c05bc7ca284075731ef1\": container with ID starting with c9c26f81b333634fe7d0e60cca1050392baf04ecf898c05bc7ca284075731ef1 not found: ID does not exist" Jul 01 16:23:19.415780 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:19.415749 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f58566ddc-rdp8s"] Jul 01 16:23:19.421224 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:19.421200 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f58566ddc-rdp8s"] Jul 01 16:23:19.803288 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:19.803211 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b9981f9-b3be-4205-807d-5bf6ae88efb2" path="/var/lib/kubelet/pods/4b9981f9-b3be-4205-807d-5bf6ae88efb2/volumes" Jul 01 16:23:34.296503 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:34.296471 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:23:41.509648 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:41.509598 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:23:57.232562 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:23:57.232477 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dfcd7bcd6-tkwdn_fa0ac713-a2f4-467b-bec8-e1a583d7de96/authorino/0.log" Jul 01 16:24:02.286924 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:02.286892 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5968f65d96-cszlc_98092218-bf7d-4f93-aa57-1161551eed13/nginx/0.log" Jul 01 16:24:02.524590 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:02.524559 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-8bzzf_deac0dd7-32cf-4cb5-8125-33165ed6f1dc/manager/0.log" Jul 01 16:24:02.640146 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:02.640119 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-zbdxc_ca5d03d2-e036-4b7b-b894-041b2c300160/manager/0.log" Jul 01 16:24:02.877154 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:02.877123 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-wxlx7_38366358-fab3-4789-af8b-dbe453873de5/server/0.log" Jul 01 16:24:02.990865 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:02.990790 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-fr8pd_fa3a3337-9826-4513-a910-2087a6973cf8/manager/0.log" Jul 01 16:24:03.237815 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:03.237790 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cbf7fc9f-qr645_346991bd-db84-401d-a137-67831b2468e1/copy-manifests/0.log" Jul 01 16:24:03.250582 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:03.250508 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cbf7fc9f-qr645_346991bd-db84-401d-a137-67831b2468e1/manager/0.log" Jul 01 16:24:04.667996 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:04.667958 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dfcd7bcd6-tkwdn_fa0ac713-a2f4-467b-bec8-e1a583d7de96/authorino/0.log" Jul 01 16:24:04.795088 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:04.795058 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-f42xb_0cde2c7f-7c4e-47e5-ab5e-3619dadd0e03/manager/0.log" Jul 01 16:24:05.136995 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:05.136969 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nsmhf_9bf1e4f9-6690-4c05-b499-9546b4f59861/registry-server/0.log" Jul 01 16:24:05.254745 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:05.254716 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9gp76_75634504-b52d-4daa-a4bd-e155f847d8b8/manager/0.log" Jul 01 16:24:05.798555 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:05.798524 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvpld_21eb759a-7b1e-4ac1-aab1-00429b75021c/ovn-acl-logging/0.log" Jul 01 16:24:05.799042 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:05.798674 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jvpld_21eb759a-7b1e-4ac1-aab1-00429b75021c/ovn-acl-logging/0.log" Jul 01 16:24:05.839286 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:05.839250 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nxdtm_9524b75b-5618-4b7a-b301-20fca5034132/istio-proxy/0.log" Jul 01 16:24:06.069134 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:06.069053 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5545fb4b4d-bf58p_e9d9bad5-6bf5-479a-8479-7b5d62e22f3a/kube-auth-proxy/0.log" Jul 01 16:24:06.284369 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:06.284343 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-krgt9_27f33efb-55f1-4440-b577-1639fd054ea5/istio-proxy/1.log" Jul 01 16:24:07.288527 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:07.288497 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649ttdbp_55e2b993-e058-4747-b9ac-e4b5e81dd9ed/main/0.log" Jul 01 16:24:07.524873 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:07.524845 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6cfb9f9b9c-v2jm5_704a94f7-3001-4fc6-9838-4a2cb03a928b/main/0.log" Jul 01 16:24:12.064341 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:12.064309 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:24:12.173226 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:12.173194 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" limit=1024 Jul 01 16:24:14.996239 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:14.996206 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j8fcp_380e01c0-55b2-48ce-ae9e-b1a515fed1a5/global-pull-secret-syncer/0.log" Jul 01 16:24:15.047920 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:15.047894 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ckhcp_887c4c96-28a9-4186-94ff-331743b555e5/konnectivity-agent/0.log" Jul 01 16:24:15.143408 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:15.143380 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-217.ec2.internal_fcd975de0452e008bc237379d64b3e7d/haproxy/0.log" Jul 01 16:24:19.950681 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:19.950653 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dfcd7bcd6-tkwdn_fa0ac713-a2f4-467b-bec8-e1a583d7de96/authorino/0.log" Jul 01 16:24:19.991175 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:19.991139 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-f42xb_0cde2c7f-7c4e-47e5-ab5e-3619dadd0e03/manager/0.log" Jul 01 16:24:20.090179 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:20.090153 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nsmhf_9bf1e4f9-6690-4c05-b499-9546b4f59861/registry-server/0.log" Jul 01 16:24:20.153279 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:20.153245 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9gp76_75634504-b52d-4daa-a4bd-e155f847d8b8/manager/0.log" Jul 01 16:24:22.585231 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:22.585200 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tmtx2_164884a9-7595-4216-87ea-e550ba7fa0ea/node-exporter/0.log" Jul 01 16:24:22.624209 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:22.624185 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tmtx2_164884a9-7595-4216-87ea-e550ba7fa0ea/kube-rbac-proxy/0.log" Jul 01 16:24:22.662446 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:22.662426 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tmtx2_164884a9-7595-4216-87ea-e550ba7fa0ea/init-textfile/0.log" Jul 01 16:24:26.093550 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.093520 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5"] Jul 01 16:24:26.093928 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.093893 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9981f9-b3be-4205-807d-5bf6ae88efb2" containerName="authorino" Jul 01 16:24:26.093928 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.093910 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9981f9-b3be-4205-807d-5bf6ae88efb2" containerName="authorino" Jul 01 16:24:26.094000 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.093976 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b9981f9-b3be-4205-807d-5bf6ae88efb2" containerName="authorino" Jul 01 16:24:26.096085 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.096060 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.098479 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.098456 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wddzr\"/\"default-dockercfg-x8ctx\"" Jul 01 16:24:26.098604 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.098458 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wddzr\"/\"kube-root-ca.crt\"" Jul 01 16:24:26.098604 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.098503 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wddzr\"/\"openshift-service-ca.crt\"" Jul 01 16:24:26.108568 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.108542 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5"] Jul 01 16:24:26.148986 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.148957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/366870e3-5f8d-4941-a6d2-6abb7fa98706-sys\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.149135 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.148990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/366870e3-5f8d-4941-a6d2-6abb7fa98706-lib-modules\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.149135 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.149010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/366870e3-5f8d-4941-a6d2-6abb7fa98706-podres\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.149135 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.149066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/366870e3-5f8d-4941-a6d2-6abb7fa98706-proc\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.149135 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.149097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fmg2\" (UniqueName: \"kubernetes.io/projected/366870e3-5f8d-4941-a6d2-6abb7fa98706-kube-api-access-7fmg2\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.249951 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.249854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/366870e3-5f8d-4941-a6d2-6abb7fa98706-proc\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.250112 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.249976 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/366870e3-5f8d-4941-a6d2-6abb7fa98706-proc\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.250112 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.249995 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fmg2\" (UniqueName: \"kubernetes.io/projected/366870e3-5f8d-4941-a6d2-6abb7fa98706-kube-api-access-7fmg2\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.250112 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.250051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/366870e3-5f8d-4941-a6d2-6abb7fa98706-sys\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.250112 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.250084 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/366870e3-5f8d-4941-a6d2-6abb7fa98706-lib-modules\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.250112 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.250111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/366870e3-5f8d-4941-a6d2-6abb7fa98706-podres\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.250311 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.250171 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/366870e3-5f8d-4941-a6d2-6abb7fa98706-sys\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.250311 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.250252 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/366870e3-5f8d-4941-a6d2-6abb7fa98706-podres\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.250311 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.250253 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/366870e3-5f8d-4941-a6d2-6abb7fa98706-lib-modules\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.258815 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.258793 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fmg2\" (UniqueName: \"kubernetes.io/projected/366870e3-5f8d-4941-a6d2-6abb7fa98706-kube-api-access-7fmg2\") pod \"perf-node-gather-daemonset-tg9t5\" (UID: \"366870e3-5f8d-4941-a6d2-6abb7fa98706\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.413006 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.412978 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.538029 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.538005 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5"] Jul 01 16:24:26.540133 ip-10-0-130-217 kubenswrapper[2577]: W0701 16:24:26.540108 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod366870e3_5f8d_4941_a6d2_6abb7fa98706.slice/crio-e534402e49b9ec57fa9376efd50e60bcfaf653e30aab7681a88ba3ecee3f3f32 WatchSource:0}: Error finding container e534402e49b9ec57fa9376efd50e60bcfaf653e30aab7681a88ba3ecee3f3f32: Status 404 returned error can't find the container with id e534402e49b9ec57fa9376efd50e60bcfaf653e30aab7681a88ba3ecee3f3f32 Jul 01 16:24:26.698530 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.698463 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" event={"ID":"366870e3-5f8d-4941-a6d2-6abb7fa98706","Type":"ContainerStarted","Data":"e086faf71e8fffea9ca1e3b7e8f3bc9feb5e7946098e75a08bd6d9f90b0a3c3f"} Jul 01 16:24:26.698530 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.698511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" event={"ID":"366870e3-5f8d-4941-a6d2-6abb7fa98706","Type":"ContainerStarted","Data":"e534402e49b9ec57fa9376efd50e60bcfaf653e30aab7681a88ba3ecee3f3f32"} Jul 01 16:24:26.698702 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.698583 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:26.715871 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:26.715826 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" podStartSLOduration=0.715812371 podStartE2EDuration="715.812371ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:24:26.714130335 +0000 UTC m=+921.393755613" watchObservedRunningTime="2026-07-01 16:24:26.715812371 +0000 UTC m=+921.395437647" Jul 01 16:24:27.745411 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:27.745381 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fdgjg_6cfab973-2b3d-4bb4-8ce1-a77cf8609572/dns/0.log" Jul 01 16:24:27.768792 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:27.768768 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fdgjg_6cfab973-2b3d-4bb4-8ce1-a77cf8609572/kube-rbac-proxy/0.log" Jul 01 16:24:27.927093 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:27.927053 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b86ld_97f53243-652b-4225-88e1-8f0b6c55bcd0/dns-node-resolver/0.log" Jul 01 16:24:28.537732 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:28.537699 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5h5b6_534f29c6-46ba-43f3-b9eb-25c35d9302b1/node-ca/0.log" Jul 01 16:24:29.674200 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:29.674166 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nxdtm_9524b75b-5618-4b7a-b301-20fca5034132/istio-proxy/0.log" Jul 01 16:24:29.769689 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:29.769663 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5545fb4b4d-bf58p_e9d9bad5-6bf5-479a-8479-7b5d62e22f3a/kube-auth-proxy/0.log" Jul 01 16:24:29.833216 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:29.833145 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-krgt9_27f33efb-55f1-4440-b577-1639fd054ea5/istio-proxy/1.log" Jul 01 16:24:29.833397 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:29.833380 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-krgt9_27f33efb-55f1-4440-b577-1639fd054ea5/istio-proxy/0.log" Jul 01 16:24:30.616534 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:30.616508 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bnrhw_f3795109-23f9-4bf7-8d5f-20175be5e56f/serve-healthcheck-canary/0.log" Jul 01 16:24:31.378243 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:31.378215 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8kmq4_1d61ef3f-9eca-48a4-957a-06523c974be6/kube-rbac-proxy/0.log" Jul 01 16:24:31.402300 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:31.402276 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8kmq4_1d61ef3f-9eca-48a4-957a-06523c974be6/exporter/0.log" Jul 01 16:24:31.429095 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:31.429069 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8kmq4_1d61ef3f-9eca-48a4-957a-06523c974be6/extractor/0.log" Jul 01 16:24:32.712843 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:32.712817 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-tg9t5" Jul 01 16:24:33.752388 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:33.752362 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5968f65d96-cszlc_98092218-bf7d-4f93-aa57-1161551eed13/nginx/0.log" Jul 01 16:24:33.806988 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:33.806965 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-8bzzf_deac0dd7-32cf-4cb5-8125-33165ed6f1dc/manager/0.log" Jul 01 16:24:33.842927 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:33.842896 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-zbdxc_ca5d03d2-e036-4b7b-b894-041b2c300160/manager/0.log" Jul 01 16:24:33.901296 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:33.901271 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-wxlx7_38366358-fab3-4789-af8b-dbe453873de5/server/0.log" Jul 01 16:24:33.950583 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:33.950554 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-fr8pd_fa3a3337-9826-4513-a910-2087a6973cf8/manager/0.log" Jul 01 16:24:34.058286 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:34.058204 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cbf7fc9f-qr645_346991bd-db84-401d-a137-67831b2468e1/manager/0.log" Jul 01 16:24:34.083925 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:34.083900 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cbf7fc9f-qr645_346991bd-db84-401d-a137-67831b2468e1/copy-manifests/0.log" Jul 01 16:24:35.011298 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:35.011199 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nxdtm_9524b75b-5618-4b7a-b301-20fca5034132/istio-proxy/0.log" Jul 01 16:24:35.077815 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:35.077785 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5545fb4b4d-bf58p_e9d9bad5-6bf5-479a-8479-7b5d62e22f3a/kube-auth-proxy/0.log" Jul 01 16:24:35.127559 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:35.127535 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-krgt9_27f33efb-55f1-4440-b577-1639fd054ea5/istio-proxy/1.log" Jul 01 16:24:35.127760 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:35.127747 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-krgt9_27f33efb-55f1-4440-b577-1639fd054ea5/istio-proxy/0.log" Jul 01 16:24:35.780803 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:35.780773 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dk7rm_e3e41914-7603-45d6-a2a7-513a0564c9be/openshift-lws-operator/0.log" Jul 01 16:24:36.434703 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:36.434672 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nxdtm_9524b75b-5618-4b7a-b301-20fca5034132/istio-proxy/0.log" Jul 01 16:24:36.506382 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:36.506358 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5545fb4b4d-bf58p_e9d9bad5-6bf5-479a-8479-7b5d62e22f3a/kube-auth-proxy/0.log" Jul 01 16:24:36.547813 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:36.547748 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-krgt9_27f33efb-55f1-4440-b577-1639fd054ea5/istio-proxy/1.log" Jul 01 16:24:36.547978 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:36.547919 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-krgt9_27f33efb-55f1-4440-b577-1639fd054ea5/istio-proxy/0.log" Jul 01 16:24:41.130575 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:41.130541 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-cdwd8_8322bee6-bf25-42e2-abc9-8ee401d9ac9c/migrator/0.log" Jul 01 16:24:41.183545 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:41.183519 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-cdwd8_8322bee6-bf25-42e2-abc9-8ee401d9ac9c/graceful-termination/0.log" Jul 01 16:24:42.814077 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:42.814048 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p59n9_81a3ab17-7e6c-4684-ac86-b8daef81a806/kube-multus-additional-cni-plugins/0.log" Jul 01 16:24:42.837872 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:42.837848 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p59n9_81a3ab17-7e6c-4684-ac86-b8daef81a806/egress-router-binary-copy/0.log" Jul 01 16:24:42.861553 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:42.861532 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p59n9_81a3ab17-7e6c-4684-ac86-b8daef81a806/cni-plugins/0.log" Jul 01 16:24:42.888080 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:42.888061 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p59n9_81a3ab17-7e6c-4684-ac86-b8daef81a806/bond-cni-plugin/0.log" Jul 01 16:24:42.911574 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:42.911555 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p59n9_81a3ab17-7e6c-4684-ac86-b8daef81a806/routeoverride-cni/0.log" Jul 01 16:24:42.934693 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:42.934668 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p59n9_81a3ab17-7e6c-4684-ac86-b8daef81a806/whereabouts-cni-bincopy/0.log" Jul 01 16:24:42.959184 ip-10-0-130-217 kubenswrapper[2577]: I0701 16:24:42.959166 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p59n9_81a3ab17-7e6c-4684-ac86-b8daef81a806/whereabouts-cni/0.log"